skip to content

New Article published in Political Analysis

Testing the Validity of Automatic Speech Recognition for Political Text Analysis

A new article has been published by Sven-Oliver Proksch, Jens Wäckerle and Christopher Wratil: "Testing the Validity of Automatic Speech Recognition for Political Text Analysis" was published in Political Analysis,

https://doi.org/10.1017/pan.2018.62.

Abstract:

The analysis of political texts from parliamentary speeches, party manifestos, social media, or press releases forms the basis of major and growing fields in political science, not least since advances in “text-as-data” methods have rendered the analysis of large text corpora straightforward. However, a lot of sources of political speech are not regularly transcribed, and their on-demand transcription by humans is prohibitively expensive for research purposes. This class includes political speech in certain legislatures, during political party conferences as well as television interviews and talk shows. We showcase how scholars can use automatic speech recognition systems to analyze such speech with quantitative text analysis models of the “bag-of-words” variety. To probe results for robustness to transcription error, we present an original “word error rate simulation” (WERSIM) procedure implemented in R . We demonstrate the potential of automatic speech recognition to address open questions in political science with two substantive applications and discuss its limitations and practical challenges.