ID | 156707 |
Title Proper | Pairwise comparison framework for fast, flexible, and reliable human coding of political texts |
Language | ENG |
Author | Montgomery, Jacob M ; CARLSON, DAVID |
Summary / Abstract (Note) | Scholars are increasingly utilizing online workforces to encode latent political concepts embedded in written or spoken records. In this letter, we build on past efforts by developing and validating a crowdsourced pairwise comparison framework for encoding political texts that combines the human ability to understand natural language with the ability of computers to aggregate data into reliable measures while ameliorating concerns about the biases and unreliability of non-expert human coders. We validate the method with advertisements for U.S. Senate candidates and with State Department reports on human rights. The framework we present is very general, and we provide free software to help applied researchers interact easily with online workforces to extract meaningful measures from texts. |
`In' analytical Note | American Political Science Review Vol. 111, No.4; Nov 2017: p.835-843 |
Journal Source | American Political Science Review 2017-12 111, 4 |
Key Words | Flexible ; Pairwise Comparison Framework ; Fast ; Reliable Human Coding ; Political Texts |