Measuring Political Positions from Legislative Speech

Existing approaches to measuring political disagreement from text data perform poorly except when applied to narrowly selected texts discussing the same issues and written in the same style. We demonstrate the first viable approach for estimating legislator-specific scores from the entire speech corpus of a legislature, while also producing extensive information about the evolution of speech polarization and politically loaded language. In the Irish Dáil, we show that the dominant dimension of speech variation is government–opposition, with ministers more extreme on this dimension than backbenchers, and a second dimension distinguishing between the establishment and anti-establishment opposition parties. In the U. S. Senate, we estimate a dimension that has moderate within-party correlations with scales based on roll-call votes and campaign donation patterns; however, we observe greater overlap across parties in speech positions than roll-call positions and partisan polarization in speeches varies more clearly in response to major political events.

[1]  K. T. Poole,et al.  A Spatial Model for Legislative Roll Call Analysis , 1985 .

[2]  Michael Laver,et al.  Multiparty Government: The Politics of Coalition in Europe , 1990 .

[3]  Can We Learn the Causes of Congressional Decisions from Roll-Call Data? , 1990 .

[4]  K. T. Poole,et al.  Congress: A Political-Economic History of Roll Call Voting , 1997 .

[5]  M. Laver MODELS OF GOVERNMENT FORMATION , 1998 .

[6]  John D. Huber,et al.  Institutions and Strategy in Parliamentary Democracy: A Review Article@@@Rationalizing Parliament: Legislative Institutions and Party Politics in France@@@Making and Breaking Governments: Cabinets and Legislatures in Parliamentary Democracies , 1998 .

[7]  Wolfgang C. Müller,et al.  Coalition Governments in Western Europe , 2000 .

[8]  M. Laver,et al.  Estimating policy positions from political texts , 2000 .

[9]  I. Budge Validating Party Policy Placements , 2001, British Journal of Political Science.

[10]  Michael F. Thies Keeping Tabs on Partners: The Logic of Delegation in Coalition Governments , 2001 .

[11]  Kenneth Benoit,et al.  Locating TDs in Policy Spaces: The Computational Text Analysis of Dáil Speeches , 2002 .

[12]  Andrew D. Martin,et al.  Dynamic Ideal Point Estimation via Markov Chain Monte Carlo for the U.S. Supreme Court, 1953–1999 , 2002, Political Analysis.

[13]  M. Laver,et al.  Extracting Policy Positions from Political Texts Using Words as Data , 2003, American Political Science Review.

[14]  Lanny W. Martin,et al.  Policing the Bargain: Coalition Government and Parliamentary Scrutiny , 2004 .

[15]  Joshua D. Clinton,et al.  The Statistical Analysis of Roll Call Data , 2004, American Political Science Review.

[16]  G. Young,et al.  Electoral Context and MP Constituency Focus in Australia, Canada, Ireland, New Zealand, and the United Kingdom , 2005 .

[17]  S. Hix,et al.  Power to the Parties: Cohesion and Competition in the European Parliament, 1979–2001 , 2005, British Journal of Political Science.

[18]  M. Laver,et al.  Policy positions and jobs in the government , 2005 .

[19]  Kenneth Benoit,et al.  Party Policy in Modern Democracies , 2006 .

[20]  M. Gabel,et al.  Off the Record: Unrecorded Legislative Votes, Selection Bias and Roll-Call Vote Analysis , 2006, British Journal of Political Science.

[21]  Sven-Oliver Proksch,et al.  A Scaling Model for Estimating Time-Series Party Positions from Texts , 2007 .

[22]  Michael Marsh Candidates or Parties? , 2007 .

[23]  I. McLean,et al.  UK OC OK? Interpreting Optimal Classification Scores for the U.K. House of Commons , 2007, Political Analysis.

[24]  Simon Hug,et al.  Legislative Voting Behavior, Seen and Unseen: A Theory of Roll-Call Vote Selection , 2008 .

[25]  W. Müller,et al.  Cabinets and coalition bargaining : The democratic life cycle in Western Europe , 2008 .

[26]  W. Lowe,et al.  Understanding Wordscores , 2008, Political Analysis.

[27]  Lanny W. Martin,et al.  Coalition Government and Political Communication , 2008 .

[28]  S. Hug Selection Effects in Roll Call Votes , 2006, British Journal of Political Science.

[29]  Kenneth Benoit,et al.  Treating Words as Data with Error: Uncertainty in Text Statements of Policy Positions , 2009 .

[30]  E. Martin The government and the Taoiseach , 2009 .

[31]  M. Hansen The Positions of Irish Parliamentary Parties 1937–2006 , 2009 .

[32]  K. Benoit,et al.  Intra-party politics and coalition governments , 2009 .

[33]  Barbara Palmer,et al.  The Roll Call Behavior of Men and Women in the U.S. House of Representatives, 1937–2008 , 2010, Politics & Gender.

[34]  Dragomir R. Radev,et al.  How to Analyze Political Attention with Minimal Assumptions and Costs , 2010 .

[35]  Jonathan B. Slapin,et al.  Position Taking in European Parliament Speeches , 2010 .

[36]  Benjamin E. Lauderdale,et al.  Unpredictable Voters in Ideal Point Estimation , 2010, Political Analysis.

[37]  Lanny W. Martin,et al.  Parliaments and Coalitions: The Role of Legislative Institutions in Multiparty Governance , 2011 .

[38]  Dirk Eddelbuettel,et al.  Rcpp: Seamless R and C++ Integration , 2011 .

[39]  Benjamin E. Lauderdale,et al.  Distinguishing between influences on brazilian legislative behavior , 2011 .

[40]  Lanny W. Martin,et al.  Parliaments and Coalitions , 2011 .

[41]  Will Lowe Mzes,et al.  Estimating Uncertainty in Quantitative Text Analysis ∗ , 2011 .

[42]  G. Cox,et al.  Shadowing Ministers , 2012 .

[43]  Jonathan B. Slapin,et al.  Institutional Foundations of Legislative Speech , 2012 .

[44]  Markus Wagner Party Discipline and Parliamentary Politics , 2012 .

[45]  Will Lowe There's (Basically) Only One Way to Do it , 2013 .

[46]  Justin Grimmer Representational Style in Congress: What Legislators Say and Why It Matters , 2013 .

[47]  Justin Grimmer,et al.  Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts , 2013, Political Analysis.

[48]  Adam Bonica,et al.  Mapping the Ideological Marketplace , 2013 .

[49]  Adam Bonica Mapping the Ideological Marketplace: MAPPING THE IDEOLOGICAL MARKETPLACE , 2014 .

[50]  M. Laver Measuring Policy Positions in Political Space , 2014 .

[51]  Tom S. Clark,et al.  Scaling Politically Meaningful Dimensions Using Texts and Votes , 2014 .

[52]  Yael Shomer,et al.  No News Is News: Nonignorable Nonresponse in Roll‐Call Data Analysis , 2015 .

[53]  Kenneth Benoit,et al.  quanteda: Quantitative Analysis of Textual Data (R package) , 2015 .

[54]  Lanny W. Martin,et al.  Coalition formation and policymaking in parliamentary democracies , 2015 .

[55]  Kenneth Benoit,et al.  Estimating Intra-Party Preferences: Comparing Speeches to Votes* , 2015, Political Science Research and Methods.

[56]  Kenneth Benoit,et al.  The Most Unkindest Cuts: Speaker Selection and Expressed Government Dissent during Economic Crisis , 2015, The Journal of Politics.

[57]  M. Gallagher,et al.  The Constituency Role of Dáil Deputies , 2017 .

[58]  L. Weeks Parties and the party system , 2017 .