How Does Multilevel Regression and Poststratification Perform with Conventional National Surveys?

Multilevel regression and poststratification (MRP) is a method to estimate public opinion across geographic units from individual-level survey data. If it works with samples the size of typical national surveys, then MRP offers the possibility of analyzing many political phenomena previously believed to be outside the bounds of systematic empirical inquiry. Initial investigations of its performance with conventional national samples produce generally optimistic assessments. This article examines a larger number of cases and a greater range of opinions than in previous studies and finds substantial variation in MRP performance. Through empirical and Monte Carlo analyses, we develop an explanation for this variation. The findings suggest that the conditions necessary for MRP to perform well will not always be met. Thus, we draw a less optimistic conclusion than previous studies do regarding the use of MRP with samples of the size found in typical national surveys.

[1]  Jonathan Rodden,et al.  How Should We Measure District-Level Public Opinion on Individual Issues? , 2012, The Journal of Politics.

[2]  Jeffrey R. Lax,et al.  The Democratic Deficit in the States , 2012 .

[3]  Julianna Pacheco Using National Surveys to Measure Dynamic U.S. State Public Opinion , 2011, State Politics & Policy Quarterly.

[4]  R. Y. Shapiro Public Opinion and American Democracy , 2011 .

[5]  Simon Munzert,et al.  Estimating Constituency Preferences from Sparse Survey Data Using Auxiliary Geographic Information , 2011, Political Analysis.

[6]  Jonathan P. Kastellec,et al.  Public Opinion and Senate Confirmation of Supreme Court Nominees , 2010 .

[7]  Jeffrey R. Lax,et al.  Gay Rights in the States: Public Opinion and Policy Responsiveness , 2009, American Political Science Review.

[8]  Joseph Hilbe,et al.  Data Analysis Using Regression and Multilevel/Hierarchical Models , 2009 .

[9]  Andrew Gelman,et al.  State-Level Opinions from National Surveys: Poststratification using Multilevel Logistic Regression , 2009 .

[10]  Jeffrey R. Lax,et al.  How Should We Estimate Public Opinion in the States , 2009 .

[11]  Kenneth K. Wong,et al.  Ten Thousand Democracies: Politics and Public Opinion in America's School Districts by Michael B. Berkman and Eric Plutzer , 2007 .

[12]  E. Plutzer,et al.  Ten Thousand Democracies: Politics and Public Opinion in America's School Districts , 2005 .

[13]  Andrew Gelman,et al.  Bayesian Multilevel Estimation with Poststratification: State-Level Estimates from National Polls , 2004, Political Analysis.

[14]  Kevin Arceneaux The “Gender Gap” in State Legislative Representation: New Data to Tackle an Old Question , 2001 .

[15]  Warren E. Miller,et al.  Constituency Influence in Congress , 1963, American Political Science Review.