Predicting Elections: Considering Tools to Pool the Polls

Surveys have long been critical tools for understanding elections and forecasting their results. As the number of election surveys has increased in prevalence, researchers, journalists, and standalone political bloggers have sought to learn from the wealth of information released. This paper explores three central strategies for pooling surveys and other information to better understand both the state of an election and what can be expected when voters head to the polls. Aggregation, predictive modeling, and hybrid models are assessed as ways of improving on the results of individual surveys. For each method, central questions, key choices, applications, and considerations for use are discussed. Trade-offs in choices between pooling strategies are considered, and the accuracies of each set of strategies for forecasting results in 2012 are compared. Although hybrid models have the potential to most accurately pool election information and make predictions, the simplicity of aggregations and the theory-testing capacity of predictive models can sometimes prove more valuable.

[1]  Larry M. Bartels Pooling Disparate Observations , 1996 .

[2]  Christopher Wlezien,et al.  The Fundamentals, the Polls, and the Presidential Vote , 2004, PS: Political Science & Politics.

[3]  Robert S. Erikson,et al.  Are Political Markets Really Superior to Polls as Election Predictors , 2008 .

[4]  Irving Crespi Pre-election polling , 1988 .

[5]  Robert S. Erikson,et al.  Presidential Polls as a Time Series: The Case of 1996 , 1999 .

[6]  Costas Panagopoulos Polls and Elections: Preelection Poll Accuracy in the 2008 General Elections , 2009 .

[7]  M. Lavine Sensitivity in Bayesian Statistics: The Prior and the Likelihood , 1991 .

[8]  R. Dahl Myth of the Presidential Mandate , 1990 .

[9]  Jeff Gill,et al.  Bayesian Methods : A Social and Behavioral Sciences Approach , 2002 .

[10]  Adam J. Berinsky,et al.  American Public Opinion in the 1930s and 1940s The Analysis of Quota-Controlled Sample Survey Data , 2006 .

[11]  Andrew Gelman,et al.  Bayesian Combination of State Polls and Election Forecasts , 2010, Political Analysis.

[12]  John M. Sides,et al.  The Gamble: Choice and Chance in the 2012 Presidential Election - Updated Edition , 2013 .

[13]  James E. Campbell,et al.  Trial-Heat Forecasts of the Presidential Vote , 1990 .

[14]  Seymour Sudman,et al.  Survey Research in the United States: Roots and Emergence 1890-1960. , 1987 .

[15]  Gary King,et al.  Why Are American Presidential Election Campaign Polls So Variable When Votes Are So Predictable? , 1993, British Journal of Political Science.

[16]  Thomas M. Holbrook,et al.  Statewide trial-heat polls and the 2000 presidential election: A forecast model , 2003 .

[17]  Jon A. Krosnick,et al.  Optimizing Survey Questionnaire Design in Political Science , 2010 .

[18]  Dean Lacy,et al.  The Vote-Stealing and Turnout Effects of Ross Perot in the 1992 U.S. Presidential Election , 1999 .

[19]  Jon A. Krosnick,et al.  Research Synthesis AAPOR Report on Online Panels , 2010 .

[20]  James E. Campbell Introduction—The 2004 Presidential Election Forecasts , 2004, PS: Political Science & Politics.

[21]  M. Abrams THE OPINION POLLS AND THE 1970 BRITISH GENERAL ELECTION , 1970 .

[22]  Helmut Norpoth,et al.  History and Primary: The Obama Reelection , 2012, PS: Political Science & Politics.

[23]  R. Little To Model or Not To Model? Competing Modes of Inference for Finite Population Sampling , 2004 .

[24]  S. Keeter,et al.  Cell-Phone-Only Voters in the 2008 Exit Poll and Implications for Future Noncoverage Bias , 2009 .

[25]  Stefan Van Dongen,et al.  Prior specification in Bayesian statistics: three cautionary tales. , 2006 .

[26]  Gary King,et al.  THE POLLS-A REVIEW PREELECTION SURVEY METHODOLOGY: DETAILS FROM EIGHT POLLING ORGANIZATIONS, 1988 AND 1992 , 1995 .

[27]  Florian M. Hollenbach,et al.  Ensemble Predictions of the 2012 US Presidential Election , 2012, PS: Political Science & Politics.

[28]  Kathleen A. Frankovic,et al.  Review: Horserace Polling and Survey Method Effects: An Analysis of the 2000 Campaign , 2003 .

[29]  The fundamentals in US presidential elections: Public opinion, the economy and incumbency in the 2004 presidential election , 2005 .

[30]  P. Bohm,et al.  Political Stock Markets and Unreliable Polls , 1999 .

[31]  Michael E. Sobel,et al.  Forecasting the Vote: A Theoretical Comparison of Election Markets and Public Opinion Polls , 2004, Political Analysis.

[32]  D. Green,et al.  Tracking Opinion over Time: A method for Reducing Sampling Error , 1999 .

[33]  David Rothschild,et al.  Forecasting Elections Comparing Prediction Markets, Polls, and Their Biases , 2009 .

[34]  Kyu S. Hahn,et al.  Consumer Demand for Election News: The Horserace Sells , 2004, The Journal of Politics.

[35]  Charlotte Steeh,et al.  The State of Surveying Cell Phone Numbers in the United States , 2007 .

[36]  James E. Campbell Forecasting the Presidential Vote in the States , 1992 .

[37]  Michael S. Lewis-Beck,et al.  The Job of President and the Jobs Model Forecast: Obama for '08? , 2008, PS: Political Science & Politics.

[38]  James E. Campbell Polls and Votes , 1996 .

[39]  Mark M. Blumenthal,et al.  Polls, Forecasts, and Aggregators , 2014, PS: Political Science & Politics.

[40]  S. Jackman BAYESIAN ANALYSIS FOR POLITICAL RESEARCH , 2004 .

[41]  The Objective and Subjective Economy and the Presidential Vote , 2012, PS: Political Science & Politics.

[42]  Michael S. Lewis-Beck,et al.  Election Forecasting: Principles and Practice , 2005 .

[43]  Archibald M. Crossley STRAW POLLS IN 1936 , 1937 .

[44]  James E. Campbell Forecasting the 2012 American National Elections , 2012, PS: Political Science & Politics.

[45]  J. Scott Armstrong,et al.  Principles of forecasting : a handbook for researchers and practitioners , 2001 .

[46]  Ilias P. Tatsiopoulos,et al.  PREDICTION MARKETS: AN EXTENDED LITERATURE REVIEW , 2007 .

[47]  Simon Jackman,et al.  Pooling the polls over an election campaign , 2005 .

[48]  Drew A. Linzer Dynamic Bayesian Forecasting of Presidential Elections in the States , 2013 .

[49]  Robert M. Groves,et al.  Total Survey Error: Past, Present, and Future , 2010 .

[50]  Frederick Mosteller,et al.  On Pooling Data , 1948 .

[51]  Market Design, Manipulation, and Accuracy in Political Prediction Markets: Lessons from the Iowa Electronic Markets , 2014, PS: Political Science & Politics.

[52]  D. Sunshine Hillygus,et al.  The Evolution of Election Polling in the United States , 2011 .

[53]  Sheldon H. Jacobson,et al.  A Bayesian Prediction Model for the U.S. Presidential Election , 2009 .

[54]  John M. Sides,et al.  Four Suggestions for Making Election Forecasts Better, and Better Known , 2014, PS: Political Science & Politics.

[55]  D. Shaw A Study of Presidential Campaign Event Effects from 1952 to 1992 , 1999, The Journal of Politics.

[56]  Mark Pickup,et al.  Campaign trial heats as election forecasts: Measurement error and bias in 2004 presidential campaign polls , 2008 .

[57]  Michael W. Traugott,et al.  The Accuracy of the National Preelection Polls in the 2004 Presidential Election , 2005 .

[58]  J. Wolfers,et al.  including © notice, is given to the source. Prediction Markets for Economic Forecasting , 2012 .

[59]  William F. Christensen,et al.  Predicting Presidential and Other Multistage Election Outcomes Using State-Level Pre-Election Polls , 2008 .

[60]  S. Soroka,et al.  Campaigns and the prediction of election outcomes: Can historical and campaign-period prediction models be combined? , 2012 .

[61]  Seymour Sudman,et al.  Numbered Voices: How Opinion Polling Has Shaped American Politics. , 1993 .

[62]  Seth C. McKee,et al.  The Electoral College, Mobilization, and Turnout in the 2000 Presidential Election , 2005 .

[63]  D. Katz THE PUBLIC OPINION POLLS AND THE 1940 ELECTION , 1941 .

[64]  S. Jackman The Predictive Power of Uniform Swing , 2014, PS: Political Science & Politics.

[65]  Andreas Graefe,et al.  Combining Forecasts: An Application to Elections , 2013 .

[66]  Henry W. Chappell,et al.  Forecasting presidential elections using history and polls , 1999 .

[67]  David W. Moore The Opinion Makers: An Insider Exposes the Truth Behind the Polls , 2008 .

[68]  James E. Campbell Editor's Introduction: Forecasting the 2008 National Elections , 2008, PS: Political Science & Politics.

[69]  Christopher Wlezien,et al.  Likely (and Unlikely) Voters and the Assessment of Campaign Dynamics , 2004 .

[70]  Thomas M. Holbrook,et al.  Using state polls to forecast presidential election outcomes in the American states , 1999 .

[71]  Jeff Gill,et al.  What are Bayesian Methods , 2008 .

[72]  W. Mitofsky Review: Was 1996 a Worse Year for Polls than 1948? , 1998 .

[73]  Robert S. Erikson,et al.  Leading Economic Indicators, the Polls, and the Presidential Vote , 2008, PS: Political Science & Politics.

[74]  Janine Hansen,et al.  Manipulation in political stock markets – preconditions and evidence , 2004 .