Self-reported cheating in web surveys on political knowledge

Measuring citizens’ political knowledge is important for understanding public opinion formation. In view of the increasing popularity of Web surveys, this paper examines the limitations of this interviewing facility when measuring factual political knowledge. We show that Web surveys contain a source of measurement error as respondents can “Google” the correct answers. This cheating activity is our principal concern. Past efforts are extended by: (1) offering a self-reported estimate of the share of Googling cheaters, (2) showing that the positive effect of education on factual political knowledge is most probably underestimated when cheating occurs, and (3) showing that self-reported cheating activity is inversely related to actual response time. In the concluding section, we discuss the implications of these results and the extent to which cheating can be reduced. The empirical analyses are based on a Danish Web sample from 2012 (N$$=$$= 1,509).

[1]  R. Sherman,et al.  Subject Acquisition for Web-Based Surveys , 2003, Political Analysis.

[2]  F. Kreuter,et al.  Social Desirability Bias in CATI, IVR, and Web Surveys The Effects of Mode and Question Sensitivity , 2008 .

[3]  D. Stolle,et al.  Ethnic Diversity and Generalized Trust in Europe , 2009 .

[4]  Laura B. Stephenson,et al.  Studying Political Behavior: A Comparison of Internet and Telephone Surveys , 2011 .

[5]  Martin Gilens,et al.  Political Ignorance and Collective Policy Preferences , 2001, American Political Science Review.

[6]  Jon A. Krosnick,et al.  Comparing Oral Interviewing with Self-Administered Computerized QuestionnairesAn Experiment , 2010 .

[7]  P. Whiteley,et al.  Leader heuristics, political knowledge and voting in Britain's AV referendum , 2013 .

[8]  Jeffery J. Mondak Reconsidering the Measurement of Political Knowledge , 1999, Political Analysis.

[9]  Geert Loosveldt,et al.  Face-to-Face versus Web Surveying in a High-Internet-Coverage Population Differences in Response Quality , 2008 .

[10]  Scott Fricker,et al.  An Experimental Comparison of Web and Telephone Surveys , 2005 .

[11]  Dirk Heerwegh,et al.  Mode Differences Between Face-to-Face and Web Surveys: An Experimental Investigation of Data Quality and Social Desirability Effects , 2009 .

[12]  Steven D. Brown,et al.  The Social Sources of Political Knowledge , 1988, Canadian Journal of Political Science.

[13]  M. Couper A REVIEW OF ISSUES AND APPROACHES , 2000 .

[14]  Robert C. Luskin Measuring Political Sophistication , 1987 .

[15]  M. Jennings,et al.  POLITICAL KNOWLEDGE OVER TIME AND ACROSS GENERATIONS , 1996 .

[16]  A. Lupia,et al.  Money, Time, and Political Knowledge: Distinguishing Quick Recall and Political Learning Skills , 2008 .

[17]  J. Zaller,et al.  The Nature and Origins of Mass Opinion. , 1992 .

[18]  R. M. Kunovich,et al.  Political knowledge in Poland , 2013 .

[19]  S. Keeter,et al.  What Americans Know about Politics and Why It Matters , 1996 .

[20]  Patrick Sturgis,et al.  An experiment on the measurement of political knowledge in surveys , 2008 .

[21]  Mattias Viklund Trust and Risk Perception in Western Europe: A Cross‐National Study , 2003, Risk analysis : an official publication of the Society for Risk Analysis.

[22]  Michael X. Delli Carpini,et al.  Measuring Political Knowledge: Putting First Things First , 1993 .

[23]  Claudia Biancotti A polarization of inequality? The distribution of national Gini coefficients 1970–1996 , 2006 .

[24]  Kimmo Elo,et al.  Asking Factual Knowledge Questions: Reliability in Web-Based, Passive Sampling Surveys , 2009 .

[25]  Brian F. Schaffner,et al.  Does Survey Mode Still Matter? Findings from a 2010 Multi-Mode Comparison , 2011, Political Analysis.

[26]  Robert P. Berrens,et al.  The Advent of Internet Surveys for Political Research: A Comparison of Telephone and Internet Samples , 2003, Political Analysis.

[27]  Russel L. Thompson,et al.  A Meta-Analysis of Response Rates in Web- or Internet-Based Surveys , 2000 .

[28]  Kimmo Grönlund,et al.  The Determinants of Political Knowledge in Comparative Perspective , 2006 .

[29]  T. Aalberg,et al.  Measuring Political Knowledge in Telephone and Web Surveys: A Cross-National Comparison , 2011 .