Studying Political Behavior: A Comparison of Internet and Telephone Surveys

Despite the promise of Internet surveys, there are significant concerns about the representativeness of the sample and survey instrument effects. This article seeks to address these questions by examining the differences and similarities between parallel Internet and telephone surveys conducted in Quebec after the provincial election in 2007. Our results indicate that the responses obtained in each mode differ somewhat from each other but that few inferential differences would occur if conclusions were drawn from the analysis of one dataset or the other. We urge researchers to consider the Internet as a viable mode of data collection, in that the consequences of mode effects appear to be minimal.

[1]  S. Kiesler,et al.  Response Effects in the Electronic Survey , 1986 .

[2]  John O. Brehm.  The Phantom Respondents: Opinion Surveys and Political Representation , 1993 .

[3]  R. Coomber.  Using the Internet for Survey Research , 1997 .

[4]  J. Krosnick,et al.  Comparing Telephone and Face to Face Interviewing in Terms of Data Quality: The 1982 National Election Studies Method Comparison Project , 1999 .

[5]  Henry E. Brady.  Contributions of Survey Research to Political Science* , 2000, PS: Political Science & Politics.

[6]  M. Couper.  A REVIEW OF ISSUES AND APPROACHES , 2000 .

[7]  Thomas W. Smith.  ARE REPRESENTATIVE INTERNET SURVEYS POSSIBLE , 2001 .

[8]  Nadine S. Koch,et al.  The Internet and Opinion Measurement: Surveying Marginalized Populations , 2001 .

[9]  James J. Bason.  COMPARISON OF TELEPHONE, MAIL, WEB, AND IVR SURVEYS OF DRUG AND A L C O H O L USE AMONG UNIVERSITY OF GEORGIA STUDENTS , 2002 .

[10]  Vasja Vehovar,et al.  WEB SURVEYS " CAN THE WEIGHTING SOLVE THE PROBLEM ? , 2002 .

[11]  Peter Tuckel,et al.  The Vanishing Respondent In Telephone Surveys , 2002, Journal of Advertising Research.

[12]  Melanie C. Green,et al.  Telephone versus Face-to-Face Interviewing of National Probability Samples with Long Questionnaires: Comparisons of Respondent Satisficing and Social Desirability Response Bias , 2003 .

[13]  Robert P. Berrens,et al.  The Advent of Internet Surveys for Political Research: A Comparison of Telephone and Internet Samples , 2003, Political Analysis.

[14]  R. Sherman,et al.  Subject Acquisition for Web-Based Surveys , 2003, Political Analysis.

[15]  Michael D. Kaplowitz,et al.  A Comparison of Web and Mail Survey Response Rates , 2004 .

[16]  Gerald Albaum,et al.  A Comparison of Response Characteristics from Web and Telephone Surveys , 2004 .

[17]  Roger Tourangeau,et al.  Survey research and societal change. , 2004, Annual review of psychology.

[18]  P. Whiteley,et al.  The 2001 British Election Study Internet Poll , 2004 .

[19]  Matthias Schonlau,et al.  A Comparison Between Responses From a Propensity-Weighted Web Survey and an Identical RDD Survey , 2004 .

[20]  Scott Fricker,et al.  An Experimental Comparison of Web and Telephone Surveys , 2005 .

[21]  Michael W. Link,et al.  Effects of survey mode on self-reports of adult alcohol consumption: a comparison of mail, web and telephone approaches. , 2005, Journal of studies on alcohol.

[22]  John Sides,et al.  The Study of Political Campaigns , 2006 .

[23]  Richard Johnston,et al.  Capturing Campaign Effects , 2006 .

[24]  Jon A. Krosnick,et al.  The Effect of Survey Mode and Sampling on Inferences about Political Attitudes and Behavior: Comparing the 2000 and 2004 ANES to Internet Surveys with Nonprobability Samples , 2007, Political Analysis.

[25]  David Sanders,et al.  Does Mode Matter For Modeling Political Choice? Evidence From the 2005 British Election Study , 2007, Political Analysis.

[26]  Karin Braunsberger,et al.  A comparison of reliability between telephone and web-based surveys. , 2007 .

[27]  F. Kreuter,et al.  Social Desirability Bias in CATI, IVR, and Web Surveys The Effects of Mode and Question Sensitivity , 2008 .

[28]  Gregg G. Van Ryzin.  Validity of an On-Line Panel Approach to Citizen Surveys , 2008 .

[29]  R. Gibson,et al.  Designing Online Election Surveys: Lessons from the 2004 Australian Election , 2008 .

[30]  R. Knibbe,et al.  The utility of online panel surveys versus computer-assisted interviews in obtaining substance-use prevalence estimates in the Netherlands. , 2009, Addiction.

[31]  Christopher M. Fleming,et al.  Web-based surveys as an alternative to traditional mail methods. , 2009, Journal of environmental management.

[32]  Jon A. Krosnick,et al.  Comparing Oral Interviewing with Self-Administered Computerized QuestionnairesAn Experiment , 2010 .