Costs and Errors in Fixed and Mobile Phone Surveys

Due to low costs, speed, simplicity, interviewer assistance, and easy monitoring telephone interviewing had been the preferred mode of many survey practitioners for decades. However, technological developments related to information society, in particular the increasing rate of mobile-only individuals and households, are rapidly changing the survey research environment. In the first part of the chapter methodological issues of data collection by phone are delineated. After a brief history of phone surveys recent telephone use trends and their implications on survey coverage and sampling are outlined. Next, nonresponse in phone surveys is discussed. The section ends with an illustration of challenges posed by incorporating mobile phone in survey research. In the second part, phone surveys are discussed in the context of mixed modes, in particular their potential to improve coverage and response rates. Furthermore, data quality and cost issues are treated. Finally, the section introduces dual frame sampling of fixed and mobile numbers, a special type of mixed mode surveys that was developed to resolve the phone coverage problem. In the third part, the chapter deals with the optimization of telephone surveys according to costs and errors. An analytical solution for dual frame surveys and a more general postsurvey evaluation of different modes are presented. In conclusion, we recapitulate key issues of phone surveys and indicate future trends with guidelines for further research.

[1]  Vasja Vehovar,et al.  Overview: Online Surveys , 2008 .

[2]  Sara Dolnicar,et al.  Online Versus Paper , 2009 .

[3]  Vasja Vehovar,et al.  Mobile phone surveys: The Slovenian case study , 2021, Advances in Methodology and Statistics.

[4]  S. Keeter,et al.  ASSESSING THE CELL PHONE CHALLENGE TO SURVEY RESEARCH IN 2010 , 2010 .

[5]  Alan F. Karr,et al.  Survey Costs: Workshop Report and White Paper , 2006 .

[6]  Vesa Virtanen,et al.  Reducing Nonresponse by SMS Reminders in Mail Surveys , 2007 .

[7]  J. Michael Brick,et al.  Nonsampling errors in dual frame telephone surveys , 2011 .

[8]  Roderick J. A. Little,et al.  Subsampling Callbacks to Improve Survey Efficiency , 2000 .

[9]  Vasja Vehovar,et al.  Fitting disposition codes to mobile phone surveys: experiences from studies in Finland, Slovenia and the USA , 2007 .

[10]  M. Traugott,et al.  USING DUAL FRAME DESIGNS TO REDUCE NONRESPONSE IN TELEPHONE SURVEYS , 1987 .

[11]  Karen L. Soderberg,et al.  Wireless substitution: state-level estimates from the National Health Interview Survey, January-December 2007. , 2009, National health statistics reports.

[12]  D. Leeuw,et al.  Data Quality in Mail, Telephone and Face to Face Surveys. , 1992 .

[13]  J. Michael Brick,et al.  Nonresponse Bias in a Dual Frame Sample of Cell and Landline Numbers , 2006 .

[14]  Vasja Vehovar,et al.  Mobile Phones in an Environment of Competing Survey Modes: Applying Metric for Evaluation of Costs and Errors , 2010 .

[15]  Siegfried Gabler,et al.  Erfahrungen beim Aufbau eines Auswahlrahmens für Telefonstichproben in Deutschland , 1999 .

[16]  W. Edwards Deming,et al.  Some Theory of Sampling , 1950 .

[17]  Charlotte Steeh,et al.  The State of Surveying Cell Phone Numbers in the United States , 2007 .

[18]  Edith D. de Leeuw,et al.  Advances in Telephone Survey Methodology , 2007 .

[19]  R. Groves,et al.  Survey Errors and Survey Costs. , 1991 .

[20]  P. Biemer Total Survey Error: Design, Implementation, and Evaluation , 2010 .

[21]  Marek Fuchs Mobile Web Surveys: A Preliminary Discussion of Methodological Implications , 2007 .

[22]  Robert D. Tortora Response Trends in a National Random Digit Dial Survey , 2004 .

[23]  Robert M. Groves,et al.  A Mean Squared Error Model for Dual Frame, Mixed Mode Survey Design , 1986 .

[24]  Eleanor Singer,et al.  Introduction Nonresponse Bias in Household Surveys , 2006 .

[25]  Paul P. Biemer,et al.  Introduction to Survey Quality , 2003 .

[26]  Michael W. Link,et al.  Reaching the U.S. Cell Phone Generation Comparison of Cell Phone Survey Results with an Ongoing Landline Telephone Survey , 2007 .

[27]  Morris H. Hansen,et al.  Sample survey methods and theory , 1955 .

[28]  Robert M. Groves,et al.  Surveys by Telephone: A National Comparison With Personal Interviews. , 1980 .

[29]  Shirley A. Star,et al.  AMERICAN ASSOCIATION FOR PUBLIC OPINION RESEARCH , 1980 .

[30]  Joseph Waksberg,et al.  Sampling Methods for Random Digit Dialing , 1978 .

[31]  E. Singer NONRESPONSE BIAS IN HOUSEHOLD SURVEYS , 2006 .

[32]  Peter Lynn,et al.  The British Crime Survey: A Review of Methodology , 2000 .

[33]  Sharon L. Lohr,et al.  Multiple-Frame Surveys , 2009 .

[34]  J. Michael Brick,et al.  Household Telephone Service and Usage Patterns in the United states in 2004: Implications for Telephone Samples , 2007 .

[35]  Robert M. Groves,et al.  The Impact of Nonresponse Rates on Nonresponse Bias A Meta-Analysis , 2008 .

[36]  Courtney Kennedy,et al.  Evaluating the Effects of Screening for Telephone Service in Dual Frame RDD Surveys , 2007 .

[37]  Lars Kaczmirek,et al.  Prenotification in Web-Based Access Panel Surveys , 2008 .

[38]  Robert M. Groves,et al.  Survey Errors and Survey Costs: Groves/Survey Errors , 2005 .

[39]  Sunghee Lee,et al.  Sampling Telephone Numbers and Adults, Interview Length, and Weighting in The California Health Interview Survey Cell Phone Pilot Study , 2007 .

[40]  W. Deming On a Probability Mechanism to Attain an Economic Balance Between the Resultant Error of Response and the Bias of Nonresponse , 1953 .

[41]  Mario Callegaro,et al.  Guidelines and Considerations for Survey Researchers When Planning and Conducting RDD and Other Telephone Surveys in the U.S. With Respondents Reached via Cell Phone Numbers , 2010 .

[42]  R. Groves,et al.  Telephone Survey Methodology. , 1990 .

[43]  Courtney Kennedy,et al.  What's Missing from National Landline RDD Surveys? , 2007 .

[44]  Charlotte Steeh,et al.  Accommodating New Technologies: Mobile and VoIP Communication , 2007 .

[45]  E. Leeuw,et al.  To mix or not to mix data collection modes in surveys. , 2005 .

[46]  H. Weisberg The Total Survey Error Approach: A Guide to the New Science of Survey Research , 2005 .

[47]  J. Krosnick,et al.  National Surveys Via Rdd Telephone Interviewing Versus the Internet Comparing Sample Representativeness and Response Quality , 2009 .

[48]  Mario Callegaro,et al.  Using Text Messages in U.S. Mobile Phone Surveys , 2007 .

[49]  Vasja Vehovar,et al.  Sensitivity of Electronic Commerce Measurement to the Survey Instrument , 2001, Int. J. Electron. Commer..

[50]  F. Conrad,et al.  Envisioning the Survey Interview of the Future , 2007 .

[51]  F. S. P. Szuster,et al.  Nonsampling Error in Surveys , 1994 .

[52]  Vasja Vehovar,et al.  The Influence of Mobile Telephones on Telephone Surveys , 2007 .