Comparing Mail and Web-Based Survey Distribution Methods: Results of Surveys to Leisure Travel Retailers

Findings from existing research that compares Web-based survey and traditional survey methods have been inconclusive. This study compares responses from a Web-based survey and those from a paper-and-pencil survey in terms of response rates, data quality, demographic profiles of respondents, internal consistency of scales, and responses to items among American Society of Travel Agents members. Two samples from the same population were randomly assigned to receive the questionnaire either by e-mail notices or by postal mail. Several differences were found between the Web-based survey and the paper-and-pencil survey. The response rate to the Web-based survey was lower than that to the mail survey. The Web-based survey had more missing data fields than the mail survey. The two groups differed in 15.3% of the total items in the data set. Web respondents’ mean scores to the five scales were consistently lower than those of mail respondents.

[1]  Craig A. Mertler,et al.  A Comparison of the Psychometric Qualities of Surveys Administered by Web and Traditional Methods. , 2003 .

[2]  M. Couper.  A REVIEW OF ISSUES AND APPROACHES , 2000 .

[3]  Titus Schleyer,et al.  Research Paper: Methods for the Design and Administration of Web-based Surveys , 2000, J. Am. Medical Informatics Assoc..

[4]  T. L. Brown,et al.  Factors Affecting Response Rates to Natural Resource - Focused Mail Surveys: Empirical Evidence of Declining Rates Over Time , 2003 .

[5]  Matthias Schonlau,et al.  Advantages and Disadvantages of Internet Research Surveys: Evidence from the Literature , 2002 .

[6]  S. Baron,et al.  Online Surveys in Marketing Research , 2002 .

[7]  David M. Shannon,et al.  A Comparison of Response Rate, Response Time, and Costs of Mail and Electronic Surveys , 2002 .

[8]  J. Pitkow,et al.  Surveying the Territory: GVU's Five WWW User Surveys , 1997 .

[9]  F. Langerak,et al.  Non-Probability Sampling for WWW Surveys: A Comparison of Methods , 1998 .

[10]  John C. Hayek,et al.  College Student Responses to Web and Paper Surveys: Does Mode Matter? , 2003 .

[11]  M. Traugott,et al.  Web survey design and administration. , 2001, Public opinion quarterly.

[12]  T. Hatten,et al.  Small Business: Entrepreneurship and Beyond , 1996 .

[13]  M. Weiner,et al.  E-mail versus conventional postal mail survey of geriatric chiefs. , 2001, The Gerontologist.

[14]  Eric L. Dey.  Working with Low Survey Response Rates: The Efficacy of Weighting Adjustments , 1995 .

[15]  Gi Woong Yun,et al.  Comparative Response to a Survey Executed by Post, E-mail, & Web Form , 2006, J. Comput. Mediat. Commun..

[16]  Cihan Cobanoglu,et al.  A Comparison of Mail, Fax and Web-Based Survey Methods , 2001 .

[17]  John L. Smith,et al.  Using the Internet for psychological research: personality testing on the World Wide Web. , 1999, British journal of psychology.

[18]  J. Crompton,et al.  What response rate can be expected from questionnaire surveys that address park and recreation issues , 1999 .

[19]  S. Baron,et al.  ONLINE SURVEYS IN MARKETING RESEARCH: PROS AND CONS , 2002 .

[20]  Margie L. Tomsic,et al.  A World Wide Web Response to Student Satisfaction Surveys: Comparisons Using Paper and Internet Formats. , 2000 .

[21]  Robert D. Tortora,et al.  INFLUENCE OF PLAIN VS. FANCY DESIGN ON RESPONSE RATES FOR WEB SURVEYS , 1999 .

[22]  J. Stanton.  AN EMPIRICAL ASSESSMENT OF DATA COLLECTION USING THE INTERNET , 1998 .

[23]  Paul D. Umbach,et al.  What Works Best? Collecting Alumni Data with Multiple Technologies. AIR 2001 Annual Forum Paper. , 2001 .

[24]  P. Chisnall.  Mail and Internet Surveys: The Tailored Design Method , 2007, Journal of Advertising Research.

[25]  Ramit K. Basi.  WWW Response Rates to Sociodemographic Items , 1999 .

[26]  Shannon K. Gilmartin,et al.  Assessing Response Rates and Nonresponse Bias in Web and Paper Surveys , 2003 .

[27]  Humphrey Taylor,et al.  Does Internet Research Work? , 2000 .

[28]  Lynda Idleman,et al.  Comparing Responses to Mail and Web-based Surveys. , 2003 .

[29]  Don A. Dillman,et al.  Development of a Standard E-Mail Methodology: Results of an Experiment , 1998 .