Cost-Effectiveness of Follow-Up Strategies in Improving the Response Rate of Mail Surveys

Abstract Although inexpensive and geographically flexible, mail surveys typically result in low response rates. These low response rates can bias the results when nonrespondents differ systematically from respondents. Because follow-ups with nonrespondents have been shown to increase overall response rate, the purpose of the study was to compare both response rate and cost-effectiveness ratio of four different follow-up strategies. Nonrespondents from a national mailing of 596 surveys were randomly assigned into four strategy conditions: (1) postcard reminders; (2) second mailings; (3) telephone reminders; and (4) Dillman’s multiple follow-up strategy, which combines all three. When telephone numbers were not available, the Dillman strategy and second mailings yielded significantly higher return rates than the telephone condition. However, it was determined if telephone numbers had been available, there would be no significant differences among response rates for the four follow-up conditions. In both situations, postcard reminders were most cost-effective. Thus, although surveys with higher response rates are generally accorded greater validity, the additional cost and time of the multiple follow-ups do not always lead to a significantly higher response rate.

[1]  Charles W. Lamb,et al.  Effect on Mail Survey Return Rates of Including Questionnaires with Follow-up Letters , 1981 .

[2]  C. Scott Research on Mail Surveys , 1961 .

[3]  David L. Rados,et al.  Effects of Foot-in-the-Door, Cash Incentives, and Followups on Survey Response , 1981 .

[4]  B. Eckland EFFECTS OF PRODDING TO INCREASE MAIL-BACK RETURNS. , 1965, The Journal of applied psychology.

[5]  T. Heberlein,et al.  Factors affecting response rates to mailed questionnaires: A quantitative analysis of the published literature. , 1978 .

[6]  W. Kephart,et al.  Increasing the Responses to Mail Questionnaires: A Research Study , 1958 .

[7]  M. Paxson Increasing survey response rates: Practical instructions from the total-design method , 1995 .

[8]  Bruce J. Walker,et al.  A method to improve response to industrial mail surveys , 1987 .

[9]  Judith A. Boser,et al.  Reviewing the Research on Mail Survey Response Rates: Descriptive Study. , 1996 .

[10]  D. Aaker,et al.  Chapter 2 – Marketing research , 2004 .

[11]  L. Kanuk,et al.  Mail Surveys and Response Rates: A , 1975 .

[12]  D. McKee Miscellany: The Effect of using Questionnaire Identification Code and Message about Non-Response Follow-Up Plans on Mail Survey Response Characteristics , 1992 .

[13]  John R. Dickinson,et al.  Mail survey response, speed, and cost , 1992 .

[14]  L. Kanuk,et al.  Mail Surveys and Response Rates: A Literature Review , 1975 .

[15]  H. Cooper,et al.  A Quantitative Review of Research Design Effects on Response Rates to Questionnaires , 1983 .

[16]  E. Suchman,et al.  Who answers questionnaires , 1940 .

[17]  A. S. Linsky STIMULATING RESPONSES TO MAILED QUESTIONNAIRES: A REVIEW , 1975 .

[18]  Leonard A. Marascuilo,et al.  Statistical methods for behavioral science research , 1971 .

[19]  M. Crask,et al.  MAIL SURVEY RESPONSE RATE A META-ANALYSIS OF SELECTED TECHNIQUES FOR INDUCING RESPONSE , 1988 .

[20]  Terry L. Childers,et al.  Understanding mail survey response behavior: A meta-analysis. , 1991 .

[21]  G. Gordon,et al.  Maximizing Returns on Mail Questionnaires , 1958 .

[22]  R. F. Sletto Pretesting of Questionnaires , 1940 .

[23]  J. E. Swan,et al.  Can Follow-up Response Rates to a Mail Survey Be Increased by Including Another Copy of the Questionnaire? , 1980 .