Randomized trial of financial incentives and delivery methods for improving response to a mailed questionnaire.

In a follow-up study, only 64% of 126,628 US radiologic technologists completed a questionnaire during 1994-1997 after two mailings. The authors conducted a randomized trial of financial incentives and delivery methods to identify the least costly approach for increasing overall participation. They randomly selected nine samples of 300 nonresponders each to receive combinations of no, 1.00 US dollar, 2.00 US dollars, and 5.00 US dollars cash or check incentives delivered by first-class mail or Federal Express. Federal Express delivery did not achieve greater participation than first-class mail (23.2% vs. 23.7%). In analyses pooled across delivery methods, the response was significantly greater for the 2.00 US dollar bill (28.9%, 95% confidence interval (CI): 25.2, 32.7; p < 0.0001), 5.00 US dollars check (27.5%, 95% CI: 22.5, 33.0; p = 0.0001), 1.00 US dollar bill (24.6%, 95% CI: 21.2, 28.3; p = 0.0007), and 2.00 US dollars check (21.8%, 95% CI: 18.5, 25.3; p = 0.02) compared with no incentive (16.6%, 95% CI: 13.7, 19.9). The response increased significantly with increasing incentive amounts from 0.00 to 2.00 US dollars cash (p trend < 0.0001). The 2.00 US dollar bill achieved a 30% greater response than did a 2.00 US dollars check (p = 0.005). For incentives sent by first-class mail, the 5.00 US dollars check yielded 30% greater participation than did the 2.00 US dollars check (p = 0.07). A 1.00 US dollar bill, chosen instead of the 2.00 US dollars bill because of substantially lower overall cost and sent by first-class mail to the remaining 42,717 nonresponders, increased response from 64% to 72%.

[1]  Debra T. Silverman,et al.  Selection of controls in case-control studies. II. Types of controls. , 1992, American journal of epidemiology.

[2]  M. Clarke,et al.  Increasing response rates to postal questionnaires: systematic review , 2002, BMJ : British Medical Journal.

[3]  P. De Wals,et al.  Cost-Effectiveness of a Lottery for Increasing Physicians’ Responses to a Mail Survey , 2001, Evaluation & the health professions.

[4]  J. S. St. Lawrence,et al.  The Effects of Variations in Mode of Delivery and Monetary Incentive on Physicians’ Responses to a Mailed Survey Assessing STD Practice Patterns , 2001, Evaluation & the health professions.

[5]  T. Beebe,et al.  The use of monetary incentives in a community survey: impact on response rates, data quality, and cost. , 2001, Health services research.

[6]  I. Wilson,et al.  Effects of Different Monetary Incentives on the Return Rate of a National Mail Survey of Physicians , 2001, Medical care.

[7]  J. Herold,et al.  Physician response to surveys. A review of the literature. , 2001, American journal of preventive medicine.

[8]  C. Perry,et al.  Effectiveness of monetary incentives for recruiting adolescents to an intervention trial to reduce smoking. , 2000, Preventive medicine.

[9]  D. McCaffrey,et al.  Effects of Incentive Size and Timing on Response Rates to a Follow-Up Wave of a Longitudinal Mailed Survey , 2000, Evaluation review.

[10]  N. Kreiger,et al.  Effects on subject response of information brochures and small cash incentives in a mail-based case-control study. , 2000, Annals of epidemiology.

[11]  N. Talley,et al.  The effects of lottery incentive and length of questionnaire on health survey response rates: a randomized study. , 1999, Journal of clinical epidemiology.

[12]  T. Koepsell,et al.  Increasing response rates for mailed surveys of Medicaid clients and other low-income populations. , 1999, American journal of epidemiology.

[13]  K. Helzlsouer,et al.  Controlled trial of the effect of length, incentives, and follow-up techniques on response to a mailed questionnaire. , 1998, American journal of epidemiology.

[14]  N. Kreiger,et al.  Improvement in cumulative response rates following implementation of a financial incentive. , 1998, American journal of epidemiology.

[15]  M. Cotterchio,et al.  The effect of financial incentives on participation in future research. , 1998, Epidemiology.

[16]  J H Price,et al.  Increasing Return Rates of a Mail Survey to Exercise Professionals Using a Modest Monetary Incentive , 1998, Perceptual and motor skills.

[17]  H. Adami,et al.  Response rate to mailed epidemiologic questionnaires: a population-based randomized trial of variations in design and mailing routines. , 1998, American journal of epidemiology.

[18]  D. Asch,et al.  Conducting physician mail surveys on a limited budget. A randomized trial comparing $2 bill versus $5 bill incentives. , 1998, Medical care.

[19]  H. Morgenstern,et al.  A Randomized Trial of the Impact of Certified Mail on Response Rate to a Physician Survey, and a Cost-Effectiveness Analysis , 1997, Evaluation & the health professions.

[20]  T V Perneger,et al.  Analysis of non-response bias in a mailed health survey. , 1997, Journal of clinical epidemiology.

[21]  E. Shahar,et al.  The effect of nonresponse on prevalence estimates for a referent population: insights from a population-based cohort study. Atherosclerosis Risk in Communities (ARIC) Study Investigators. , 1996, Annals of Epidemiology.

[22]  D A Asch,et al.  Timing payments to subjects of mail surveys: cost-effectiveness and bias. , 1995, Journal of clinical epidemiology.

[23]  J. Potter,et al.  Response rates among control subjects in case-control studies. , 1995, Annals of epidemiology.

[24]  R M Groves,et al.  Advances in strategies for minimizing and adjusting for survey nonresponse. , 1995, Epidemiologic reviews.

[25]  P. Estok,et al.  Research incentives: money versus gifts. , 1994, Nursing Research.

[26]  T. Sellers,et al.  Mortality and cancer rates in nonrespondents to a prospective study of older women: 5-year follow-up. , 1994, American journal of epidemiology.

[27]  E. John,et al.  Effect of a monetary incentive on response to a mail survey. , 1994, Annals of epidemiology.

[28]  P. Milgrom,et al.  Dentists' response to financial incentives in a mail survey of malpractice liability experience. , 1994, Journal of public health dentistry.

[29]  T V Perneger,et al.  Randomized trial of use of a monetary incentive and a reminder card to increase the response rate to a mailed health survey. , 1993, American journal of epidemiology.

[30]  M. Berk,et al.  The Use of a Prepaid Incentive to Convert Nonresponders on a Survey of Physicians , 1993, Evaluation & the health professions.

[31]  J. Finlay,et al.  Applying mail response enhancement techniques to health care surveys: a cost-benefit approach. , 1993, Health marketing quarterly.

[32]  J K McLaughlin,et al.  Selection of controls in case-control studies. I. Principles. , 1992, American journal of epidemiology.

[33]  Terry L. Childers,et al.  Understanding mail survey response behavior: A meta-analysis. , 1991 .

[34]  G. Stemmermann,et al.  The effects of non-response in a prospective study of cancer: 15-year follow-up. , 1991, International journal of epidemiology.

[35]  D. Dillman The Design and Administration of Mail Surveys , 1991 .

[36]  J. M. James,et al.  THE EFFECT OF MONETARY INCENTIVES AND FOLLOW-UP MAILINGS ON THE RESPONSE RATE AND RESPONSE QUALITY IN MAIL SURVEYS , 1990 .

[37]  E. Rimm,et al.  Effectiveness of various mailing strategies among nonrespondents in a prospective cohort study. , 1990, American journal of epidemiology.

[38]  A. Tellegen,et al.  The Minnesota Twin Family Registry: some initial findings. , 1990, Acta geneticae medicae et gemellologiae.

[39]  Anita W. P. Pak,et al.  Effects of mailing strategies on response rate, response time, and cost in a questionnaire study among nurses. , 1990, Epidemiology.

[40]  J. Elder,et al.  Recruiting survey respondents to mailed surveys: controlled trials of incentives and prompts. , 1989, American journal of epidemiology.

[41]  J. Lambert,et al.  Increasing response rates in physicians' mail surveys: an experimental study. , 1989, American journal of public health.

[42]  M. Crask,et al.  MAIL SURVEY RESPONSE RATE A META-ANALYSIS OF SELECTED TECHNIQUES FOR INDUCING RESPONSE , 1988 .

[43]  J Siemiatycki,et al.  Nonresponse bias and early versus all responders in mail and telephone surveys. , 1984, American journal of epidemiology.

[44]  R. Little,et al.  Effectiveness of various methods of contact and reimbursement on response rates of pregnant women to a mail questionnaire. , 1984, American journal of epidemiology.

[45]  D. Dillman Mail and telephone surveys : the total design method , 1979 .