Analysis of non-response bias in a mailed health survey.

The objective of this study was to identify characteristics of non-respondents and late respondents to a mailed health survey. Persons who returned and those who did not return the questionnaire were compared using health insurance data, which indicated their age, sex, and health care expenditures in the previous year. Insurance and questionnaire data were used to compare early and late survey respondents and to compare categories of non-respondents. Questions covered use of health services, health status, and sociodemographic characteristics. Participants were members of health insurance plans in Geneva, Switzerland, 19-45 years old (n = 1822). Respondents (n = 1424) and non-respondents (n = 398) were of similar age and sex. The proportion of persons who had health care expenditures greater than zero Swiss francs (SFr) was higher among respondents (75%) than among non-respondents (69%, p = 0.03). Among non-respondents, expenditures of persons who explicitly refused to participate (2378 SFr) were higher than expenditures of persons who moved out of Geneva (1085 SFr) or who failed to return the questionnaire (1592 SFr, p = .02). Among respondents, being born in a Switzerland, having completed elementary school, having generated health care expenditures, and reporting good physical health were independent predictors of early response. In conclusion, low response rates to mailed health surveys may result in overestimating the utilization of health services. However, non-respondents did not constitute a homogeneous group, and the strength and even direction of non-response bias depended on the mechanisms of non-response.

[1]  T. Sørensen,et al.  Influence of fatness, intelligence, education and sociodemographic factors on response rate in a health survey. , 1989, Journal of epidemiology and community health.

[2]  J. Senf.  The Option To Refuse , 1987 .

[3]  S H Kaplan,et al.  A comparison of various methods of collecting self-reported health outcomes data among low-income and minority patients. , 1995, Medical care.

[4]  R. Bergstrand,et al.  Bias due to non-participation and heterogenous sub-groups in population surveys. , 1983, Journal of chronic diseases.

[5]  T. Heberlein,et al.  Factors affecting response rates to mailed questionnaires: A quantitative analysis of the published literature. , 1978 .

[6]  J W Drane,et al.  Imputing nonresponses to mail-back questionnaires. , 1991, American journal of epidemiology.

[7]  J. M. James,et al.  LARGE MONETARY INCENTIVES AND THEIR EFFECT ON MAIL SURVEY RESPONSE RATES , 1992 .

[8]  Robert M. Groves,et al.  UNDERSTANDING THE DECISION TO PARTICIPATE IN A SURVEY , 1992 .

[9]  E. Barrett-Connor,et al.  Differences between respondents and non-respondents in a population-based cardiovascular disease study. , 1978, American journal of epidemiology.

[10]  G. Friedman,et al.  Mail survey response by health status of smokers, nonsmokers, and ex-smokers. , 1973, American journal of epidemiology.

[11]  D. Dillman.  Mail and telephone surveys : the total design method , 1979 .

[12]  T. Perneger,et al.  Validation of a French-language version of the MOS 36-Item Short Form Health Survey (SF-36) in young healthy adults. , 1995, Journal of clinical epidemiology.

[13]  E. Spitznagel,et al.  Difficult-to-recruit respondents and their effect on prevalence estimates in an epidemiologic survey. , 1987, American journal of epidemiology.

[14]  A. Paganini-Hill,et al.  Comparison of early and late respondents to a postal health survey questionnaire. , 1993, Epidemiology.

[15]  A confidence interval approach to investigating non-response bias and monitoring response to postal questionnaires. , 1991, Journal of epidemiology and community health.

[16]  R. Wiggins,et al.  Estimating the prevalence of disability in the community: the influence of sample design and response bias. , 1981, Journal of epidemiology and community health.

[17]  S. Blair,et al.  Patterns of non-response to a mail survey. , 1990, Journal of clinical epidemiology.

[18]  A. H. Church.  ESTIMATING THE EFFECT OF INCENTIVES ON MAIL SURVEY RESPONSE RATES: A META-ANALYSIS , 1993 .

[19]  T V Perneger,et al.  Randomized trial of use of a monetary incentive and a reminder card to increase the response rate to a mailed health survey. , 1993, American journal of epidemiology.

[20]  R. Ames,et al.  Respiratory health as a predictor of questionnaire return in a sample of United States underground coalminers. , 1987, British journal of industrial medicine.

[21]  D. Yach,et al.  Drop-out and newcomer bias in a community cardiovascular follow-up study. , 1990, International journal of epidemiology.

[22]  Terry L. Childers,et al.  Understanding mail survey response behavior: A meta-analysis. , 1991 .

[23]  A. Gulsvik,et al.  Postal survey on airborne occupational exposure and respiratory disorders in Norway: causes and consequences of non-response. , 1990, Journal of epidemiology and community health.

[24]  C. Sherbourne,et al.  The MOS 36-Item Short-Form Health Survey (SF-36) , 1992 .

[25]  J. Vestbo,et al.  Baseline characteristics are not sufficient indicators of non-response bias follow up studies. , 1992, Journal of epidemiology and community health.

[26]  B. Stuart,et al.  Assessment and Control of Nonresponse Bias in a Survey of Medicine Use by the Elderly , 1994, Medical care.

[27]  T. Perneger,et al.  Switching Swiss enrollees from indemnity health insurance to managed care: the effect on health status and stisfaction with care. , 1996, American journal of public health.

[28]  K. Ribisl,et al.  Minimizing participant attrition in panel studies through the use of effective retention and tracking strategies: Review and recommendations , 1996 .

[29]  R. Forthofer.  Investigation of nonresponse bias in NHANES II. , 1983, American journal of epidemiology.