Response rates in postal surveys of healthcare professionals between 1996 and 2005: An observational study

BackgroundPostal surveys are a frequently used method of data collection in health services research. Low response rates increase the potential for bias and threaten study validity. The objectives of this study were to estimate current response rates, to assess whether response rates are falling, to explore factors that might enhance response rates and to examine the potential for non-response bias in surveys mailed to healthcare professionals.MethodsA random sample of postal or electronic surveys of healthcare workers (1996-2005) was identified from Medline, Embase or Psycinfo databases or Biomed Central. Outcome measures were survey response rate and non response analysis. Multilevel, multivariable logistic regression examined the relationship between response rate and publication type, healthcare profession, country and number of survey participants, questionnaire length and use of reminders.ResultsThe analysis included 350 studies. Average response rate in doctors was 57.5% (95%CI: 55.2% to 59.8%) and significantly lower than the estimate for the prior 10 year period. Response rates were higher when reminders were sent (adjusted OR 1.3; 95%CI 1.1-1.6) but only half the studies did this. Response rates were also higher in studies with fewer than 1000 participants and in countries other than US, Canada, Australia and New Zealand. They were not significantly affected by publication type or healthcare profession (p > 0.05). Only 17% of studies attempted assessment of possible non-response bias.ConclusionResponse rates to postal surveys of healthcare professionals are low and probably declining, almost certainly leading to unknown levels of bias. To improve the informativeness of postal survey findings, researchers should routinely consider the use of reminders and assess potential for non-response bias.

[1]  N. Horton Multilevel and Longitudinal Modeling Using Stata , 2006 .

[2]  P. Chisnall Mail and Internet Surveys: The Tailored Design Method , 2007, Journal of Advertising Research.

[3]  S. Weisberg,et al.  Residuals and Influence in Regression , 1982 .

[4]  E McColl,et al.  Design and use of questionnaires: a review of best practice applicable to surveys of health service staff and patients. , 2001, Health technology assessment.

[5]  E. Rimm,et al.  Activity level and risk of overweight in male health professionals. , 1996, American journal of public health.

[6]  J. Herold,et al.  Physician response to surveys. A review of the literature. , 2001, American journal of preventive medicine.

[7]  M K Campbell,et al.  Cluster trials in implementation research: estimation of intracluster correlation coefficients and sample size. , 2001, Statistics in medicine.

[8]  Ann Bowling,et al.  Research Methods in Health: Investigating Health and Health Services , 1997 .

[9]  David E. Booth,et al.  Analysis of Incomplete Multivariate Data , 2000, Technometrics.

[10]  D. Dillman Mail and internet surveys: The tailored design method, 2nd ed. , 2007 .

[11]  D. Rubin,et al.  Statistical Analysis with Missing Data. , 1989 .

[12]  E. Kaner,et al.  General practice postal surveys: a questionnaire too far? , 1996, BMJ.

[13]  M. Clarke,et al.  Methods to increase response rates to postal questionnaires. , 2007, The Cochrane database of systematic reviews.

[14]  Sarah M. Greene,et al.  Surveying Physicians: Do Components of the “Total Design Approach” to Optimizing Survey Response Rates Apply to Physicians? , 2002, Medical care.

[15]  T. Konrad,et al.  Reported response rates to mailed physician questionnaires. , 2001, Health services research.

[16]  Jeremy M. Grimshaw,et al.  Sample size calculator for cluster randomized trials , 2004, Comput. Biol. Medicine.

[17]  D A Asch,et al.  Response rates to mail surveys published in medical journals. , 1997, Journal of clinical epidemiology.

[18]  Roderick J. A. Little,et al.  Statistical Analysis with Missing Data: Little/Statistical Analysis with Missing Data , 2002 .

[19]  M. Moore,et al.  'Bin bag' study: a survey of the research requests received by general practitioners and the primary health care team. , 1999, The British journal of general practice : the journal of the Royal College of General Practitioners.