Non-response bias in a web-based health behaviour survey of New Zealand tertiary students.

OBJECTIVE There has been little investigation of non-response bias in web-based health surveys. We hypothesised that non-respondents have a higher prevalence of risk behaviours than respondents. METHOD In 2005, random samples of students aged 17-25 years from 12 New Zealand tertiary institutions (n=7130) were invited to complete a web-based health behaviour survey, with three e-mail reminders. Early respondents (before 2nd reminder) were compared with late respondents (after 2nd reminder). Late respondents served as a proxy for non-respondents. RESULTS 2607 students (37%) responded early, 676 (9%) responded late, and 3847 (54%) did not respond. There were differences between early and late respondents in high school binge drinking (38% vs 47%, p=0.002) and non-compliance with physical activity guidelines (12% vs 18%, p=0.004). Differences in overweight/obesity (26% vs 31%, p=0.058), smoking (18% vs 22%, p=0.091) and non-compliance with dietary guidelines (76% vs 77%, p=0.651) were non-significant but point estimates were in the expected direction. Estimated bias in prevalence of risk behaviours was an absolute difference of 1-4% and a relative difference of 0-21%. CONCLUSION Respondents whose participation was hardest to elicit reported more risk behaviour. Assuming non-respondents' behaviour is similar or more extreme than that of late respondents, prevalence will have been substantially underestimated.

[1]  J. Ormel,et al.  Survey non-response in the Netherlands: effects on prevalence estimates and associations. , 2003, Annals of epidemiology.

[2]  J. Meiklejohn Drinking patterns, drinking in partnerships and informal social controls on drinking in New Zealand , 2010 .

[3]  R. de Marco,et al.  Asthmatics and ex-smokers respond early, heavy smokers respond late to mailed surveys in Italy. , 2010, Respiratory medicine.

[4]  T. Lallukka,et al.  Does survey non-response bias the association between occupational social class and health? , 2007, Scandinavian journal of public health.

[5]  J. Langley,et al.  Drinking and alcohol-related harm among New Zealand university students: findings from a national Web-based survey. , 2009, Alcoholism, clinical and experimental research.

[6]  J. Gundgaard,et al.  The effect of non-response on estimates of health care utilisation: linking health surveys and registers. , 2007, European journal of public health.

[7]  N. C. Schaeffer,et al.  Institute for Research on Poverty Discussion Paper no. 1024-93 Using Survey Participants to Estimate the Impact of Nonparticipation , 1993 .

[8]  M. Kjøller,et al.  Characteristics of non-response in the Danish Health Interview Surveys, 1987-1994. , 2005, European journal of public health.

[9]  M. Clarke,et al.  Increasing response rates to postal questionnaires: systematic review , 2002, BMJ : British Medical Journal.

[10]  P. Bakke,et al.  Non-response bias in a postal questionnaire survey on respiratory health in the old and very old , 2003, Scandinavian journal of public health.

[11]  J. Cunningham,et al.  Nonresponse in a follow-up to a representative telephone survey of adult drinkers. , 2001, Journal of studies on alcohol.

[12]  G. Cohen,et al.  Are nonrespondents to health surveys less healthy than respondents , 2002 .

[13]  J. Hassi,et al.  Does non-responder bias have a significant effect on the results in a postal questionnaire study? , 2004, European Journal of Epidemiology.

[14]  D. Balzi,et al.  Nine-year follow-up of a survey on smoking habits in Florence (Italy): higher mortality among non-responders. , 2002, International journal of epidemiology.

[15]  P. Rautava,et al.  Non-response and related factors in a nation-wide health survey , 2004, European Journal of Epidemiology.

[16]  A. Dobson,et al.  Effect on Trend Estimates of the Difference between Survey Respondents and Non-respondents: Results from 27 Populations in the WHO MONICA Project , 2005, European Journal of Epidemiology.

[17]  Kypros Kypri,et al.  Assessment of nonresponse bias in an internet survey of alcohol use. , 2004, Alcoholism, clinical and experimental research.

[18]  Kypros Kypri,et al.  An internet-based survey method for college student drinking research. , 2004, Drug and alcohol dependence.