Surveying alcohol and other drug use through telephone sampling: a comparison of landline and mobile phone samples

BackgroundTelephone surveys based on samples of landline telephone numbers are widely used to measure the prevalence of health risk behaviours such as smoking, drug use and alcohol consumption. An increasing number of households are relying solely on mobile telephones, creating a potential bias for population estimates derived from landline-based sampling frames which do not incorporate mobile phone numbers. Studies in the US have identified significant differences between landline and mobile telephone users in smoking and alcohol consumption, but there has been little work in other settings or focussed on illicit drugs.MethodsThis study examined Australian prevalence estimates of cannabis use, tobacco smoking and risky alcohol consumption based on samples selected using a dual-frame (mobile and landline) approach. Respondents from the landline sample were compared both to the overall mobile sample (including respondents who had access to a landline) and specifically to respondents who lived in mobile-only households. Bivariate comparisons were complemented with multivariate logistic regression models, controlling for the effects of basic demographic variables.ResultsThe landline sample reported much lower prevalence of tobacco use, cannabis use and alcohol consumption than the mobile samples. Once demographic variables were adjusted for, there were no significant differences between the landline and mobile respondents on any of the alcohol measures examined. In contrast, the mobile samples had significantly higher rates of cannabis and tobacco use, even after adjustment. Weighted estimates from the dual-frame sample were generally higher than the landline sample across all substances, but only significantly higher for tobacco use.ConclusionsLandline telephone surveys in Australia are likely to substantially underestimate the prevalence of tobacco smoking by excluding potential respondents who live in mobile-only households. In contrast, estimates of alcohol consumption and cannabis use from landline surveys are likely to be broadly accurate, once basic demographic weighting is undertaken.

[1]  Anne W. Taylor,et al.  Sampling and coverage issues of telephone surveys used for collecting health information in Australia: results from a face-to-face survey from 1999 to 2008 , 2010, BMC medical research methodology.

[2]  L. Balluz,et al.  Improving public health surveillance using a dual-frame survey of landline and cell phone numbers. , 2011, American journal of epidemiology.

[3]  D. Gunnell,et al.  Non-response bias in a lifestyle survey. , 1997, Journal of public health medicine.

[4]  G. Gmel,et al.  Measuring alcohol consumption--should the 'graduated frequency' approach become the norm in survey research? , 2006, Addiction.

[5]  J. Ferris,et al.  Surveying the range and magnitude of alcohol's harm to others in Australia. , 2011, Addiction.

[6]  Kypros Kypri,et al.  Assessment of nonresponse bias in an internet survey of alcohol use. , 2004, Alcoholism, clinical and experimental research.

[7]  R. Borland,et al.  Centre for behavioural research in cancer. , 1991, British journal of addiction.

[8]  P. Remington,et al.  New challenges for telephone survey research in the twenty-first century. , 2007, Annual review of public health.

[9]  Ronaldo Laranjeira,et al.  Alcohol no ordinary commodity: research and public policy , 2004 .

[10]  S. Blumberg,et al.  Coverage Bias in Traditional Telephone Surveys of Low-Income and Young Adults , 2007 .

[11]  R. Groves.  Nonresponse Rates and Nonresponse Bias in Household Surveys , 2006 .

[12]  Vasja Vehovar,et al.  Costs and Errors in Fixed and Mobile Phone Surveys , 2012 .

[13]  Basil Donovan,et al.  Mobile phones are a viable option for surveying young Australian women: a comparison of two telephone survey methods , 2011, BMC medical research methodology.

[14]  L. Gideon.  Handbook of Survey Methodology for the Social Sciences , 2012 .

[15]  S. Macdonald,et al.  Non-response bias in alcohol and drug population surveys. , 2009, Drug and alcohol review.

[16]  Antonio Pflüger,et al.  The costs of tobacco, alcohol and illicit drug abuse to Australian society in 2004/05: summary version , 2008 .

[17]  G. Gmel.  The effect of mode of data collection and of non-response on reported alcohol consumption: a split-sample study in Switzerland. , 2000, Addiction.

[18]  C. Delnevo,et al.  Declining estimated prevalence of alcohol drinking and smoking among young adults nationally: artifacts of sample undercoverage? , 2007, American journal of epidemiology.