Can Simply Answering Research Questions Change Behaviour? Systematic Review and Meta Analyses of Brief Alcohol Intervention Trials

Background Participant reports of their own behaviour are critical for the provision and evaluation of behavioural interventions. Recent developments in brief alcohol intervention trials provide an opportunity to evaluate longstanding concerns that answering questions on behaviour as part of research assessments may inadvertently influence it and produce bias. The study objective was to evaluate the size and nature of effects observed in randomized manipulations of the effects of answering questions on drinking behaviour in brief intervention trials. Methodology/Principal Findings Multiple methods were used to identify primary studies. Between-group differences in total weekly alcohol consumption, quantity per drinking day and AUDIT scores were evaluated in random effects meta-analyses. Ten trials were included in this review, of which two did not provide findings for quantitative study, in which three outcomes were evaluated. Between-group differences were of the magnitude of 13.7 (−0.17 to 27.6) grams of alcohol per week (approximately 1.5 U.K. units or 1 standard U.S. drink) and 1 point (0.1 to 1.9) in AUDIT score. There was no difference in quantity per drinking day. Conclusions/Significance Answering questions on drinking in brief intervention trials appears to alter subsequent self-reported behaviour. This potentially generates bias by exposing non-intervention control groups to an integral component of the intervention. The effects of brief alcohol interventions may thus have been consistently under-estimated. These findings are relevant to evaluations of any interventions to alter behaviours which involve participant self-report.

[1]  W. Mackenzie,et al.  The Management and the Worker , 2008 .

[2]  N. Laird,et al.  Meta-analysis in clinical trials. , 1986, Controlled clinical trials.

[3]  M. Conner,et al.  A mere measurement effect for anticipated regret: impacts on cervical screening attendance. , 2009, British Journal of Social Psychology.

[4]  S. Thompson,et al.  Quantifying heterogeneity in a meta‐analysis , 2002, Statistics in medicine.

[5]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[6]  M. Bateson,et al.  Cues of being watched enhance cooperation in a real-world setting , 2006, Biology Letters.

[7]  P. Sheeran,et al.  Effects of Study Design and Allocation on participant behaviour - ESDA: study protocol for a randomized controlled trial , 2011, Trials.

[8]  J. Mccambridge,et al.  Randomized controlled trial of the effects of completing the Alcohol Use Disorders Identification Test questionnaire on self-reported hazardous drinking. , 2008, Addiction.

[9]  F Guillemin,et al.  Nonspecific effects in longitudinal studies: impact on quality of life measures. , 1996, Journal of clinical epidemiology.

[10]  Jasmin A. Tiro,et al.  Promoting regular mammography screening I. A systematic assessment of validity in a randomized trial. , 2009, Journal of the National Cancer Institute.

[11]  R. Sanson-Fisher,et al.  Systematic review and meta-analyses of strategies targeting alcohol problems in emergency departments: interventions reduce alcohol-related injuries. , 2008, Addiction.

[12]  W. Miller,et al.  Calculating standard drink units: international comparisons. , 1991, British journal of addiction.

[13]  Michael Behnke,et al.  Compliance With Antiseptic Hand Rub Use in Intensive Care Units The Hawthorne Effect , 2006, Infection Control & Hospital Epidemiology.

[14]  G. Gmel,et al.  Brief alcohol intervention and alcohol assessment do not influence alcohol use in injured patients treated in the emergency department: a randomized controlled clinical trial. , 2007, Addiction.

[15]  K. Carey,et al.  Brief motivational interventions for heavy college drinkers: A randomized controlled trial. , 2006, Journal of consulting and clinical psychology.

[16]  A. Al Samaraee,et al.  Surgical Safety Checklist , 2010, Journal of perioperative practice.

[17]  Alan D. Lopez,et al.  The Burden of Disease and Mortality by Condition: Data, Methods, and Results for 2001 -- Global Burden of Disease and Risk Factors , 2006 .

[18]  M. Copass,et al.  Alcohol interventions in a trauma center as a means of reducing the risk of injury recurrence. , 1999, Annals of surgery.

[19]  E. Mayo The Human Problems of an Industrial Civilization , 1934, Nature.

[20]  Alan D. Lopez,et al.  Global and regional burden of disease and risk factors, 2001: systematic analysis of population health data , 2006, The Lancet.

[21]  A. Haines,et al.  Randomised controlled trial of general practitioner intervention in patients with excessive alcohol consumption. , 1988, BMJ.

[22]  Ralph L. Rosnow,et al.  People studying people , 1997 .

[23]  H. Schwartzman,et al.  What Happened at Hawthorne , 1993 .

[24]  D. Torgerson,et al.  Review of randomised trials using the post-randomised consent (Zelen's) design. , 2006, Contemporary clinical trials.

[25]  W A Watson,et al.  Hawthorne effect: implications for prehospital research. , 1995, Annals of emergency medicine.

[26]  Scott T Walters,et al.  Reactivity to alcohol assessment measures: an experimental test. , 2009, Addiction.

[27]  R. Solomon,et al.  An extension of control group design. , 1949, Psychological bulletin.

[28]  L. Delbeke Quasi-experimentation - design and analysis issues for field settings - cook,td, campbell,dt , 1980 .

[29]  T. Heeren,et al.  Mechanisms of change in control group drinking in clinical trials of brief alcohol intervention: implications for bias toward the null. , 2010, Drug and alcohol review.

[30]  A Wodak,et al.  Controlled evaluation of a general practice-based brief intervention for excessive drinking. , 1995, Addiction.

[31]  R. Korcha,et al.  Screening, brief intervention, and referral to treatment (SBIRT): 12-month outcomes of a randomized controlled clinical trial in a Polish emergency department. , 2010, Alcoholism, clinical and experimental research.

[32]  J. Mccambridge [Commentary] Research assessments: instruments of bias and brief interventions of the future? , 2009, Addiction.

[33]  M. Hutchinson "Intentional use of the Hawthorne effect to improve oral hygiene compliance in orthodontic patients". , 2003, Journal of dental education.

[34]  Anthony G. Greenwald,et al.  Increasing voting behavior by asking people if they expect to vote. , 1987 .

[35]  F. J. Roethlisberger,et al.  Management and the Worker , 1941 .

[36]  P. Bower,et al.  Impact of participant and physician intervention preferences on randomized trials: a systematic review. , 2005, JAMA.

[37]  H. Carabin,et al.  Effectiveness of a training program in reducing infections in toddlers attending day care centers. , 1999, Epidemiology.

[38]  Kypros Kypri,et al.  Randomized controlled trial of a web-based primary care intervention for multiple health risk behaviors. , 2005, Preventive medicine.

[39]  E. Kuntsche,et al.  Short message service (SMS) technology in alcohol research--a feasibility study. , 2009, Alcohol and alcoholism.

[40]  G. Fitzsimons,et al.  Should we ask our Children about Sex, Drugs and Rock & Roll?: Potentially Harmful Effects of Asking Questions About Risky Behaviors. , 2008, Journal of consumer psychology : the official journal of the Society for Consumer Psychology.

[41]  Mark Conner,et al.  Asking questions changes behavior: mere measurement effects on frequency of blood donation. , 2008, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[42]  C. Brewin,et al.  Patient preferences and randomised clinical trials. , 1989, BMJ.

[43]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2010, International journal of surgery.

[44]  J. Langley,et al.  Assessment may conceal therapeutic benefit: findings from a randomized controlled trial for hazardous drinking. , 2007, Addiction.

[45]  Michael M. Sokal,et al.  Manufacturing Knowledge: A History of the Hawthorne Experiments , 1991 .

[46]  S. Iliffe,et al.  Bmc Medical Research Methodology Open Access the Hawthorne Effect: a Randomised, Controlled Trial , 2022 .

[47]  P. Anderson,et al.  The effect of general practitioners' advice to heavy drinking men. , 1992, British journal of addiction.

[48]  Diana Elbourne,et al.  Can Research Assessments Themselves Cause Bias in Behaviour Change Trials? A Systematic Review of Evidence from Solomon 4-Group Studies , 2011, PloS one.

[49]  Stephen Sutton,et al.  Efficacy of a theory-based behavioural intervention to increase physical activity in an at-risk group in primary care (ProActive UK): a randomised trial , 2008, The Lancet.

[50]  D De Amici,et al.  Impact of the Hawthorne effect in a longitudinal clinical study: the case of anesthesia. , 2000, Controlled clinical trials.

[51]  E Scott,et al.  Randomized controlled trial of general practitioner intervention in women with excessive alcohol consumption. , 1991, Drug and alcohol review.

[52]  R. Voogt,et al.  Nonresponse Bias and Stimulus Effects in the Dutch National Election Study , 2002 .

[53]  Tim Rakow,et al.  Prospective Research in Health Service Settings: Health Psychology, Science and the ‘Hawthorne’ Effect , 2004, Journal of health psychology.

[54]  S. Brophy,et al.  Interventions for latent autoimmune diabetes (LADA) in adults. , 2011, The Cochrane database of systematic reviews.

[55]  J. M. Cohen,et al.  Mexico City : México , 1965 .

[56]  S. Maisto,et al.  Alcohol treatment research assessment exposure subject reactivity effects: part I. Alcohol use and related consequences. , 2007, Journal of studies on alcohol and drugs.

[57]  Robert Rosenthal,et al.  People Studying People: Artifacts and Ethics in Behavioral Research , 1997 .

[58]  S. Clemes,et al.  Increasing our understanding of reactivity to pedometers in adults. , 2009, Medicine and science in sports and exercise.

[59]  K. Lui,et al.  Randomized consent designs for clinical trials: an update by M. Zelen, Statistics in Medicine 1990; 9: 645–656 , 2002, Statistics in medicine.