Recommendations for the Design and Analysis of Treatment Trials for Alcohol Use Disorders.

BACKGROUND Over the past 60 years, the view that "alcoholism" is a disease for which the only acceptable goal of treatment is abstinence has given way to the recognition that alcohol use disorders (AUDs) occur on a continuum of severity, for which a variety of treatment options are appropriate. However, because the available treatments for AUDs are not effective for everyone, more research is needed to develop novel and more efficacious treatments to address the range of AUD severity in diverse populations. Here we offer recommendations for the design and analysis of alcohol treatment trials, with a specific focus on the careful conduct of randomized clinical trials of medications and nonpharmacological interventions for AUDs. METHODS This paper provides a narrative review of the quality of published clinical trials and recommendations for the optimal design and analysis of treatment trials for AUDs. RESULTS Despite considerable improvements in the design of alcohol clinical trials over the past 2 decades, many studies of AUD treatments have used faulty design features and statistical methods that are known to produce biased estimates of treatment efficacy. CONCLUSIONS The published statistical and methodological literatures provide clear guidance on methods to improve clinical trial design and analysis. Consistent use of state-of-the-art design features and analytic approaches will enhance the internal and external validity of treatment trials for AUDs across the spectrum of severity. The ultimate result of this attention to methodological rigor is that better treatment options will be identified for patients with an AUD.

[1]  A. Page,et al.  Bridging the gap between best evidence and best practice in mental health. , 2010, Clinical psychology review.

[2]  R. Olsen,et al.  Recent advances in the discovery and preclinical testing of novel compounds for the prevention and/or treatment of alcohol use disorders. , 2013, Alcoholism, clinical and experimental research.

[3]  N. Heather,et al.  Effectiveness of treatment for alcohol problems: findings of the randomised UK alcohol treatment trial (UKATT) , 2005, BMJ : British Medical Journal.

[4]  J. Finney,et al.  Outcome variables and their assessment in alcohol treatment studies: 1968-1998. , 2003, Alcoholism, clinical and experimental research.

[5]  H. Kranzler,et al.  The pharmacogenetics of alcohol use disorder. , 2015, Alcoholism, clinical and experimental research.

[6]  Lei Liu,et al.  Percentage of subjects with no heavy drinking days: evaluation as an efficacy endpoint for alcohol clinical trials. , 2010, Alcoholism, clinical and experimental research.

[7]  Cassandra J Rowe,et al.  Pharmacotherapy for adults with alcohol use disorders in outpatient settings: a systematic review and meta-analysis. , 2014, JAMA.

[8]  Ree Dawson,et al.  Dynamic treatment regimes: practical design considerations , 2004, Clinical trials.

[9]  M. Abdalla,et al.  The SF 36 health survey questionnaire. A valid measure of health status... , 1993, BMJ.

[10]  D. Oslin,et al.  Adherence monitoring in naltrexone pharmacotherapy trials: a systematic review. , 2011, Journal of studies on alcohol and drugs.

[11]  B. Kahan Accounting for centre-effects in multicentre trials with a binary outcome – when, why, and how? , 2014, BMC Medical Research Methodology.

[12]  S. Bowen,et al.  The mindfulness-based relapse prevention adherence and competence scale: Development, interrater reliability, and validity , 2010, Psychotherapy research : journal of the Society for Psychotherapy Research.

[13]  P. Jatlow,et al.  Ethyl glucuronide and ethyl sulfate assays in clinical trials, interpretation, and limitations: results of a dose ranging alcohol challenge study and 2 clinical trials. , 2014, Alcoholism, clinical and experimental research.

[14]  Amy M. Cohn,et al.  Promoting behavior change from alcohol use through mobile technology: the future of ecological momentary assessment. , 2011, Alcoholism, clinical and experimental research.

[15]  Katie Witkiewitz,et al.  Missing data in alcohol clinical trials: a comparison of methods. , 2013, Alcoholism, clinical and experimental research.

[16]  Douglas Steinley,et al.  Alcohol use trajectories and the ubiquitous cat's cradle: cause for concern? , 2011, Journal of abnormal psychology.

[17]  B. Giraudeau,et al.  Propensity scores used for analysis of cluster randomized trials with selection bias: a simulation study , 2013, Statistics in medicine.

[18]  David P. MacKinnon,et al.  Statistical Approaches for Enhancing Causal Interpretation of the M to Y Relation in Mediation Analysis , 2015, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[19]  David Couper,et al.  Combined pharmacotherapies and behavioral interventions for alcohol dependence: the COMBINE study: a randomized controlled trial. , 2006, JAMA.

[20]  D. Gastfriend,et al.  Developing a baseline assessment battery: balancing patient time burden with essential clinical and research monitoring. , 2005, Journal of studies on alcohol. Supplement.

[21]  G. Koob,et al.  Heterogeneity of alcohol use disorder: understanding mechanisms to advance personalized treatment. , 2015, Alcoholism, clinical and experimental research.

[22]  Lorenzo Leggio,et al.  Use of novel technology-based techniques to improve alcohol-related outcomes in clinical trials. , 2013, Alcohol and alcoholism.

[23]  Drinking reports from collateral individuals. , 2003, Addiction.

[24]  S. Murphy,et al.  Developing adaptive treatment strategies in substance abuse research. , 2007, Drug and alcohol dependence.

[25]  Ellen Frank,et al.  A novel approach for developing and interpreting treatment moderator profiles in randomized clinical trials. , 2013, JAMA psychiatry.

[26]  D. Roth,et al.  Effects of interactive voice response self-monitoring on natural resolution of drinking problems: utilization and behavioral economic factors. , 2012, Journal of studies on alcohol and drugs.

[27]  Kazem Mohammad,et al.  Let Continuous Outcome Variables Remain Continuous , 2012, Comput. Math. Methods Medicine.

[28]  G. Guyatt,et al.  Post-randomisation exclusions: the intention to treat principle and excluding patients from analysis , 2002, BMJ : British Medical Journal.

[29]  K. Witkiewitz Lapses following alcohol treatment: modeling the falls from the wagon. , 2008, Journal of studies on alcohol and drugs.

[30]  Foreman,et al.  The state of US health, 1990-2010: burden of diseases, injuries, and risk factors. , 2013, JAMA.

[31]  H. Kranzler,et al.  Pharmacotherapy of alcohol use disorders: seventy-five years of progress. , 2014, Journal of studies on alcohol and drugs. Supplement.

[32]  L. Sobell,et al.  Factors affecting agreement between alcohol abusers' and their collaterals' reports. , 1997, Journal of studies on alcohol.

[33]  B. Rounsaville,et al.  A general system for evaluating therapist adherence and competence in psychotherapy research in the addictions. , 2000, Drug and alcohol dependence.

[34]  S. Widner,et al.  Self-Report of Drinking Compared to Objective Markers of Alcohol Consumption , 2009, The American journal of drug and alcohol abuse.

[35]  Vance W Berger,et al.  The reverse propensity score to detect selection bias and correct for baseline imbalances , 2005, Statistics in medicine.

[36]  Peter C Austin,et al.  The performance of different propensity score methods for estimating marginal hazard ratios , 2007, Statistics in medicine.

[37]  Hanne H. Brorson,et al.  Drop-out from addiction treatment: a systematic review of risk factors. , 2013, Clinical psychology review.

[38]  C. Randall,et al.  Measurement and choice of drinking outcome variables in the COMBINE Study. , 2005, Journal of studies on alcohol. Supplement.

[39]  S. Murphy,et al.  A "SMART" design for building individualized treatment sequences. , 2012, Annual review of clinical psychology.

[40]  K. Humphreys,et al.  Use of exclusion criteria in selecting research subjects and its effect on the generalizability of alcohol treatment outcome studies. , 2000, The American journal of psychiatry.

[41]  L. Davis,et al.  Maximizing retention in community-based clinical trials. , 2002, Journal of nursing scholarship : an official publication of Sigma Theta Tau International Honor Society of Nursing.

[42]  W. Miller,et al.  Is low therapist empathy toxic? , 2013, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[43]  H. Kraemer,et al.  Are certain multicenter randomized clinical trial structures misleading clinical and policy decisions? , 2005, Contemporary clinical trials.

[44]  James G. Murphy,et al.  Contingency management for alcohol use reduction: a pilot study using a transdermal alcohol sensor. , 2011, Drug and alcohol dependence.

[45]  J. Blodgett,et al.  Intention-to-treat analyses and missing data approaches in pharmacotherapy trials for alcohol use disorders , 2013, BMJ Open.

[46]  D. Kivlahan,et al.  Assessing nondrinking outcomes in combined pharmacotherapy and psychotherapy clinical trials for the treatment of alcohol dependence. , 2005, Journal of studies on alcohol. Supplement.

[47]  K. Witkiewitz,et al.  Relapse prevention for alcohol and drug problems: that was Zen, this is Tao. , 2004, The American psychologist.

[48]  S. Coffey,et al.  Pretreatment changes in drinking: relationship to treatment outcomes. , 2013, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[49]  Frederick P Rivara,et al.  Comparison of trauma center patient self-reports and proxy reports on the Alcohol Use Identification Test (AUDIT). , 2004, The Journal of trauma.

[50]  Ahnalee M. Brincks,et al.  Modeling Site Effects in the Design and Analysis of Multi-site Trials , 2011, The American journal of drug and alcohol abuse.

[51]  Maria A. Levi-Minzi,et al.  Interview as intervention: the case of young adult multidrug users in the club scene. , 2013, Journal of substance abuse treatment.

[52]  Yoshiharu Yamamoto,et al.  Ecological Momentary Assessment Scale for Appetite , 2015 .

[53]  J. Baer,et al.  The utility of collateral informant assessment in college alcohol research: results from a longitudinal prevention trial. , 2005, Journal of studies on alcohol.

[54]  S. Tiffany,et al.  Beyond drug use: a systematic consideration of other outcomes in evaluations of treatments for substance use disorders. , 2012, Addiction.

[55]  J. Myers,et al.  Effects of adjusting for instrumental variables on bias and precision of effect estimates. , 2011, American journal of epidemiology.

[56]  S. Maisto,et al.  Alcohol treatment research assessment exposure subject reactivity effects: part I. Alcohol use and related consequences. , 2007, Journal of studies on alcohol and drugs.

[57]  W. van den Brink,et al.  Treatment outcome of alcohol use disorder outpatients with or without medically assisted detoxification. , 2014, Journal of studies on alcohol and drugs.

[58]  J. Hosking,et al.  Do patients with alcohol dependence respond to placebo? Results from the COMBINE Study. , 2008, Journal of studies on alcohol and drugs.

[59]  Alex H. S. Harris,et al.  Guidelines for the Reporting of Treatment Trials for Alcohol Use Disorders. , 2015, Alcoholism, clinical and experimental research.

[60]  Jack Darkes,et al.  The validity of self-reports of alcohol consumption: state of the science and challenges for research. , 2003, Addiction.

[61]  J. McKay Treating Substance Use Disorders with Adaptive Continuing Care , 2009 .

[62]  B. Kahan,et al.  Improper analysis of trials randomised using stratified blocks or minimisation , 2012, Statistics in medicine.

[63]  D. Couper,et al.  Baseline trajectories of heavy drinking and their effects on postrandomization drinking in the COMBINE Study: empirically derived predictors of drinking outcomes during treatment. , 2012, Alcohol.

[64]  Daniel J Bauer,et al.  Distributional assumptions of growth mixture models: implications for overextraction of latent trajectory classes. , 2003, Psychological methods.

[65]  L. Derogatis,et al.  The Brief Symptom Inventory: an introductory report , 1983, Psychological Medicine.

[66]  Matching Alcoholism Treatments to Client Heterogeneity: Project MATCH posttreatment drinking outcomes. , 1997, Journal of studies on alcohol.

[67]  Craig K. Enders,et al.  Applied Missing Data Analysis , 2010 .

[68]  J. Ware,et al.  A 12-Item Short-Form Health Survey: construction of scales and preliminary tests of reliability and validity. , 1996, Medical care.

[69]  T. Wagner,et al.  Estimating the efficacy of Alcoholics Anonymous without self-selection bias: an instrumental variables re-analysis of randomized clinical trials. , 2014, Alcoholism, clinical and experimental research.

[70]  Y. Kaminer,et al.  Can assessment reactivity predict treatment outcome among adolescents with alcohol and other substance use disorders? , 2008, Substance abuse.

[71]  Helena Chmura Kraemer,et al.  Discovering, comparing, and combining moderators of treatment on outcome after randomized clinical trials: a parametric approach , 2013, Statistics in medicine.

[72]  P. Donnan,et al.  The PRECIS-2 tool: designing trials that are fit for purpose , 2015, BMJ : British Medical Journal.

[73]  S. Armeli,et al.  Self‐efficacy mediates the effects of topiramate and GRIK1 genotype on drinking , 2016, Addiction biology.

[74]  R. S. Palmer,et al.  Treatment: Dropping Out Substance User Treatment Dropout from Client and Clinician Perspectives: A Pilot Study , 2009 .

[75]  Richard Longabaugh,et al.  Concurrent validity of the Alcohol Use Disorders Identification Test (AUDIT) and AUDIT zones in defining levels of severity among out-patients with alcohol dependence in the COMBINE study. , 2006, Addiction.

[76]  A. Justice,et al.  An experimental study of the agreement of self-administration and telephone administration of the Timeline Followback interview. , 2008, Journal of studies on alcohol and drugs.

[77]  Alex H. S. Harris,et al.  Common statistical and research design problems in manuscripts submitted to high-impact psychiatry journals: what editors and reviewers want authors to know. , 2009, Journal of psychiatric research.

[78]  Kenneth J Sher,et al.  Limits of Current Approaches to Diagnosis Severity Based on Criterion Counts , 2015, Clinical psychological science : a journal of the Association for Psychological Science.

[79]  K. Lynch,et al.  Initial evidence for the reliability and validity of a "Lite" version of the Addiction Severity Index. , 2007, Drug and alcohol dependence.

[80]  Nancy P Barnett,et al.  Predictors of detection of alcohol use episodes using a transdermal alcohol sensor. , 2014, Experimental and clinical psychopharmacology.

[81]  Mirjam Moerbeek,et al.  A comparison between traditional methods and multilevel regression for the analysis of multicenter intervention studies. , 2003, Journal of clinical epidemiology.

[82]  H. Moss,et al.  Alcohol biomarkers in applied settings: recent advances and future research opportunities. , 2010, Alcoholism, clinical and experimental research.

[83]  W. Miller,et al.  Mesa Grande: a methodological analysis of clinical trials of treatments for alcohol use disorders. , 2002, Addiction.

[84]  L. Sobell,et al.  Alcohol and drug treatment outcome studies: new methodological review (2005-2010) and comparison with past reviews. , 2014, Addictive behaviors.

[85]  Yuanyuan Liang,et al.  Use of continuous transdermal alcohol monitoring during a contingency management procedure to reduce excessive alcohol use. , 2014, Drug and alcohol dependence.

[86]  R. Anton,et al.  What role does measuring medication compliance play in evaluating the efficacy of naltrexone? , 2007, Alcoholism, clinical and experimental research.

[87]  G. Clarke,et al.  AACAP 2001 research forum: challenges and recommendations regarding recruitment and retention of participants in research investigations. , 2004, Journal of the American Academy of Child and Adolescent Psychiatry.

[88]  C. Davis,et al.  Alcohol treatment research assessment exposure: a critical review of the literature. , 2012, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[89]  H. Neels,et al.  Hair ethyl glucuronide levels as a marker for alcohol use and abuse: a review of the current state of the art. , 2014, Drug and alcohol dependence.

[90]  S. Murphy,et al.  Dynamic Treatment Regimes. , 2014, Annual review of statistics and its application.

[91]  J. Blodgett,et al.  A meta-analysis of topiramate's effects for individuals with alcohol use disorders. , 2014, Alcoholism, clinical and experimental research.

[92]  M. Heilig,et al.  Medications development to treat alcohol dependence: a vision for the next decade , 2012, Addiction biology.

[93]  J. Lachin,et al.  Properties of permuted-block randomization in clinical trials. , 1988, Controlled clinical trials.

[94]  Antonio A Morgan-Lopez,et al.  Analytic methods for modeling longitudinal data from rolling therapy groups with membership turnover. , 2007, Journal of consulting and clinical psychology.

[95]  Zac E. Imel,et al.  Distinctions without a difference: direct comparisons of psychotherapies for alcohol use disorders. , 2008, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[96]  Katherine E. Masyn,et al.  Drinking trajectories following an initial lapse. , 2008, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[97]  D. Moher,et al.  The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration , 2001, Annals of Internal Medicine.

[98]  R. Woolson,et al.  Randomization in substance abuse clinical trials , 2006, Substance abuse treatment, prevention, and policy.

[99]  W. Miller,et al.  Training, supervision and quality monitoring of the COMBINE Study behavioral interventions. , 2005, Journal of studies on alcohol. Supplement.

[100]  Sean C. Duncan,et al.  Concurrent validity of an online version of the Timeline Followback assessment. , 2012, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[101]  Hsiao-ye Yi,et al.  The placebo effect in clinical trials for alcohol dependence: an exploratory analysis of 51 naltrexone and acamprosate studies. , 2013, Alcoholism, clinical and experimental research.

[102]  Richard Longabaugh,et al.  Recent Advances in Behavioral Addiction Treatments: Focusing on Mechanisms of Change , 2011, Current psychiatry reports.

[103]  Sara T Brookes,et al.  Subgroup analyses in randomized trials: risks of subgroup-specific analyses; power and sample size for the interaction test. , 2004, Journal of clinical epidemiology.

[104]  J. MacKillop,et al.  Biobehavioral mechanisms of topiramate's effects on alcohol use: an investigation pairing laboratory and ecological momentary assessments , 2016, Addiction biology.

[105]  Alex H. S. Harris,et al.  HEDIS initiation and engagement quality measures of substance use disorder care: impact of setting and health care specialty. , 2009, Population health management.

[106]  M. Berk,et al.  Client-reported reasons for non-engagement in drug and alcohol treatment. , 2009, Drug and alcohol review.

[107]  A. Kazdin Mediators and mechanisms of change in psychotherapy research. , 2007, Annual review of clinical psychology.

[108]  A. Zweben,et al.  Development of a composite measure for assessing alcohol treatment outcome: operationalization and validation. , 1999, Alcoholism, clinical and experimental research.

[109]  V. Berger A review of methods for ensuring the comparability of comparison groups in randomized clinical trials. , 2006, Reviews on recent clinical trials.

[110]  M. Brusco,et al.  Evaluating mixture modeling for clustering: recommendations and cautions. , 2011, Psychological methods.

[111]  Wei Wang,et al.  Methods for Synthesizing Findings on Moderation Effects Across Multiple Randomized Trials , 2011, Prevention Science.

[112]  Vance W Berger,et al.  Quantifying the Magnitude of Baseline Covariate Imbalances Resulting from Selection Bias in Randomized Clinical Trials , 2005, Biometrical journal. Biometrische Zeitschrift.

[113]  H. Kranzler,et al.  Elevated rates of early discontinuation from pharmacotherapy trials in alcoholics and drug abusers. , 1996, Alcoholism, clinical and experimental research.

[114]  K. Witkiewitz,et al.  A comparison of methods for estimating change in drinking following alcohol treatment. , 2010, Alcoholism, clinical and experimental research.

[115]  F. Wurst,et al.  BIOMARKER: Phosphatidylethanol as a sensitive and specific biomarker—comparison with gamma‐glutamyl transpeptidase, mean corpuscular volume and carbohydrate‐deficient transferrin , 2007, Addiction biology.

[116]  A. Alterman,et al.  Recent status scores for version 6 of the Addiction Severity Index (ASI-6). , 2011, Addiction.

[117]  Linda C. Sobell,et al.  Timeline Follow-Back A Technique for Assessing Self-Reported Alcohol Consumption , 1992 .

[118]  S. Maisto,et al.  Alcohol treatment research assessment exposure subject reactivity effects: part II. Treatment engagement and involvement. , 2007, Journal of studies on alcohol and drugs.

[119]  R. Feinn,et al.  Psychometric properties of the short index of problems as a measure of recent alcohol-related problems. , 2003, Alcoholism, clinical and experimental research.

[120]  David C. Atkins,et al.  A tutorial on count regression and zero-altered count models for longitudinal substance use data. , 2013, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[121]  K. Witkiewitz "Success" following alcohol treatment: moving beyond abstinence. , 2013, Alcoholism, clinical and experimental research.

[122]  K. Witkiewitz,et al.  Alcohol use disorder clinical course research: informing clinicians' treatment planning now and in the future. , 2014, Journal of studies on alcohol and drugs.

[123]  S. Pocock,et al.  Statistical problems in the reporting of clinical trials. A survey of three medical journals. , 1987, The New England journal of medicine.

[124]  James R McKay,et al.  Personalized Treatment of Alcohol Dependence , 2012, Current Psychiatry Reports.

[125]  Craig K Enders,et al.  Missing not at random models for latent growth curve analyses. , 2011, Psychological methods.

[126]  M. Hesselbrock,et al.  Consensus paper of the WFSBP task force on biological markers: Biological markers for alcoholism , 2013, The world journal of biological psychiatry : the official journal of the World Federation of Societies of Biological Psychiatry.

[127]  R. G. Rychtarik,et al.  Participant selection biases in a randomized clinical trial of alcoholism treatment settings and intensities. , 1998, Alcoholism, clinical and experimental research.

[128]  Yu Ye,et al.  Using propensity scores to adjust for selection bias when assessing the effectiveness of Alcoholics Anonymous in observational studies. , 2009, Drug and alcohol dependence.

[129]  D. Rubin,et al.  A hierarchical finite mixture model that accommodates zero‐inflated counts, non‐independence, and heterogeneity , 2014, Statistics in medicine.

[130]  Brian D. Kiluk,et al.  The Short Inventory of Problems - revised (SIP-R): psychometric properties within a large, diverse sample of substance use disorder treatment seekers. , 2013, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[131]  K. Mann,et al.  The Alcohol Clinical Trials Initiative (ACTIVE): Purpose and Goals for Assessing Important and Salient Issues for Medications Development in Alcohol Use Disorders , 2012, Neuropsychopharmacology.

[132]  S. Murphy,et al.  Experimental design and primary data analysis methods for comparing adaptive interventions. , 2012, Psychological methods.

[133]  Kristopher J Preacher,et al.  On the practice of dichotomization of quantitative variables. , 2002, Psychological methods.

[134]  David C. Atkins,et al.  Project INTEGRATE: An integrative study of brief alcohol interventions for college students. , 2015, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[135]  Linda M Collins,et al.  The effect of the timing and spacing of observations in longitudinal studies of tobacco and other drug use: temporal design considerations. , 2002, Drug and alcohol dependence.

[136]  A. Zweben,et al.  Recruiting and retaining participants in a combined behavioral and pharmacological clinical trial. , 2005, Journal of studies on alcohol. Supplement.

[137]  K. Mann,et al.  Extending the Treatment Options in Alcohol Dependence: A Randomized Controlled Study of As-Needed Nalmefene , 2013, Biological Psychiatry.

[138]  N. Heather,et al.  Development of a scale for measuring impaired control over alcohol consumption: a preliminary report. , 1993, Journal of studies on alcohol.

[139]  B. Rounsaville,et al.  A vision of the next generation of behavioral therapies research in the addictions. , 2007, Addiction.

[140]  K. Witkiewitz,et al.  Trajectories of cigarettes per day during the course of telephone tobacco cessation counseling services: a comparison of missing data models. , 2012, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.

[141]  E. Pedersen,et al.  A within-subjects validation of a group-administered timeline followback for alcohol use. , 2006, Journal of studies on alcohol.

[142]  D. Metzger,et al.  The Fifth Edition of the Addiction Severity Index. , 1992, Journal of substance abuse treatment.

[143]  W. Fals-Stewart,et al.  Analytic complexities associated with group therapy in substance abuse treatment research: problems, recommendations, and future directions. , 2006, Experimental and clinical psychopharmacology.

[144]  Alex H. S. Harris,et al.  Subject eligibility criteria can substantially influence the results of alcohol-treatment outcome research. , 2008, Journal of studies on alcohol and drugs.

[145]  Kevin A. Hallgren,et al.  Methods to analyze treatment effects in the presence of missing data for a continuous heavy drinking outcome measure when participants drop out from treatment in alcohol clinical trials. , 2014, Alcoholism, clinical and experimental research.

[146]  Dhavan V. Shah,et al.  A smartphone application to support recovery from alcoholism: a randomized clinical trial. , 2014, JAMA psychiatry.

[147]  M. Soyka,et al.  Validity of carbohydrate-deficient transferrin (%CDT), gamma-glutamyltransferase (gamma-GT) and mean corpuscular erythrocyte volume (MCV) as biomarkers for chronic alcohol abuse: a study in patients with alcohol dependence and liver disorders of non-alcoholic and alcoholic origin. , 2005, Addiction.

[148]  Bongin Yoo The impact of dichotomization in longitudinal data analysis: a simulation study , 2010, Pharmaceutical statistics.

[149]  Alan E Kazdin,et al.  Evidence-based treatment and practice: new opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. , 2008, The American psychologist.

[150]  J Scott Tonigan,et al.  A novel application of propensity score matching to estimate Alcoholics Anonymous' effect on drinking outcomes. , 2013, Drug and alcohol dependence.

[151]  Lane F Burgette,et al.  A tutorial on propensity score estimation for multiple treatments using generalized boosted models , 2013, Statistics in medicine.

[152]  Peter C Austin,et al.  A critical appraisal of propensity‐score matching in the medical literature between 1996 and 2003 , 2008, Statistics in medicine.

[153]  David Goldman,et al.  COMBINE genetics study: the pharmacogenetics of alcoholism treatment response: genes and mechanisms. , 2005, Journal of studies on alcohol. Supplement.

[154]  I. White,et al.  A general method for handling missing binary outcome data in randomized controlled trials , 2014, Addiction.

[155]  Ming D. Li,et al.  Pharmacogenetic approach at the serotonin transporter gene as a method of reducing the severity of alcohol drinking. , 2011, The American journal of psychiatry.

[156]  N. Azrin,et al.  Psychometric evaluation of self- and collateral timeline follow-back reports of drug and alcohol use in a sample of drug-abusing and conduct-disordered adolescents and their parents. , 2004, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[157]  W. van den Brink,et al.  Efficacy of As-Needed Nalmefene in Alcohol-Dependent Patients with at Least a High Drinking Risk Level: Results from a Subgroup Analysis of Two Randomized Controlled 6-Month Studies , 2013, Alcohol and alcoholism.

[158]  J. Beyene,et al.  Estimating treatment effects in randomised controlled trials with non-compliance: a simulation study , 2014, BMJ Open.

[159]  Joseph A. Bulbulia,et al.  Demographic and Psychological Predictors of Panel Attrition: Evidence from the New Zealand Attitudes and Values Study , 2015, PloS one.

[160]  John A. Lewis,et al.  Subgroup Analyses in Randomized Clinical Trials: Statistical and Regulatory Issues , 2005, Journal of biopharmaceutical statistics.

[161]  Katie Witkiewitz,et al.  Behavioral Therapy Across the Spectrum , 2011, Alcohol research & health : the journal of the National Institute on Alcohol Abuse and Alcoholism.

[162]  B. Rounsaville,et al.  Reasons for dropout from drug abuse treatment: symptoms, personality, and motivation. , 2006, Addictive behaviors.

[163]  R. Longabaugh The search for mechanisms of change in behavioral treatments for alcohol use disorders: a commentary. , 2007, Alcoholism, clinical and experimental research.

[164]  A. Holbrook,et al.  Comparing methods to estimate treatment effects on a continuous outcome in multicentre randomized controlled trials: A simulation study , 2011, BMC medical research methodology.

[165]  W. Miller,et al.  The forest and the trees: relational and specific factors in addiction treatment. , 2015, Addiction.

[166]  S. Armeli,et al.  A Double-Blind, Randomized Trial of Sertraline for Alcohol Dependence: Moderation by Age of Onset and 5-Hydroxytryptamine Transporter-Linked Promoter Region Genotype , 2011, Journal of clinical psychopharmacology.

[167]  W. Miller,et al.  Psychometrics of the Drinker Inventory of Consequences (DrInC). , 2007, Addictive behaviors.

[168]  S. Tiffany,et al.  Other outcomes in treatments for substance-use disorders: a call for action. , 2012, Addiction.

[169]  Alex H. S. Harris,et al.  Pharmacotherapy of alcohol use disorders by the Veterans Health Administration: patterns of receipt and persistence. , 2012, Psychiatric services.

[170]  David P Mackinnon,et al.  Investigation of Mediational Processes Using Parallel Process Latent Growth Curve Modeling , 2003, Structural equation modeling : a multidisciplinary journal.

[171]  D. Bandyopadhyay,et al.  Modeling longitudinal drinking data in clinical trials: an application to the COMBINE study. , 2013, Drug and alcohol dependence.

[172]  Linda C. Sobell,et al.  Alcohol Timeline Followback , 2000 .

[173]  Robert D Brewer,et al.  Economic costs of excessive alcohol consumption in the U.S., 2006. , 2011, American journal of preventive medicine.

[174]  A. Zweben,et al.  Alcohol treatment effects on secondary nondrinking outcomes and quality of life: the COMBINE study. , 2009, Journal of studies on alcohol and drugs.

[175]  B. Kahan,et al.  Analysis of multicentre trials with continuous outcomes: when and how should we account for centre effects? , 2013, Statistics in medicine.

[176]  D. Couper,et al.  Naltrexone and combined behavioral intervention effects on trajectories of drinking in the COMBINE study. , 2010, Drug and Alcohol Dependence.

[177]  J. Schafer,et al.  Missing data: our view of the state of the art. , 2002, Psychological methods.

[178]  Nick Freemantle,et al.  Interpreting the results of secondary end points and subgroup analyses in clinical trials: should we lock the crazy aunt in the attic? , 2001, BMJ : British Medical Journal.

[179]  J. Graham,et al.  Missing data analysis: making it work in the real world. , 2009, Annual review of psychology.

[180]  H. Kranzler,et al.  What happens when people discontinue taking medications? Lessons from COMBINE. , 2014, Addiction.

[181]  D. Donovan More mice or a better mouse trap? Reflections on primary outcome indices in illicit drug dependence treatment research. , 2012, Addiction.

[182]  W. Miller,et al.  Form 90: A Structured Assessment Interview for Drinking and Related Behaviors: Test Manual , 1996 .

[183]  K. Humphreys,et al.  Do clinical trials of treatment of alcohol dependence adequately enroll participants with co-occurring independent mood and anxiety disorders? An analysis of data from the National Epidemiologic Survey on Alcohol and Related Conditions (NESARC). , 2014, The Journal of clinical psychiatry.