Distinctions without a difference: direct comparisons of psychotherapies for alcohol use disorders.

To estimate the relative efficacy of alcohol use disorder treatments, the authors meta-analyzed studies that directly compared 2 bona fide psychological treatments. The authors accommodated problems with the inclusion of multiple treatment comparisons by randomly assigning a positive/negative sign to the effect size derived from each comparison and then estimating the extent to which effect sizes were heterogeneous. The authors' primary hypothesis was that the variability in effect sizes of bona fide psychological treatments for alcohol use disorders that were directly compared would be zero. For both alcohol measures and measures of abstinence, analyses indicate that effects were homogenously distributed about zero (I(2) = 10.61, 0.00, respectively), indicating that different treatment comparisons yielded a common effect size that was not significantly different from zero. Analyses also indicate that allegiance accounted for a significant portion of variability in differences between treatments. Implications for the treatment of alcohol use disorders as well as research on the mechanisms responsible for the benefit of treatment are discussed.

[1]  R. Rosenthal Experimenter effects in behavioral research , 1968 .

[2]  E. Forgy,et al.  A controlled experiment on the use of court probation for drunk arrests. , 1967, The American journal of psychiatry.

[3]  L. M. Campbell,et al.  A comparison of four behavioral treatments of alcoholism , 1974 .

[4]  D. Kavanagh,et al.  Cue exposure in moderation drinking: a comparison with cognitive-behavior therapy. , 1997, Journal of consulting and clinical psychology.

[5]  N. Heather,et al.  Efficacy of moderation-oriented cue exposure for problem drinkers: a randomized controlled trial. , 2002, Journal of consulting and clinical psychology.

[6]  Frederick A. Stich,et al.  A meta-analysis of outcome studies comparing bona fide psychotherapies: Empiricially, "all must have prizes." , 1997 .

[7]  V. Devine,et al.  Long-term effects of behavioral versus insight-oriented therapy with inpatient alcoholics. , 1981, Journal of consulting and clinical psychology.

[8]  C. Diclemente,et al.  Matching alcoholism treatments to client heterogeneity , 1998 .

[9]  N. McGillicuddy,et al.  Treatment settings for persons with alcoholism: evidence for matching clients to inpatient versus outpatient care. , 2000, Journal of consulting and clinical psychology.

[10]  M. Beattie,et al.  Matching treatment focus to patient social investment and support: 18-month follow-up results. , 1995, Journal of consulting and clinical psychology.

[11]  N. Heather,et al.  Effectiveness of treatment for alcohol problems: findings of the randomised UK alcohol treatment trial (UKATT) , 2005, BMJ : British Medical Journal.

[12]  L. Hedges,et al.  The Handbook of Research Synthesis , 1995 .

[13]  K. Humphreys,et al.  Participation in alcoholics anonymous: intended and unintended change mechanisms. , 2003, Alcoholism, clinical and experimental research.

[14]  L Luborsky,et al.  Comparative studies of psychotherapies: is it true that "everybody has won and all must have prizes"? , 1975, Proceedings of the annual meeting of the American Psychopathological Association.

[15]  W. Miller,et al.  Treating Addictive Behaviors , 1986, Applied Clinical Psychology.

[16]  G. Walters Behavioral self-control training for problem drinkers: A meta-analysis of randomized control studies , 2000 .

[17]  O. Pomerleau,et al.  A comparison of behavioral and traditional treatment for middle-income problem drinkers , 1978, Journal of Behavioral Medicine.

[18]  K. A. Blanchard,et al.  Testing the effectiveness of cognitive-behavioral treatment for substance abuse in a community setting: within treatment and posttreatment findings. , 2001, Journal of consulting and clinical psychology.

[19]  R. DeRubeis,et al.  A Conceptual and Methodological Analysis of the Nonspecifics Argument , 2006 .

[20]  W. Shadish,et al.  Effects of family and marital psychotherapies: a meta-analysis. , 1993, Journal of consulting and clinical psychology.

[21]  M. Telch,et al.  A comparison of cessation strategies for the outpatient alcoholic. , 1984, Addictive behaviors.

[22]  R. Woolson,et al.  Naltrexone Combined With Either Cognitive Behavioral or Motivational Enhancement Therapy for Alcohol Dependence , 2005, Journal of clinical psychopharmacology.

[23]  C. Sandahl,et al.  Time-Limited Group Psychotherapy for Moderately Alcohol Dependent Patients: A Randomized Controlled Clinical Trial , 1998 .

[24]  B. Wampold,et al.  Direct comparisons of treatment modalities for youth disorders: a meta-analysis , 2008, Psychotherapy research : journal of the Society for Psychotherapy Research.

[25]  Effectiveness of Broad Spectrum Approaches to Relapse Prevention in Severe Alcoholism , 1994 .

[26]  D. B. Wilson,et al.  Meta-analyses in alcohol and other drug abuse treatment research. , 2000, Addiction.

[27]  R. Hanka The Handbook of Research Synthesis , 1994 .

[28]  Limitations of the Dodo Bird Verdict and the Role of Clinical Trials in Psychotherapy Research: Comment on Wampold et al. (1997) , 1997 .

[29]  C Rouquette,et al.  [Epidemiologic research]. , 1970, Bulletin de l'Institut national de la sante et de la recherche medicale.

[30]  B. Stimmel,et al.  Is treatment for alcoholism effective in persons on methadone maintenance? , 1983, The American journal of psychiatry.

[31]  D. Fleiger,et al.  Covert Sensitization Treatment with Alcoholics. , 1973 .

[32]  P. Crits-Christoph Limitations of the Dodo Bird Verdict and the Role of Clinical Trials in Psychotherapy Research: Comment on Wampold et al. (1997) , 1997 .

[33]  D. Donovan,et al.  Relapse prevention in alcohol aftercare: effects on drinking outcome, change process, and aftercare attendance. , 1988, British journal of addiction.

[34]  B. Wampold,et al.  The consequence of ignoring a nested factor on measures of effect size in analysis of variance. , 2000, Psychological methods.

[35]  E. Gaffan,et al.  Researcher allegiance and meta-analysis: the case of cognitive therapy for depression. , 1995, Journal of consulting and clinical psychology.

[36]  L. Ray,et al.  Blood glucose level, alcohol heavy drinking, and alcohol craving during treatment for alcohol dependence: results from the Combined Pharmacotherapies and Behavioral Interventions for Alcohol Dependence (COMBINE) Study. , 2009, Alcoholism, clinical and experimental research.

[37]  David J. Kupfer,et al.  Size of Treatment Effects and Their Importance to Clinical Research and Practice , 2006, Biological Psychiatry.

[38]  Timothy J. Robinson,et al.  Multilevel Analysis: Techniques and Applications , 2002 .

[39]  G. Coffman,et al.  A randomized trial of treatment options for alcohol-abusing workers. , 1991, The New England journal of medicine.

[40]  Tania B. Huedo-Medina,et al.  Assessing heterogeneity in meta-analysis: Q statistic or I2 index? , 2006, Psychological methods.

[41]  M. Kelley,et al.  Learning sobriety together: A randomized clinical trial examining behavioral couples therapy with alcoholic female patients. , 2006, Journal of consulting and clinical psychology.

[42]  R. Neimeyer,et al.  Psychotherapy for the treatment of depression: a comprehensive review of controlled outcome research. , 1990, Psychological bulletin.

[43]  Matching alcoholics to coping skills or interactional therapies , 1991, Pharmacology Biochemistry and Behavior.

[44]  W. Shadish,et al.  Does Alcoholics Anonymous work? The results from a meta-analysis of controlled experiments. , 1999, Substance use & misuse.

[45]  S. Quintana,et al.  Guidelines for Meta-Analyses of Counseling Psychology Research , 2006 .

[46]  M. Berglund,et al.  Treatment of alcohol abuse: an evidence-based review. , 2003, Alcoholism, clinical and experimental research.

[47]  R. Longabaugh,et al.  Patient depressive symptoms and therapist focus on emotional material: a new look at Project MATCH. , 2003, Journal of studies on alcohol.

[48]  W. Zwick,et al.  Communication skills training, communication skills training with family and cognitive behavioral mood management training for alcoholics. , 1990, Journal of studies on alcohol.

[49]  T. G. Brown,et al.  Process and outcome changes with relapse prevention versus 12-Step aftercare programs for substance abusers. , 2002, Addiction.

[50]  W. Miller Behavioral treatment of problem drinkers: a comparative outcome study of three controlled drinking therapies. , 1978, Journal of consulting and clinical psychology.

[51]  D. Gastfriend Testing combined pharmacotherapies and behavioral interventions in alcohol dependence: rationale and methods. , 2003, Alcoholism, clinical and experimental research.

[52]  W. Miller,et al.  Treatment for Alcoholism , 2002 .

[53]  L. Sobell,et al.  Individualized behavior therapy for alcoholics , 1973 .

[54]  Richard A. Graber,et al.  Abstinence or controlled drinking goals for problem drinkers: A randomized clinical trial. , 1988 .

[55]  S. Chinn A simple method for converting an odds ratio to effect size for use in meta-analysis. , 2000, Statistics in medicine.

[56]  M. Thase What Is the Investigator Allegiance Effect and What Should We Do About It , 2006 .

[57]  A. Horvath The Great Psychotherapy Debate: Models Methods and Findings , 2002 .

[58]  M. Sanchez-Craig,et al.  Random assignment to abstinence and controlled drinking: evaluation of a cognitive-behavioral program for problem drinkers. , 1984, Journal of consulting and clinical psychology.

[59]  F. Floyd,et al.  Evaluating behavioral marital therapy for male alcoholics: Effects on marital adjustment and communication from before to after treatment , 1985 .

[60]  S. Thompson,et al.  Quantifying heterogeneity in a meta‐analysis , 2002, Statistics in medicine.

[61]  C. Sannibale A prospective study of treatment outcome with a group of male problem drinkers. , 1989, Journal of studies on alcohol.

[62]  W. Miller,et al.  A Wealth of Alternatives , 1998 .

[63]  W. Miller,et al.  Covert Sensitization: Alternative Treatment Procedures for Alcoholism , 1989, Behavioural and Cognitive Psychotherapy.

[64]  Robert Rosenthal,et al.  The Researcher's Own Therapy Allegiances: A "Wild Card" in Comparisons of Treatment Efficacy , 1999 .

[65]  W. Shadish,et al.  Mediators and moderators in meta-analysis: there's a reason we don't let dodo birds tell us which psychotherapies should have prizes. , 1991, Journal of consulting and clinical psychology.

[66]  M. Beattie,et al.  Matching alcoholics to treatment. Failure to replicate finding of an earlier study. , 2000, Journal of substance abuse treatment.

[67]  J. McKay,et al.  Rethinking the paradigms that inform behavioral treatment research for substance use disorders. , 2007, Addiction.

[68]  M. Thase Commentary. What is the investigator allegiance effect and what should we do about it , 1999 .

[69]  B. McCrady,et al.  Maintaining change after conjoint behavioral alcohol treatment for men: outcomes at 6 months. , 1999, Addiction.

[70]  M. Salaspuro,et al.  Inpatient treatment of employed alcoholics: a randomized clinical trial on Hazelden-type and traditional treatment. , 1990, Alcoholism, clinical and experimental research.

[71]  K. Carroll,et al.  Treatment of cocaine and alcohol dependence with psychotherapy and disulfiram. , 1998, Addiction.

[72]  C. Mccance,et al.  Alcoholism in North-East Scotland: Its Treatment and Outcome , 1969, British Journal of Psychiatry.

[73]  Larry V. Hedges,et al.  Cooper, Harris, and Larry V. Hedges, eds., The Handbook of Research Synthesis. New York: Russell Sage Foundation, 1994. , 1994 .

[74]  G. A. Marcoulides,et al.  Multilevel Analysis Techniques and Applications , 2002 .

[75]  S. Joe McCarthy,et al.  A randomized controlled trial of Moderation-Oriented Cue Exposure. , 2000, Journal of studies on alcohol.

[76]  Morgan C. Wang,et al.  Efficacy of relapse prevention: a meta-analytic review. , 1999, Journal of consulting and clinical psychology.

[77]  Zac E. Imel,et al.  Untangling the alliance-outcome correlation: exploring the relative importance of therapist and patient variability in the alliance. , 2007, Journal of consulting and clinical psychology.

[78]  W. Miller,et al.  Comparison of three alcohol consumption measures: a concurrent validity study. , 1995, Journal of studies on alcohol.

[79]  L. Hedges,et al.  Statistical Methods for Meta-Analysis , 1987 .