Internal validity of Project MATCH treatments: discriminability and integrity.

Project MATCH (Matching Alcoholism Treatments to Client Heterogeneity) is a multisite collaborative project designed to evaluate patient-treatment interactions in alcoholism treatment. To evaluate whether major threats to the internal validity of the independent (treatment) variable in Project MATCH could be ruled out, we investigated several aspects of treatment integrity and discriminability. In this study, 1,726 alcohol-dependent participants at 10 sites were randomized to 3 treatments: cognitive-behavioral treatment (CBT), motivational enhancement therapy (MET), and 12-step facilitation (TSF). Participants received treatment either as outpatients or as aftercare following a more intensive inpatient or day hospital treatment. For both the outpatient and aftercare arms of the study, treatments were discriminable in that therapists implemented each of the treatments according to manual guidelines and rarely used techniques associated with comparison approaches. Participants received a high level of exposure to their study treatments, and the intended contrast in treatment dose between MET and the 2 more intensive treatments (CBT and TSF) was obtained. Alcoholics Anonymous involvement was significantly higher for participants assigned to TSF versus MET or CBT, whereas the treatments did not differ in utilization of other nonstudy treatments. Nonspecific aspects of treatment such as therapist skillfulness and level of the therapeutic alliance were comparable across treatment conditions.

[1]  R. Moos,et al.  Matching patients with treatments: conceptual and methodological issues. , 1986, Journal of studies on alcohol.

[2]  R. DeRubeis,et al.  Can psychotherapies for depression be discriminated? A systematic investigation of cognitive therapy and interpersonal therapy. , 1982, Journal of consulting and clinical psychology.

[3]  W. Stiles,et al.  Disabuse of the drug metaphor: psychotherapy process-outcome correlations. , 1994, Journal of consulting and clinical psychology.

[4]  B. Rounsaville,et al.  Implementing treatment and protecting the validity of the independent variable in treatment matching studies. , 1994, Journal of studies on alcohol. Supplement.

[5]  R. Anton,et al.  Multisite clinical trials in alcoholism treatment research: organizational, methodological and management issues. , 1994, Journal of studies on alcohol. Supplement.

[6]  L. Sechrest,et al.  Critical dimensions in the choice and maintenance of successful treatments: strength, integrity, and effectiveness. , 1981, Journal of consulting and clinical psychology.

[7]  J. Stevens Applied Multivariate Statistics for the Social Sciences , 1986 .

[8]  W. Miller Motivation for treatment: a review with special emphasis on alcoholism. , 1985, Psychological bulletin.

[9]  L. Greenberg,et al.  The psychotherapeutic process: A research handbook. , 1986 .

[10]  C. Diclemente,et al.  Project MATCH: Rationale and methods for a multisite clinical trial matching patients to alcoholism treatment , 1993 .

[11]  C. Diclemente,et al.  Issues in the development of client-treatment matching hypotheses. , 1994, Journal of studies on alcohol. Supplement.

[12]  D. Orlinsky,et al.  Process and outcome in psychotherapy: Noch einmal. , 1994 .

[13]  T. Tracey,et al.  Factor structure of the Working Alliance Inventory. , 1989 .

[14]  A. Consoli,et al.  Comprehensive Textbook of Psychotherapy: Theory and Practice , 1994 .

[15]  K. O’grady,et al.  Applying the Collaborative Study Psychotherapy Rating Scale to rate therapist adherence in cognitive-behavior therapy, interpersonal therapy, and clinical management. , 1992, Journal of consulting and clinical psychology.

[16]  Clara E. Hill,et al.  A comparison of six measures of working alliance. , 1989 .

[17]  L. Lindström Managing Alcoholism: Matching Clients to Treatments , 1992 .

[18]  W. Miller,et al.  Therapist effects in three treatments for alcohol problems , 1998 .

[19]  F. D. Del Boca,et al.  Measurement of drinking behavior using the Form 90 family of instruments. , 1994, Journal of studies on alcohol. Supplement.

[20]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[21]  C. Diclemente,et al.  Issues in the selection and development of therapies in alcoholism treatment matching research. , 1994, Journal of studies on alcohol. Supplement.

[22]  R. Spitzer,et al.  Psychotherapy Research: Where Are We and Where Should We Go? , 1984 .

[23]  K. Carroll,et al.  Process assessment in treatment matching research. , 1994, Journal of studies on alcohol. Supplement.

[24]  N. Jacobson,et al.  Testing the integrity of a psychotherapy protocol: assessment of adherence and competence. , 1993, Journal of consulting and clinical psychology.

[25]  A. Horvath,et al.  The development of the Working Alliance Inventory. , 1986 .

[26]  I. Elkin,et al.  NIMH Treatment of Depression Collaborative Research Program. Background and research plan. , 1985, Archives of general psychiatry.

[27]  F. Floyd,et al.  Factor analysis in the development and refinement of clinical assessment instruments. , 1995 .

[28]  Richard J. Harris A primer of multivariate statistics , 1975 .

[29]  A. Bergin,et al.  Handbook of psychotherapy and behavior change, 4th ed. , 1994 .