Theory and method in treatment evaluation

Abstract We outline a conceptual model of evaluation research that has both guided and flowed from our research on the process and outcome of treatment for alcohol abuse and for depression. The conceptual model encompasses three basic processes: the process of treatment selection, the process of treatment, and the process underlying the onset and course of the disorder or problem being treated. A theory guiding a program evaluation can focus on one or more of these processes, and findings from evaluations can contribute to the development of better theories of these processes. We discuss how theories can guide both experimental and naturalistic evaluations, as well as aid in the estimation of treatment effects with either type of design. We then consider the role of theory and method in exploring patient-treatment matching. Finally, we discuss the implications of theory-guidance for the utility of evaluations—particularly the utility for evaluation researchers.

[1]  R. Moos,et al.  Evaluating alcoholism treatment programs: an integrated approach. , 1978, Journal of consulting and clinical psychology.

[2]  G. R. Garrett,et al.  Problem Drinkers Seeking Treatment , 1974 .

[3]  Peter H. Rossi,et al.  Evaluating With Sense , 1983 .

[4]  R. Moos,et al.  Matching patients with treatments: conceptual and methodological issues. , 1986, Journal of studies on alcohol.

[5]  A. Meyers,et al.  Seeking help for drinking problems; a study in the Boston Metropolitan Area. , 1982, Journal of studies on alcohol.

[6]  R. Moos,et al.  Treatment experiences of adults with unipolar depression: the influence of patient and life context factors. , 1984, Journal of consulting and clinical psychology.

[7]  D. Finlay.  Effect of Role Network Pressure on an Alcoholic's Approach to Treatment , 1966 .

[8]  R. Moos,et al.  Length of stay and program component effects in the treatment of alcoholism: a comparison of two techniques for process analyses. , 1981, Journal of consulting and clinical psychology.

[9]  Peter H. Rossi,et al.  The Multi-Goal, Theory-Driven Approach to Evaluation: A Model Linking Basic and Applied Social Science , 1980 .

[10]  R. Moos,et al.  Posttreatment experiences and treatment outcome of alcoholic patients six months and two years after hospitalization. , 1980, Journal of consulting and clinical psychology.

[11]  R. Moos,et al.  The expanding scope of alcoholism treatment evaluation. , 1983, The American psychologist.

[12]  R. Moos,et al.  Environmental resources and the posttreatment functioning of alcoholic patients. , 1977, Journal of health and social behavior.

[13]  L. Cronbach,et al.  Designing evaluations of educational and social programs , 1983 .

[14]  R. Moos,et al.  Life stressors and social resources affect posttreatment outcomes among depressed patients. , 1985, Journal of abnormal psychology.

[15]  L. Beckman,et al.  The Treatment‐Delivery System and Alcohol Abuse in Women: Social Policy Implications , 1982 .

[16]  W. Mandell.  A critical overview of evaluations of alcoholism treatment. , 1979, Alcoholism, clinical and experimental research.

[17]  R. Hingson,et al.  Recognizing and seeking help for drinking problems. A study in the Boston metropolitan area. , 1980, Journal of studies on alcohol.

[18]  J. G. Taylor,et al.  Experimental design: a cloak for intellectual sterility. , 1958, British Journal of Psychology.

[19]  L. Bickman.  The functions of program theory , 1987 .

[20]  David S. Cordray,et al.  Quasi‐experimental analysis: A mixture of methods and judgment , 1986 .

[21]  R. Moos,et al.  The social climate of alcoholism treatment programs. , 1976, Archives of general psychiatry.

[22]  Determinants of the posttreatment functioning of alcoholic patients: a conceptual framework. , 1980 .

[23]  Peter H. Rossi,et al.  The theory-driven approach to validity , 1987 .

[24]  R. Moos,et al.  Posttreatment functioning of alcoholic patients: its relation to program participation. , 1977, Journal of consulting and clinical psychology.

[25]  William R. Shadish,et al.  PROGRAM EVALUATION: THE WORLDLY SCIENCE , 1986 .

[26]  K. Lewin.  Field theory in social science , 1951 .

[27]  J. Z. Shapiro.  Evaluation As Theory Testing: An Example from Head Start , 1982 .

[28]  Mark W. Lipsey,et al.  Driving toward theory in program evaluation: More models to choose from , 1989 .

[29]  William M. K. Trochim,et al.  Pattern Matching, Validity, and Conceptualization in Program Evaluation , 1985 .

[30]  R. DeRubeis,et al.  Causal mediation of change in treatment for depression: discriminating between nonspecificity and noncausality. , 1987, Psychological bulletin.

[31]  L. Bickman.  Using program theory in evaluation , 1987 .

[32]  J F McLachlan,et al.  Therapy Strategies, Personality Orientation and Recovery from Alcoholism , 1974, Canadian Psychiatric Association journal.

[33]  K. Weick.  The social psychology of organizing , 1969 .