Putting Program Theory into Operation

The emphasis on understanding how a program works and what makes a program work led to the development of the theory-driven approach to program evaluation. Theory plays a major role in guiding a program design and evaluation. The theory defines the presenting problem and the target population for whom the program is designed, specifies the causal processes underlying the program effects, and identifies its expected outcomes as well as factors that affect treatment processes. In this article, a conceptual framework is presented as a tool for putting the program theory into operation. The framework incorporates variables that reflect theoretical concepts and implementation issues addressed in program evaluation. The framework organizes the variables into three categories: input, process, and output, and proposes direct and indirect relationships among them. Implications of the framework for program evaluation are discussed.

[1]  Mark W. Lipsey,et al.  Theory as method: Small theories of treatments , 1993 .

[2]  William M. K. Trochim,et al.  Pattern Matching, Validity, and Conceptualization in Program Evaluation , 1985 .

[3]  T. E. Dinero,et al.  Assessing Early Intervention Outcomes: Beyond Program Variables , 1991 .

[4]  L. Bickman.  Using program theory in evaluation , 1987 .

[5]  R. Moos,et al.  Environmental assessment and evaluation research: examples from mental health and substance abuse programs. , 1984, Evaluation and program planning.

[6]  L. Sechrest,et al.  Strength of theory and theory of strength , 1989 .

[7]  R. McCorkle,et al.  Quality of life issues in patients with disseminated breast cancer , 1990, Cancer.

[8]  Daniel L. Stufflebeam,et al.  A depth study of the evaluation requirement , 1966 .

[9]  L. Delbeke.  Quasi-experimentation - design and analysis issues for field settings - cook,td, campbell,dt , 1980 .

[10]  Thomas D. Cook,et al.  A quasi-sampling theory of the generalization of causal relationships , 1993 .

[11]  Daniel L. Stufflebeam,et al.  The Use of Experimental Design in Educational Evaluation. , 1971 .

[12]  Herbert C. Quay,et al.  The Three Faces of Evaluation , 1977 .

[13]  L. Sechrest,et al.  Critical dimensions in the choice and maintenance of successful treatments: strength, integrity, and effectiveness. , 1981, Journal of consulting and clinical psychology.

[14]  William J. Reid,et al.  Measuring implementation of social treatment , 1988 .

[15]  Angus Campbell.  the Sense of well-being in America: Recent patterns and trends , 1982 .

[16]  L. Beutler.  Have all won and must all have prizes? Revisiting Luborsky et al.'s verdict. , 1991, Journal of consulting and clinical psychology.

[17]  Lynn Lyons Morris,et al.  Theory-based evaluation☆ , 1996 .

[18]  Herbert L. Costner,et al.  The validity of conclusions in evaluation research: A further development of Chen and Rossi's theory-driven approach , 1989 .

[19]  Eva Lantos Rezmovic.  Assessing Treatment Implementation Amid the Slings and Arrows of Reality , 1984 .

[20]  R. Sanson-Fisher,et al.  Measuring quality of life in cancer patients. , 1989, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[21]  Huey-tsyh Chen.  Theory-driven evaluations , 1990 .

[22]  C. Achilles,et al.  Evaluation: A Systematic Approach , 1980 .

[23]  Daniel S. Stufflebeam.  The use and abuse of evaluation in title III , 1967 .

[24]  Huey-Tsyh Chen,et al.  Current Trends and Future Directions in Program Evaluation , 1994 .

[25]  W. Shadish,et al.  Foundations of Program Evaluation: Theories of Practice , 1990 .

[26]  A. Reynolds.  Confirmatory Program Evaluation: A Method for Strengthening Causal Inference , 1998 .

[27]  Rudolf H. Moos,et al.  Theory and method in treatment evaluation , 1989 .

[28]  Daniel L. Stufflebeam,et al.  Systematic Evaluation: A Self-Instructional Guide to Theory and Practice , 1984 .

[29]  E. Suchman.  Evaluative Research: Principles and Practice in Public Service and Social Action Progr , 1968 .

[30]  Carol H. Weiss.  Evaluation Research: Methods of Assessing Program Effectiveness , 1972 .