Lessons Learned about Evaluation in the United States and Some Possible Implications for Europe

This paper describes the main lessons learned about evaluation in the United States during the last 25 years and speculates about what some of their implications might be for the growing field of evaluation in Europe. We consider the organizational structure of the field, its political context, method preferences, |the use of multiple rather than single evaluative studies and ways to invigorate evaluation as a culture through avoiding certain kinds of method debates, through encouraging certain kinds of evaluation theory debates and through encouraging evaluators to think of themselves as substantive topic experts capable of generalizing from studies about what seems to work in a given substantive area.

[1]  R. Brook.  Evaluation and Auditing in State Legislatures: Meeting the Client's Needs , 1997 .

[2]  T. Cook,et al.  Qualitative and quantitative methods in evaluation research , 1981 .

[3]  W. Shadish.  Philosophy of science and the quantitative-qualitative debates: Thirteen common errors , 1995 .

[4]  Thomas A. Louis,et al.  Meta-Analysis for Explanation: A Casebook. , 1992 .

[5]  M. Patton,et al.  Qualitative evaluation methods , 1981 .

[6]  Robert E. Stake,et al.  Program Evaluation, Particularly Responsive Evaluation , 1983 .

[7]  James L. Heap.  Constructionism in the rhetoric and practice of fourth generation evaluation , 1995 .

[8]  Eleanor Chelimsky.  Comparing and Contrasting Auditing and Evaluation , 1985 .

[9]  David M. Fetterman,et al.  Empowerment Evaluation: An Introduction to Theory and Practice , 1996 .

[10]  Mark W. Lipsey,et al.  The efficacy of psychological, educational, and behavioral treatment. Confirmation from meta-analysis. , 1993, The American psychologist.

[11]  J. Kean.  The Impact of Head Start: An Evaluation of the Effects of Head Start on Children's Cognitive and Affective Development by Victor G. Cicirelli. , 1970 .

[12]  R. Blank.  It Takes a Nation , 1996 .

[13]  W. Dockrell,et al.  Rethinking educational research , 1980 .

[14]  L. Cronbach,et al.  Designing evaluations of educational and social programs , 1983 .

[15]  Richard A. Shweder,et al.  Metatheory in Social Science: Pluralisms and Subjectivities , 1987 .

[16]  Evert Vedung,et al.  Psychology in Program Evaluation , 1998 .

[17]  E. Guba,et al.  Fourth Generation Evaluation , 1989 .

[18]  Joy G. Dryfoos,et al.  Adolescents at Risk: Prevalence and Prevention , 1991 .

[19]  David B. Pillemer,et al.  Summing Up: The Science of Reviewing Research , 1984 .

[20]  T. Cook,et al.  The War On Fraud and Error in the Food Stamp Program , 1993 .

[21]  L. Schorr,et al.  Within Our Reach: Breaking the Cycle of Disadvantage , 1989 .

[22]  E. Guba,et al.  Effective Evaluation: Improving The Usefulness Of Evaluation Results Through Responsive And Naturalistic Approaches , 1981 .

[23]  R. L. Shotland,et al.  Social Science and Social Policy , 1985 .

[24]  L. Hedges,et al.  The Handbook of Research Synthesis , 1995 .

[25]  Milbrey W. McLaughlin,et al.  Evaluation and education : at quarter century , 1992 .

[26]  Peter Knoepfel,et al.  Einführung in die Politikevaluation , 1997 .

[27]  I. Ahlenius.  Auditing and Evaluation in Sweden , 1997 .

[28]  Lamar T. Empey,et al.  The effectiveness of correctional treatment : a survey of treatment evaluation studies , 1976 .

[29]  C. Pollitt,et al.  Performance Auditing: Travelers' Tales , 1997 .

[30]  Nick Tilley,et al.  An introduction to scientific realist evaluation , 1997 .

[31]  K. R. Hammond.  Human judgment and social policy , 1980 .

[32]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[33]  T. Cook,et al.  Evaluation Findings in Education and Social Work Textbooks , 1983 .

[34]  Eleanor Chelimsky.  The politics of program evaluation , 1987 .

[35]  Laurence E. Lynn,et al.  Inner-city poverty in the United States , 1990 .

[36]  William R. Shadish,et al.  Evaluation for the 21st century: A handbook. , 1997 .

[37]  Thomas D. Cook,et al.  A quasi-sampling theory of the generalization of causal relationships , 1993 .

[38]  L. Cronbach,et al.  Toward Reform of Program Evaluation , 1981 .

[39]  Thomas D. Cook,et al.  Post-positivist critical multiplism , 1985 .

[40]  David M. Fetterman,et al.  Empowerment evaluation : knowledge and tools for self-assessment & accountability , 1996 .

[41]  R. Light,et al.  Evaluation practice in review , 1987 .