Evaluation Use: Theory, Research, and Practice since 1986

As part of a larger effort by members of the American Evaluation Association (AEA) Topical Interest Group on Evaluation Use (TIGEU), we undertook an extensive review and synthesis of literature in evaluation use published since 1986. We observe several recent developments in theory, research and practice arising from this literature. These developments include: the rise of considerations of context as critical to understanding and explaining use; identification of process use as a significant consequence of evaluation activity; expansion of conceptions of use from the individual to the organization level; and diversification of the role of the evaluator to facilitator, planner and educator/trainer. In addition, understanding misutlilization has emerged as a significant focus for theory and to a limited extent, research. The article concludes with a summary of contemporary issues, particularly with regard to their implications for evaluation practice.

[1]  M. Patton.  Utilization-focused evaluation: The new century text , 1997 .

[2]  Sandra Mathison,et al.  Rethinking the evaluator role: Partnerships between organizations and evaluators , 1994 .

[3]  Michael Huberman,et al.  Evaluation utilization: Building links between action and reflection , 1990 .

[4]  If program decisions hinged only on information: A response to patton , 1988 .

[5]  Carol H. Weiss,et al.  Evaluation for Decisions: Is Anybody There? Does Anybody Care?. , 1988 .

[6]  John J. Donohue,et al.  Collaborative evaluation in North America: Evaluators' self-reported opinions, practices and consequences , 1996 .

[7]  David Nevo.  The Evaluation-Minded School: An Application of Perceptions from Program Evaluation. , 1993 .

[8]  C. Weiss.  Where Politics and Evaluation Research Meet , 1993 .

[9]  Can Evaluation Help an Organization to Learn? , 1994 .

[10]  C. Weiss.  Using social research in public policy making , 1979 .

[11]  M. Scriven.  Types of Evaluation and Types of Evaluator , 1996 .

[12]  J. King,et al.  Research on school use of program evaluation: A literature review and research agenda☆ , 1983 .

[13]  Use and abuse of internal evaluation , 1994 .

[14]  J. Greene.  Stakeholder Participation and Utilization in Program Evaluation , 1988 .

[15]  D. Palumbo.  The political roots of misuse of evaluation , 1994 .

[16]  E. House.  Principled evaluation: A critique of the AEA Guiding Principles , 1995 .

[17]  Hallie Preskill,et al.  Evaluation Strategies for Communicating and Reporting: Enhancing Learning in Organizations , 1996 .

[18]  J. Owen,et al.  Acquiring Knowledge of Implementation and Change , 1994 .

[19]  J. King.  Involving practitioners in evaluation studies: how viable is collaborative evaluation in schools? , 1993 .

[20]  Phyllis I. Vroom,et al.  Confronting ideology and self‐interest: Avoiding misuse of evaluation , 1994 .

[21]  M. Patton.  Six Honest Serving Men for Evaluation. , 1988 .

[22]  T. Champney.  Comments on the use of multiple roles to maximize the utilization of outcome research , 1993 .

[23]  N. L. Smith.  The Weiss-Patton Debate: Illumination of the Fundamental Concerns , 1989 .

[24]  Tonya R. Moon,et al.  Evaluation Utilization: A Review of the Literature with Implications for Gifted Education , 1993 .

[25]  John M. Owen,et al.  Roles for Evaluation in Learning Organizations , 1995 .

[26]  J. Bradley Cousins,et al.  Enhancing Knowledge Utilization as a Strategy for School Improvement , 1993 .

[27]  Jean A. King,et al.  Evaluation Utilization: A Literature Review and Research Agenda. , 1981 .

[28]  Michael Quinn Patton,et al.  The Evaluator's Responsibility for Utilization. , 1988 .

[29]  R. Eichelberger,et al.  The Utility of the Knowledge Use System in a Higher Education Evaluation Setting , 1993 .

[30]  Marvin C. Alkin,et al.  Thoughts on Evaluation Utilization, Misutilization and Non-Utilization. , 1988 .

[31]  K. Leithwood,et al.  Current Empirical Research on Evaluation Utilization , 1986 .

[32]  Jennifer Caroline Greene,et al.  Technical quality versus user responsiveness in evaluation practice , 1990 .

[33]  Michael Quinn Patton,et al.  In Search of Impact: An Analysis of the Utilization of Federal Health Evaluation Research. , 1975 .

[34]  Milbrey W. McLaughlin,et al.  Evaluation and education : at quarter century , 1992 .

[35]  Laura C. Leviton,et al.  Research On the Utilization of Evaluations , 1981 .

[36]  Thomas B. Timar.  Federal Education Policy and Practice: Building Organizational Capacity Through Chapter 1 , 1994 .

[37]  D. Wasylenki,et al.  Promoting the utilization of outcome study results by assuming multiple roles within an organization , 1993 .

[38]  Marvin C. Alkin.  A Guide for Evaluation Decision Makers , 1985 .

[39]  A Panel on Theory-driven Evaluation and Evaluation Theories , 1994 .

[40]  Patrick M. Jenlink.  Using evaluation to understand the learning architecture of an organization , 1994 .

[41]  David M. Fetterman,et al.  Empowerment evaluation : knowledge and tools for self-assessment & accountability , 1996 .

[42]  L. Earl,et al.  Participatory Evaluation In Education: Studies Of Evaluation Use And Organizational Learning , 1995 .

[43]  School Self-Evaluation as a Reflective Dialogue between Researchers and Practitioners. , 1993 .

[44]  J. M. Beyer,et al.  The Utilization Process: A Conceptual Framework and Synthesis of Empirical Findings. , 1982 .

[45]  Marvin C. Alkin,et al.  Organizing evaluations for use as a management tool , 1985 .

[46]  Lorna Earl,et al.  The Case for Participatory Evaluation , 1992 .

[47]  Tom Carney.  Fourth Generation Evaluation , 1991 .

[48]  Toby Diane Ayers,et al.  Stakeholders as partners in evaluation: A stakeholder-collaborative approach☆☆☆ , 1987 .

[49]  Evaluation's role in enhancing organizational learning: A model for practice , 1994 .

[50]  R. B. Johnson.  Models of Evaluation Utilization: A Meta-Modeling Synthesis of the Literature. , 1993 .

[51]  C. Weiss.  The many meanings of research utilization. , 1979 .

[52]  Bruce Thompson,et al.  The Revised Program Evaluation Standards and their Correlation with the Evaluation use Literature , 1994 .

[53]  Michael Quinn Patton,et al.  Debates on Evaluation , 1990 .

[54]  C. R. Cooper,et al.  A Guide to Evaluation. , 1973 .

[55]  H. Preskill.  The cultural lens: Bringing utilization into focus , 1991 .

[56]  J. Cousins,et al.  Consequences of researcher involvement in participatory evaluation , 1996 .

[57]  C. Mowbray.  The role of evaluation in the restructuring of the public mental health system , 1992 .

[58]  Michael Quinn Patton,et al.  Utilization-focused evaluation: The new century text (3rd ed.). , 1997 .

[59]  Trond Ålvik.  School-based evaluation: A close-up , 1995 .

[60]  William R. Shadish,et al.  Patterns of Program Evaluation Practice Among Members of the Evaluation Research Society and Evaluation Network , 1987 .