Towards a conceptual structure for evaluating policy analytic activities

Abstract Relatively little research has been done on the topic of evaluating policy analytic activities. This paper presents the results of a survey of publications from the field of policy analysis and some related fields. It appeared that a large variety exists regarding evaluation concepts and criteria. Although the establishment of a single set of generally applicable criteria is not feasible, a conceptual structure for identifying and categorizing criteria to evaluate policy analytic activities is proposed in this paper. The elaborated structure and constructed list of criteria provides a basis, from which researchers can, in individual cases, make a selection depending on the context and objectives of their research. The list of criteria provides a helping hand to evaluate and, in the end, improve policy analytic activities.

[1]  William N. Dunn,et al.  Public Policy Analysis: An Introduction , 1993 .

[2]  A. Hoogerwerf.  Het ontwerpen van beleid. Een handleiding voor de praktijk en resultaten van onderzoek , 1992 .

[3]  J. Mingers,et al.  Rational analysis for a problematic world revisited : problem structuring methods for complexity, uncertainty and conflict , 1989 .

[4]  A. Pinsonneault,et al.  The effects of electronic meetings on group processes and outcomes: An assessment of the empirical research , 1990 .

[5]  Joop Koppenjan,et al.  Managing Complex Networks: Strategies for the Public Sector , 1997 .

[6]  Kenneth Hanf,et al.  Interorganizational policy making : limits to coordination and central control , 1981 .

[7]  C. Achilles,et al.  Evaluation: A Systematic Approach , 1980 .

[8]  M. Patton.  Utilization-focused evaluation: The new century text , 1997 .

[9]  Peter Checkland,et al.  Systems Thinking, Systems Practice , 1981 .

[10]  Jacques Geurts,et al.  The science/public-policy dialogue on long-term environmental planning , 1994 .

[11]  F. Scharpf,et al.  Policy Effectiveness and Conflict Avoidance in Intergovernmental Policy Formation , 1978 .

[12]  Anthony D. Andre,et al.  A User's Perspective , 2007, Libr. Trends.

[13]  J. D. Ryan.  Handbook of Systems Analysis — Craft Issues and Procedural Choices , 1988 .

[14]  Frank Fischer,et al.  The Argumentative Turn in Policy Analysis and Planning , 1993 .

[15]  Colin Eden,et al.  On evaluating the performance of 'wide-band' GDSS's , 1995 .

[16]  Anne L. Schneider,et al.  Policy analysis by design , 1987 .

[17]  John S. Dryzek,et al.  Policy Analysis and Planning: From Science to Argument , 2002, The Argumentative Turn in Policy Analysis and Planning.

[18]  E.,et al.  GROUPS : INTERACTION AND PERFORMANCE , 2001 .

[19]  Patricia G. J. Twaalfhoven,et al.  The succes of policy analysis studies: An actor perspective , 1999 .

[20]  C. Eden,et al.  “Horses for courses”: A stakeholder approach to the evaluation of GDSSs , 1996 .

[21]  K. Termeer,et al.  MANAGING NETWORKS IN THE PUBLIC SECTOR: A THEORETICAL STUDY OF MANAGEMENT STRATEGIES IN POLICY NETWORKS , 1995 .

[22]  Vlatko Čerić,et al.  Rational Analysis for a Problematic World: Problem Structuring Methods for Complexity, Uncertainty and Conflict , 1991 .

[23]  George P. Richardson,et al.  Group model building: adding more science to the craft , 1997 .

[24]  Netherlands. Commissie Lange Termijn Milieubeleid.  The environment : towards a sustainable future , 1994 .

[25]  M. C. Reed.  Utilization-focused Evaluation: The New Century Text (3rd ed.) , 1999 .

[26]  Michael Quinn Patton,et al.  Utilization-focused evaluation: The new century text (3rd ed.). , 1997 .

[27]  Mark D. Uncles,et al.  Handbook of Systems Analysis: Overview of Uses, Procedures, Applications and Practice , 1986 .

[28]  Patton Sawicki Clark,et al.  Basic methods of policy analysis and planning , 1986 .

[29]  C. D. Beaumont.  Pitfalls of Analysis , 1981 .

[30]  Igor S. Mayer,et al.  Debating technologies. A methodological contribution to the design and evaluation of participatory policy analysis , 1997 .

[31]  Aaron Wildavsky,et al.  Speaking Truth to Power: The Art and Craft of Policy Analysis , 1979 .

[32]  S. Jasanoff,et al.  The Fifth Branch: Science Advisers as Policymakers. , 1991 .