Teaching People to Fish? Building the Evaluation Capability of Public Sector Organizations

In response to an increasing demand for public sector accountability, many government agencies have sought to develop their internal evaluation capabilities. Often these efforts have focused on increasing the capacity to supply credible evaluations, yet addressing demand is just as important. This article focuses on a government agency and tracks its five-year journey towards developing such a capability. It documents contextual matters, drivers for change, the actions taken by the agency, and its response to emergent challenges during four phases. Based on feedback from project staff and managers and those involved in the capability development project, it offers seven recommendations. These are: start small and grow evaluation; address both supply and demand; work top-down and bottom-up simultaneously; use a theory of change behaviour; develop a common evaluation framework, including a generic programme theory; build knowledge of what works within the agency's context; and systematically and visibly evaluate each stage.

[1]  Melvin M. Mark,et al.  Evaluation: An Integrated Framework for Understanding, Guiding, and Improving Policies and Programs , 2000 .

[2]  Frans L. Leeuw,et al.  Evaluation Activities in Europe: A Quick Scan of the Market in 1998 , 1999 .

[3]  David M. Fetterman,et al.  Empowerment evaluation : knowledge and tools for self-assessment & accountability , 1996 .

[4]  Michael Scriven.  Empowerment Evaluation Examined , 1997 .

[5]  Hallie Preskill,et al.  Building Capacity for Organizational Learning Through Evaluative Inquiry , 1999 .

[6]  Scott F. Wetterhall,et al.  Building capacity for program evaluation at the Centers for Disease Control and Prevention , 2002 .

[7]  Lauge Baungaard Rasmussen,et al.  Learning cultures , 1998, AI & SOCIETY.

[8]  I. Davies,et al.  Evaluation and Performance Management in Government , 1999 .

[9]  David M. Fetterman,et al.  Empowerment Evaluation: An Introduction to Theory and Practice , 1996 .

[10]  Lynn Westbrook,et al.  Utilization-focused evaluation , 1998 .

[11]  G. Southworth,et al.  Overview and conclusions , 2003 .

[12]  Darlene Russ-Eft,et al.  Building evaluation capacity , 2004 .

[13]  K. Nair,et al.  Natural Resources and Environment , 2004 .

[14]  Carol H. Weiss.  Evaluation : methods for studying programs and policies , 1997 .

[15]  Leonard Bickman,et al.  Advances in program theory , 1990 .

[16]  Melvin M. Mark,et al.  Review: Promoting Realism in Evaluation , 1998 .

[17]  Keith Mackay,et al.  Public Sector Performance: The Critical Role of Evaluation , 1998 .