The Practice and the Theory

Theory-based evaluation approaches are becoming increasingly popular in the evaluation of comprehensive community initiatives. Such an approach, Theory of Change (ToC), has been used in the external evaluations of two of four Scottish Health Demonstration projects. This article provides an empirically based analysis of the issues raised in the process of articulating a project’s ToC. It then considers the value of the approach in relation to sharpening planning, providing formative feedback, improving performance management, guiding internal and external evaluation, judging impact and reducing problems of attribution. A conclusion is reached that, whilst such approaches are by no means a panacea, they offer one useful framework within which to negotiate a range of evaluation practice decisions.

[1]  Stewart I. Donaldson,et al.  Theory-driven Evaluation in Action: Lessons from a $20 Million Statewide Work and Health Initiative , 2003 .

[2]  Beth C. Weitzman,et al.  Integrating a Comparison Group Design into a Theory of Change Evaluation: The Case of the Urban Health Initiative: , 2002 .

[3]  Marian Barnes,et al.  Evidence, Understanding and Complexity , 2003 .

[4]  Robert Walker,et al.  Great Expectations: Can Social Science Evaluate New Labour's Policies? , 2001 .

[5]  E. Ziegel,et al.  The Balanced Scorecard , 1998 .

[6]  Erica Wimbush,et al.  An Evaluation Framework for Health Promotion: Theory, Quality and Effectiveness , 2000 .

[7]  K. Connell,et al.  New approaches to evaluating community initiatives: Theory, measurement, and analysis , 1998 .

[8]  James P. Connell and Anne C. Kubisch.  Applying a Theory of Change Approach to the Evaluation of Comprehensive Community Initiatives: Progress, Prospects, and Problems , 1998 .

[9]  K. Wardrop.  A framework for health promotion ... a framework for AIDS. , 1993, Canadian journal of public health = Revue canadienne de sante publique.

[10]  M. Susser.  The tribulations of trials--intervention in communities. , 1995, American journal of public health.

[11]  Advancing the Development and Application of Theory-based Evaluation in the Practice of Public Health , 1999 .

[12]  I. Sanderson,et al.  Evaluation in Complex Policy Systems , 2000 .

[13]  E. Ziegel,et al.  Balanced Scorecard , 2019, Encyclopedia of Public Administration and Public Policy, Third Edition.

[14]  Marian Barnes,et al.  Building Collaborative Capacity through `Theories of Change' , 2002 .

[15]  J. Kampert,et al.  Comparison of lifestyle and structured interventions to increase physical activity and cardiorespiratory fitness: a randomized trial. , 1999, JAMA.

[16]  Janet Lewis,et al.  Reflections on Evaluation in Practice , 2001 .