Matching impact evaluation design to the nature of the intervention and the purpose of the evaluation

Appropriate impact evaluation design requires situational responsiveness – matching the design to the needs, constraints, and opportunities of the particular case. The design needs to reflect the nature of the intervention and the purposes of the impact evaluation. In particular, impact evaluation needs to address simple, complicated, and complex aspects of the intervention. Simple aspects can be tightly specified and standardised; complicated aspects work as part of a causal package; complex aspects are appropriately dynamic and adaptive. Different designs are recommended for each case, including RCT, regression discontinuity, unstructured community interviews, Participatory Performance Story Reporting, and developmental evaluation.

[1]  Sarah J. Howie,et al.  The gap between advantaged and disadvantaged students in science achievement in South African secondary schools , 2008 .

[2]  Fabio Veras Soares,et al.  Achievements and Shortfalls of Conditional Cash Transfers: Impact Evaluation of Paraguay?s Tekoporã Programme , 2008 .

[3]  Robert Chambers So that the poor count more: using participatory methods for impact evaluation , 2009 .

[4]  Frans L. Leeuw,et al.  Impact evaluations and development : NONIE guidance on impact evaluation , 2009 .

[5]  Cynthia F. Kurtz,et al.  The new dynamics of strategy: sense-making in a complex and complicated world , 2003, IEEE Engineering Management Review.

[6]  Daniela C. Schröter Evaluation: The International Journal of Theory, Research and Practice , 2007 .

[7]  Lynn Westbrook,et al.  Utilization-focused evaluation , 1998 .

[8]  Anton Hart Getting to Maybe: How the World Is Changed , 2008 .

[9]  Susan J. Nichols,et al.  Multiple Lines and Levels of Evidence for Detecting Ecological Responses to Management Intervention , 2005 .

[10]  D. Faith,et al.  Monitoring Ecological Impacts: Concepts and Practice in Flowing Waters , 2002 .

[11]  A. B. Hill The Environment and Disease: Association or Causation? , 1965, Proceedings of the Royal Society of Medicine.

[12]  Martin Ravallion,et al.  Evaluating three stylised interventions , 2009 .

[13]  Irene Guijt,et al.  Seeking surprise : rethinking monitoring for collective learning in rural resource management , 2008 .

[14]  Carol H. Weiss Evaluation : methods for studying programs and policies , 1997 .

[15]  S. Glouberman Complicated and Complex Systems: What Would Successful Reform of Medicare Look Like? , 2002 .