Toward a plurality of methods in project evaluation: a contextualised approach to understanding impact trajectories and efficacy

Understanding the efficacy of development projects requires not only a plausible counterfactual but also an appropriate match between the shape of impact trajectory over time and the deployment of a corresponding array of research tools capable of empirically discerning such a trajectory. At present, however, the development community knows very little, other than by implicit assumption, about the expected shape of the impact trajectory from any given sector or project type, and as such is prone to routinely making attribution errors. Randomisation per se does not solve this problem. The sources and manifestations of these problems are considered, along with some constructive suggestions for responding to them.

[1]  K. Weick.  FROM SENSEMAKING IN ORGANIZATIONS , 2021, The New Economic Sociology.

[2]  Sanjeev Sridharan,et al.  Ten steps to making evaluation matter. , 2011, Evaluation and program planning.

[3]  Michael A. Clemens,et al.  When does rigorous impact evaluation make a difference? The case of the Millennium Villages , 2010 .

[4]  Michael Woolcock,et al.  How and Why Does History Matter for Development Policy? , 2010 .

[5]  L. Fondation.  Punctuated Equilibrium , 2010 .

[6]  Elizabeth Levy Paluck,et al.  The Promising Integration of Qualitative Methods and Field Experiments , 2010 .

[7]  Martin Ravallion,et al.  Should the Randomistas Rule? , 2009 .

[8]  J. Behrman,et al.  Timing and Duration of Exposure in Evaluations of Social Programs , 2008 .

[9]  Michael Woolcock,et al.  Empowerment, Deliberative Development, and Local-Level Politics in Indonesia: Participatory Projects as a Source of Countervailing Power , 2008 .

[10]  S. Ziliak,et al.  The Cult of Statistical Significance: How the Standard Error Costs Us Jobs, Justice, and Lives , 2008 .

[11]  Jaak Rakfeldt,et al.  Inventing Human Rights: A History , 2008 .

[12]  K. Järvelin.  Evaluation , 2008, Interactive Information Seeking, Behaviour and Retrieval.

[13]  William R. Easterly.  How the Millennium Development Goals are Unfair to Africa , 2007 .

[14]  Dominique P. van de Walle,et al.  Rural Roads and Poor Area Development in Vietnam , 2007 .

[15]  J. Oldfield.  Moral Capital: Foundations of British Abolitionism , 2007 .

[16]  Jeffrey D. Sachs,et al.  The End of Poverty , 2005 .

[17]  Michael Woolcock,et al.  Governance in the Gullies: Democratic Responsiveness and Leadership in Delhi's Slums , 2005 .

[18]  Vijayendra Rao,et al.  The Social Impact of Social Funds in Jamaica: A ‘Participatory Econometric’ Analysis of Targeting, Collective Action, and Participation in Community-Driven Development , 2005 .

[19]  M. Ravallion,et al.  Decentralized targeting of an antipoverty program , 2005 .

[20]  Michael A. Clemens.  The Long Walk to School: International Education Goals in Historical Perspective , 2004 .

[21]  F. Bourguignon.  The impact of economic policies on poverty and income distribution : evaluation techniques and tools , 2003 .

[22]  Vijayendra Rao,et al.  The Social Impact of Social Funds in Jamaica: A Mixed-Methods Analysis of Participation, Targeting, and Collective Action in Community-Driven Development , 2003 .

[23]  T. Dichter,et al.  Despite Good Intentions: Why Development Assistance to the Third World Has Failed , 2003 .

[24]  Lant Pritchett,et al.  It pays to be ignorant: A simple political economy of rigorous program evaluation , 2002 .

[25]  Lant Pritchett,et al.  Solutions When the Solution is the Problem: Arraying the Disarray in Development , 2002 .

[26]  H. White,et al.  Combining Quantitative and Qualitative Approaches in Poverty Analysis , 2002 .

[27]  Michael Chung Kimberly Spal Bamberger,et al.  Integrating Quantitative and Qualitative Research in Development Projects , 2000 .

[28]  Jesko Hentschel,et al.  Contextuality and data collection methods: A framework and application to health service utilisation , 1999 .

[29]  M. Sobel,et al.  Identification Problems in the Social Sciences , 1996 .

[30]  C. Achilles,et al.  Evaluation: A Systematic Approach , 1980 .

[31]  D. Shapere.  The Structure of Scientific Revolutions , 1964 .

[32]  Helmut Lütkepohl,et al.  Impulse Response Function , 2010 .

[33]  Steve Ziliak.  The Cult of Statistical Significance : How the Standard Error Costs , 2008 .

[34]  A. Banerjee,et al.  Making Aid Work , 2007 .

[35]  Roger C. Riddell,et al.  Does Foreign Aid Really Work , 2007 .

[36]  W. Easterly,et al.  The White Man's Burden: Why the West's Efforts to Aid the Rest Have Done So Much Ill and So Little Good , 2006 .

[37]  R. Heifetz,et al.  Leadership Without Easy Answers , 2006 .

[38]  V. Rao,et al.  Community Based (and Driven) Development: A Critical Review , 2004 .

[39]  Robert A. Moffitt,et al.  Forecasting the Effects of Scaling Up Social Programs : An Economics Perspective , 2004 .

[40]  Henry Mintzberg,et al.  Managers Not MBAs: A Hard Look at the Soft Practice of Managing and Management Development , 2004 .

[41]  V. Rao,et al.  Integrating Qualitative and Quantitative Approaches in Program Evaluation , 2003 .