Toward a plurality of methods in project evaluation: a contextualised approach to understanding impact trajectories and efficacy

Understanding the efficacy of development projects requires not only a plausible counterfactual but also an appropriate match between the shape of impact trajectory over time and the deployment of a corresponding array of research tools capable of empirically discerning such a trajectory. At present, however, the development community knows very little, other than by implicit assumption, about the expected shape of the impact trajectory from any given sector or project type, and as such is prone to routinely making attribution errors. Randomisation per se does not solve this problem. The sources and manifestations of these problems are considered, along with some constructive suggestions for responding to them.

[1]  W. Easterly,et al.  The White Man's Burden: Why the West's Efforts to Aid the Rest Have Done So Much Ill and So Little Good , 2006 .

[2]  Jesko Hentschel,et al.  Contextuality and data collection methods: A framework and application to health service utilisation , 1999 .

[3]  D. Mccloskey,et al.  The Cult of Statistical Significance: How the Standard Error Costs Us Jobs, Justice, and Lives , 2008 .

[4]  Henry Mintzberg,et al.  Managers Not MBAs: A Hard Look at the Soft Practice of Managing and Management Development , 2004 .

[5]  Dominique P. van de Walle,et al.  Rural Roads and Poor Area Development in Vietnam , 2007 .

[6]  Martin Ravallion,et al.  Should the Randomistas Rule? , 2009 .

[7]  Michael Chung Kimberly Spal Bamberger,et al.  Integrating Quantitative and Qualitative Research in Development Projects , 2000 .

[8]  V. Rao,et al.  Integrating Qualitative and Quantitative Approaches in Program Evaluation , 2003 .

[9]  Roger C. Riddell,et al.  Does Foreign Aid Really Work , 2007 .

[10]  J. Levinton,et al.  Punctuated equilibrium. , 1986, Science.

[11]  Martin Crawford,et al.  Moral Capital: Foundations of British Abolitionism , 2006 .

[12]  J. Behrman,et al.  Timing and Duration of Exposure in Evaluations of Social Programs , 2008 .

[13]  Vijayendra Rao,et al.  The Social Impact of Social Funds in Jamaica: A Mixed-Methods Analysis of Participation, Targeting, and Collective Action in Community-Driven Development , 2003 .

[14]  Robert A. Moffitt,et al.  Forecasting the Effects of Scaling Up Social Programs : An Economics Perspective , 2004 .

[15]  Michael Woolcock,et al.  How and Why Does History Matter for Development Policy? , 2010 .

[16]  Lant Pritchett,et al.  It pays to be ignorant: A simple political economy of rigorous program evaluation , 2002 .

[17]  A. Banerjee,et al.  Making Aid Work , 2007 .

[18]  Jaak Rakfeldt,et al.  Inventing Human Rights: A History , 2008 .

[19]  Vijayendra Rao,et al.  The Social Impact of Social Funds in Jamaica: A ‘Participatory Econometric’ Analysis of Targeting, Collective Action, and Participation in Community-Driven Development , 2005 .

[20]  R. Heifetz,et al.  Leadership Without Easy Answers , 2006 .

[21]  William R. Easterly.  How the Millennium Development Goals are Unfair to Africa , 2007 .

[22]  P. Engelhard.  [An end to poverty]]. , 1994, Vivre autrement.

[23]  Elizabeth Levy Paluck,et al.  The Promising Integration of Qualitative Methods and Field Experiments , 2010 .

[24]  Lant Pritchett,et al.  Solutions When the Solution is the Problem: Arraying the Disarray in Development , 2002 .

[25]  M. Ravallion,et al.  Decentralized targeting of an antipoverty program , 2005 .

[26]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[27]  Michael A. Clemens.  The Long Walk to School: International Education Goals in Historical Perspective , 2004 .

[28]  Sanjeev Sridharan,et al.  Ten steps to making evaluation matter. , 2011, Evaluation and program planning.

[29]  H. White,et al.  Combining Quantitative and Qualitative Approaches in Poverty Analysis , 2002 .

[30]  Michael A. Clemens,et al.  When does rigorous impact evaluation make a difference? The case of the Millennium Villages , 2010 .

[31]  J. Harriss,et al.  The Search for Empowerment: Social Capital as Idea and Practice at the World Bank , 2007 .

[32]  Michael Woolcock,et al.  Empowerment, Deliberative Development, and Local-Level Politics in Indonesia: Participatory Projects as a Source of Countervailing Power , 2008 .

[33]  Michael Woolcock,et al.  Governance in the Gullies: Democratic Responsiveness and Leadership in Delhi's Slums , 2005 .

[34]  M. Sobel,et al.  Identification Problems in the Social Sciences. , 1996 .

[35]  T. Dichter,et al.  Despite Good Intentions: Why Development Assistance to the Third World Has Failed , 2003 .

[36]  K. Weick.  FROM SENSEMAKING IN ORGANIZATIONS , 2021, The New Economic Sociology.

[37]  Helmut Lütkepohl,et al.  Impulse Response Function , 2010 .

[38]  C. Achilles,et al.  Evaluation: A Systematic Approach , 1980 .

[39]  Jeffrey D. Sachs,et al.  The End of Poverty , 2005 .

[40]  V. Rao,et al.  Community Based (and Driven) Development: A Critical Review , 2004 .