A survey of impact evaluations of infrastructure projects, programs and policies

This paper surveys the main lessons from impact evaluations of infrastructure projects, programs and policies relevant to policymakers. In the process, however, it also reveals some major research gaps of relevance to academics. After a brief discussion of the motivation for the explosion of the demand for impact evaluations, it starts with some sometimes underestimated lessons for infrastructure specialists from theoretical experiment. The main focus of the paper is, however, the impact evaluations derived from experimental and quasi-experimental techniques. It covers energy, water and sanitation as well as the various transport subsectors (ports, railways, rural roads and highways). The main value added of the survey may be to show that despite the relatively modest number of published evaluations concluded in infrastructure as compared to health or education for instance, there is a growing coverage of the sector in evaluation efforts. The survey also offers an opportunity to get a sense of the creativity of researchers conducting these evaluations. It summarizes the main questions asked, the main techniques used and when available the results available. It concludes with a discussion of some of the limitations of evaluations in the context of infrastructure interventions.

[1]  Nancy Qian,et al.  On the Road: Access to Transportation Infrastructure and Economic Growth in China , 2012, Journal of Development Economics.

[2]  Taryn Dinkelman The Effects of Rural Electrification on Employment: New Evidence from South Africa , 2011 .

[3]  Teresa García-Milá,et al.  THE IMPACT OF NEW HIGHWAYS ON BUSINESS LOCATION: NEW EVIDENCE FROM SPAIN * , 2011 .

[4]  W. Polasek,et al.  Aggregate and Regional Economic Effects of New Railway Infrastructure , 2010, Review of Economic Analysis.

[5]  Simeon Djankov,et al.  An Empirical Study of Corruption in Ports , 2010 .

[6]  James J Heckman,et al.  Comparing IV with Structural Models: What Simple IV Can and Cannot Identify , 2009, Journal of econometrics.

[7]  J. Kmenta Mostly Harmless Econometrics: An Empiricist's Companion , 2010 .

[8]  A. Hillman,et al.  Public Finance and Public Policy , 2003 .

[9]  S. Lall,et al.  Explaining High Transport Costs within Malawi - Bad Roads or Lack of Trucking Competition? , 2009 .

[10]  Dean S. Karlan,et al.  Cairo Evaluation Clinic: Thoughts on Randomized Trials for Evaluation of Development , 2009 .

[11]  G. Imbens,et al.  Better Late than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009) , 2009 .

[12]  Gabriel M. Ahlfeldt The train has left the station : Do markets value intra-city access to inter-city rail connections ? , 2013 .

[13]  Dominique van de Walle,et al.  Impact evaluation of rural road projects , 2009 .

[14]  B. Fjeldsoe,et al.  Behavior change interventions delivered by mobile telephone short-message service. , 2009, American journal of preventive medicine.

[15]  Seiro Ito,et al.  Learning to Evaluate the Impact of Aid , 2009 .

[16]  A. Deaton Instruments of Development: Randomization in the Tropics, and the Search for the Elusive Keys to Economic Development , 2009 .

[17]  Shahidur R. Khandker,et al.  The Poverty Impact of Rural Roads: Evidence from Bangladesh , 2006, Economic Development and Cultural Change.

[18]  S. Sequeira On the waterfront: An empirical study of corruption in ports , 2009 .

[19]  Joshua D. Angrist,et al.  Mostly Harmless Econometrics: An Empiricist's Companion , 2008 .

[20]  Dani Rodrik,et al.  The New Development Economics: We Shall Experiment, but How Shall We Learn? , 2008 .

[21]  E. Somanathan,et al.  The importance of being informed: Experimental evidence on demand for environmental quality , 2008 .

[22]  Robert S. Chase,et al.  Do Community-Driven Development Projects Enhance Social Capital? Evidence from the Philippines , 2008 .

[23]  M. Torero,et al.  Access to Telephone Services and Household Income in Poor Rural Areas Using a Quasi-Natural Experiment for Peru , 2008 .

[24]  Guy Michaels,et al.  The Effect of Trade on the Demand for Skill: Evidence from the Interstate Highway System , 2006, The Review of Economics and Statistics.

[25]  G. Montalvo,et al.  Do new highways attract businesses?: A new microeconometric methodology , 2008 .

[26]  B. Wee,et al.  Decision-making on mega-projects: Cost–benefit analysis, planning, and innovation , 2008 .

[27]  Laura O. Taylor,et al.  Altruism Spillovers: Are Behaviors in Context-Free Experiments Predictive of Altruism Toward a Naturally Occurring Public Good? , 2005 .

[28]  D. Donaldson Railroads and the Raj : Estimating the Economic Impact of Transportation Infrastructure , 2008 .

[29]  A. Pereira,et al.  Public infrastructure and regional asymmetries in Spain , 2007 .

[30]  Tamer Rabie,et al.  Interventions to improve water quality for preventing diarrhoea: systematic review and meta-analysis , 2007, BMJ : British Medical Journal.

[31]  The Impact of Electricity Sector Privatization on Public Health , 2007 .

[32]  J. Alm,et al.  Using Laboratory Experiments in Public Economics , 2007, National Tax Journal.

[33]  Ren Mu,et al.  Fungibility and the Flypaper Effect of Project Aid: Micro-Evidence for Vietnam , 2007 .

[34]  J. Alm,et al.  Using Laboratory Experimentsin Public Economics , 2007 .

[35]  Daniel O. Gilligan,et al.  The impact of roads and agricultural extension on consumption growth and poverty in fifteen Ethiopian villages , 2007 .

[36]  Michael Kremer,et al.  Spring Cleaning : Rural Water Impacts , Valuation , and Institutions * , 2009 .

[37]  Subhrendu K. Pattanayak,et al.  A guide to water and sanitation sector impact evaluations , 2006 .

[38]  Maximo Torero and Joachim von Braun,et al.  Information and Communication Technologies for Development and Poverty Reduction , 2006 .

[39]  M. Boarnet Conducting impact evaluations in urban transport , 2006 .

[40]  Robert M. Buckley,et al.  Housing Policy in Developing Countries: Conjectures and Refutations , 2005 .

[41]  Maureen L. Cropper,et al.  Urban Poverty and Transport: The Case of Mumbai , 2005 .

[42]  S. Fan,et al.  Rural and urban dynamics and poverty: Evidence from China and India , 2005 .

[43]  M. Ravallion Evaluating Anti-Poverty Programs , 2005 .

[44]  M. Torero,et al.  Measuring the Impact of Asset Complementarities: The case of rural Peru , 2005 .

[45]  S. Fan,et al.  Road Development, Economic Growth, and Poverty Reduction in China: , 2005 .

[46]  Matthew Taylor Electrifying Rural Guatemala: Central Policy and Rural Reality , 2005 .

[47]  J. Escobal The Role of Public Infrastructure in Market Development in Rural Peru , 2005 .

[48]  Sebastian Galiani,et al.  Water for Life: The Impact of the Privatization of Water Services on Child Mortality , 2004, Journal of Political Economy.

[49]  Yemtsov Ruslan,et al.  Evaluating the Impact of Infrastructure Rehabilitation Interventions on Household Welfare in Georgia , 2005 .

[50]  John M Colford,et al.  Water, sanitation, and hygiene interventions to reduce diarrhoea in less developed countries: a systematic review and meta-analysis. , 2005, The Lancet. Infectious diseases.

[51]  A. Mccord,et al.  The economy-wide impacts of the labour intensification of infrastructure expenditure in South Africa , 2004 .

[52]  Scott Wallsten,et al.  Has Private Participation in Water and Sewerage Improved Coverage? Empirical Evidence from Latin America , 2004 .

[53]  John F. McDonald,et al.  Reaction of House Prices to a New Rapid Transit Line: Chicago's Midway Line, 1983–1999 , 2004 .

[54]  Geoffrey J. D. Hewings,et al.  An Application of an Integrated Transport Network– Multiregional CGE Model: a Framework for the Economic Analysis of Highway Projects , 2004 .

[55]  Adelheid Holl,et al.  Manufacturing location and impacts of road transport infrastructure: empirical evidence from Spain , 2004 .

[56]  V. Rao,et al.  Community Based (and Driven) Development: A Critical Review , 2004 .

[57]  Stephen W. Gundry,et al.  Household drinking water in developing countries: a systematic review of microbiological contamination between source and point‐of‐use , 2004, Tropical medicine & international health : TM & IH.

[58]  S. Machin,et al.  Valuing rail access using transport innovations , 2004 .

[59]  Laura B. Rawlings,et al.  Evaluating Social Funds: A Cross-Country Analysis of Community Investments , 2003 .

[60]  A. Balisacan,et al.  Revisiting growth and poverty reduction in Indonesia: what do subnational data show? , 2003 .

[61]  S. Rozelle,et al.  Poverty and Access to Roads in Papua New Guinea* , 2003, Economic Development and Cultural Change.

[62]  Evaluating the Impact of Infrastructure Rehabilitation Projects on Household Welfare in Rural Georgia , 2003 .

[63]  Felix K. Rioja Filling potholes: macroeconomic effects of maintenance versus new investments in public infrastructure , 2003 .

[64]  Felix K. Rioja The Penalties of Inefficient Infrastructure , 2003 .

[65]  J. Escobal,et al.  The benefits of rural roads: enhancing income opportunities for the rural poor , 2002 .

[66]  Dominique van de Walle,et al.  Impact evaluation of a rural road rehabilitation project , 2002 .

[67]  J. Escobal,et al.  The benefits of rural roads , 2002 .

[68]  Arsenio M. Balisacan,et al.  (DP 2001-11) Probing Beneath Cross-National Averages: Poverty, Inequality, and Growth in the Philippines , 2001 .

[69]  L. Röller,et al.  Telecommunications Infrastructure and Economic Development: a Simultaneous Approach Forschungsschwerpunkt Marktprozeß Und Unter- Nehmensentwicklung Research Area Market Processes and Corporate Development Abstract Telecommunications Infrastructure and Economic Development: a Simultaneous Approach * , 1996 .

[70]  V. Foster,et al.  Accounting for Poverty in Infrastructure Reform: Learning from Latin America's Experience. WBI Development Studies. , 2001 .

[71]  M. Ravallion,et al.  Estimating the Benefit Incidence of an Antipoverty Program by Propensity-Score Matching , 2003 .

[72]  Matthew E. Kahn,et al.  The effects of new public projects to expand urban rail transit , 2000 .

[73]  Amitabh Chandra,et al.  Does Public Infrastructure Affect Economic Activity?: Evidence from the Rural Interstate Highway System , 2000 .

[74]  Martin Ravallion,et al.  Does Piped Water Reduce Diarrhea for Children in Rural India? , 1999 .

[75]  Felix K. Rioja Productiveness and welfare implications of public infrastructure: a dynamic two-sector general equilibrium analysis , 1999 .

[76]  Ken R. Smith Indoor Air Pollution , 1999 .

[77]  Hanan G. Jacoby,et al.  Access to Markets and the Benefits of Rural Roads , 1998 .

[78]  Steven J. Davis,et al.  The Quarterly Journal of Economics.@@@Giornale degli Economisti. , 1886 .

[79]  John F. McDonald,et al.  The effect of anticipated transportation improvement on residential land values , 1995 .

[80]  Andrew M. Isserman,et al.  NEW HIGHWAYS AS ECONOMIC DEVELOPMENT TOOLS: AN EVALUATION USING QUASI-EXPERIMENTAL MATCHING METHODS , 1994 .

[81]  Mark R. Rosenzweig,et al.  How infrastructure and financial institutions affect agricultural output and investment in India , 1989 .

[82]  S. Esrey,et al.  Epidemiologic evidence for health benefits from improved water and sanitation in developing countries. , 1986, Epidemiologic reviews.

[83]  M. Hewitt E. Bamberger,et al.  Monitoring and evaluating urban development programs : a handbook for program managers and researchers , 1985 .

[84]  S. Esrey,et al.  Interventions for the control of diarrhoeal diseases among young children: improving water supplies and excreta disposal facilities. , 1985, Bulletin of the World Health Organization.

[85]  B Hileman,et al.  Indoor air pollution. , 2018, Environmental science & technology.

[86]  V. Bajic,et al.  The Effects of a New Subway Line on Housing Prices in Metropolitan Toronto , 1983 .

[87]  Donald N. Dewees,et al.  The effect of a subway on residential property values in Toronto , 1976 .

[88]  Alice M. Rivlin,et al.  How Can Experiments Be More Useful , 1974 .

[89]  Jensen,et al.  paper-work in progress Title : General equilibrium impact evaluation of road sector investment projects in Ghana * , 2022 .