Evaluation of biodiversity policy instruments: what works and what doesn't?

We review and confirm the claim that credible evaluations of common conservation instruments continue to be rare. The limited set of rigorous studies suggests that protected areas cause modest reductions in deforestation; however, the evidence base for payments for ecosystem services, decentralization policies and other interventions is much weaker. Thus, we renew our urgent call for more evaluations from many more biodiversity-relevant locations. Specifically, we call for a programme of research— Conservation Evaluation 2.0 —that seeks to measure how programme impacts vary by socio-political and bio-physical context, to track economic and environmental impacts jointly, to identify spatial spillover effects to untargeted areas, and to use theories of change to characterize causal mechanisms that can guide the collection of data and the interpretation of results. Only then can we usefully contribute to the debate over how to protect biodiversity in developing countries. Copyright 2012, Oxford University Press.

[1]  R. Heltberg Determinants and impact of local institutions for common resource management , 2001, Environment and Development Economics.

[2]  M. Ravallion Evaluation in the Practice of Development , 2008 .

[3]  Paul J. Ferraro,et al.  Protected areas reduced poverty in Costa Rica and Thailand , 2010, Proceedings of the National Academy of Sciences.

[4]  H. White,et al.  Theory-Based Evaluation: The Case of Social Funds , 2004 .

[5]  Joshua D. Angrist,et al.  The Credibility Revolution in Empirical Economics: How Better Research Design is Taking the Con Out of Econometrics , 2010, SSRN Electronic Journal.

[6]  Norman L. Christensen,et al.  Disconnects in Evaluating the Relative Effectiveness of Conservation Strategies , 2004 .

[7]  E. Edmonds Government-initiated community resource management and local resource extraction from Nepal's forests , 2002 .

[8]  Robin Burgess,et al.  Environmental policy and the economic downturn , 2010 .

[9]  P. Ferraro,et al.  Protecting Ecosystems and Alleviating Poverty with Parks and Reserves: ‘Win-Win’ or Tradeoffs? , 2011 .

[10]  Katharine R. E. Sims Conservation and Development: Evidence from Thai Protected Areas , 2009 .

[11]  Harini Nagendra,et al.  Do Parks Work? Impact of Protected Areas on Land Cover Clearing , 2008, Ambio.

[12]  Julia P. G. Jones,et al.  Does community forest management provide global environmental benefits and improve local welfare , 2012 .

[13]  W. Sutherland,et al.  The need for evidence-based conservation. , 2004, Trends in ecology & evolution.

[14]  Partha Dasgupta,et al.  Poverty traps: Exploring the complexity of causation , 2007 .

[15]  Sushenjit Bandyopadhyay,et al.  Fuelwood Consumption and Participation in Community Forestry in India , 2004 .

[16]  Paul J. Ferraro,et al.  Show Me the Money: Do Payments Supply Environmental Services in Developing Countries? , 2010, Review of Environmental Economics and Policy.

[17]  L. Braat,et al.  Study on understanding the causes of biodiversity loss and the policy assessment framework , 2009 .

[18]  P. Ferraro Asymmetric information and contract design for payments for environmental services , 2008 .

[19]  Nick Salafsky,et al.  Improving the Practice of Conservation: a Conceptual Framework and Research Agenda for Conservation Science , 2002 .

[20]  Alexander Pfaff,et al.  Global protected area impacts , 2010, Proceedings of the Royal Society B: Biological Sciences.

[21]  E. Coleman,et al.  Comparing Forest Decentralization and Local Institutional Change in Bolivia, Kenya, Mexico, and Uganda , 2012 .

[22]  J. Vincent Microeconomic Analysis of Innovative Environmental Programs in Developing Countries , 2010, Review of Environmental Economics and Policy.

[23]  Esther Duflo,et al.  Scaling Up and Evaluation , 2003 .

[24]  Subhrendu K. Pattanayak,et al.  Money for Nothing? A Call for Empirical Evaluation of Biodiversity Conservation Investments , 2006, PLoS biology.

[25]  Subhrendu K. Pattanayak,et al.  Combining Qualitative and Quantitative Methods to Evaluate Participation in Costa Rica's Program of Payments for Environmental Services , 2009 .

[26]  A. Larson Natural Resources and Decentralization in Nicaragua: Are Local Governments Up to the Job? , 2002 .

[27]  Partha Dasgupta,et al.  On biodiversity conservation and poverty traps , 2011, Proceedings of the National Academy of Sciences.

[28]  R. O'Neill,et al.  Landscape Ecology Explained@@@Landscape Ecology in Theory and Practice: Pattern and Process , 2001 .

[29]  P. Ferraro,et al.  Measuring the effectiveness of protected area networks in reducing deforestation , 2008, Proceedings of the National Academy of Sciences.

[30]  Subhrendu K. Pattanayak,et al.  Rough Guide to Impact Evaluation of Environmental and Development Programs , 2009 .

[31]  Jeremy G. Weber,et al.  Do ICDPs Work? An Empirical Evaluation of Forest-Based Microenterprises in the Brazilian Amazon , 2011, Land Economics.

[32]  Subhrendu K. Pattanayak,et al.  Forest Figures: Ecosystem Services Valuation and Policy Evaluation in Developing Countries , 2012, Review of Environmental Economics and Policy.

[33]  Measuring protected areas’ impact on deforestation in Panama , 2010 .

[34]  Katharine R. E. Sims,et al.  Forest Conservation and Slippage: Evidence from Mexico’s National Payments for Ecosystem Services Program , 2012, Land Economics.

[35]  Craig W. Thomas,et al.  Evaluating the environmental impact of payments for ecosystem services in Coatepec (Mexico) using remote sensing and on-site interviews , 2011, Environmental Conservation.

[36]  Paul J. Ferraro,et al.  Counterfactual thinking and impact evaluation in environmental policy , 2009 .

[37]  G. Imbens,et al.  Large Sample Properties of Matching Estimators for Average Treatment Effects , 2004 .

[38]  Andrew S. Pullin,et al.  Effectiveness in Conservation Practice: Pointers from Medicine and Public Health , 2001 .

[39]  Markku Kanninen,et al.  Evaluating whether protected areas reduce tropical deforestation in Sumatra , 2009 .

[40]  Martin Ravallion,et al.  Chapter 59 Evaluating Anti-Poverty Programs , 2007 .

[41]  M. Ramírez,et al.  A Spatially Explicit Estimate of Avoided Forest Loss , 2011, Conservation biology : the journal of the Society for Conservation Biology.

[42]  L. Joppa,et al.  Reassessing the forest impacts of protection , 2010, Annals of the New York Academy of Sciences.

[43]  R. Arriagada,et al.  Private Provision of Public Goods: Applying Matching Methods to Evaluate Payments for Ecosystem Services in Costa Rica , 2008 .

[44]  T. DiPrete,et al.  7. Assessing Bias in the Estimation of Causal Effects: Rosenbaum Bounds on Matching Estimators and Instrumental Variables Estimation with Imperfect Instruments , 2004 .

[45]  T. Sunderland,et al.  Getting REDD to work locally: lessons learned from integrated conservation and development projects , 2010 .

[46]  S. Carpenter,et al.  Science for managing ecosystem services: Beyond the Millennium Ecosystem Assessment , 2009, Proceedings of the National Academy of Sciences.

[47]  C. Gibson,et al.  Decentralized governance and environmental change: Local institutional moderation of deforestation in Bolivia , 2007 .

[48]  P. Ferraro,et al.  Park Location Affects Forest Protection: Land Characteristics Cause Differences in Park Impacts across Costa Rica , 2009 .

[49]  Allen Blackman,et al.  The Evidence Base for Environmental and Socioeconomic Impacts of ‘Sustainable’ Certification , 2010 .

[50]  G. Imbens,et al.  Bias-Corrected Matching Estimators for Average Treatment Effects , 2002 .

[51]  Elinor Ostrom,et al.  Conserving the World's Forests: Are Protected Areas the Only Way? , 2005 .

[52]  S. Pagiola,et al.  Poor Household Participation in Payments for Environmental Services in Nicaragua and Colombia , 2009 .

[53]  A. Larson,et al.  Decentralization of Natural Resource Governance Regimes , 2008 .

[54]  Stephen Coate,et al.  Centralized Versus Decentralized Provision of Local Public Goods: a Political Economy Analysis , 1999 .

[55]  Katharine R. E. Sims,et al.  Designing payments for ecosystem services: Lessons from previous experience with incentive-based mechanisms , 2008, Proceedings of the National Academy of Sciences.

[56]  Angus Deaton,et al.  Understanding the Mechanisms of Economic Development , 2010 .

[57]  Partha Dasgupta,et al.  The Economics of Non-Convex Ecosystems: Introduction , 2003 .

[58]  R. Mittermeier,et al.  Biodiversity hotspots for conservation priorities , 2000, Nature.

[59]  Angus Deaton Instruments, Randomization, and Learning about Development , 2010 .

[60]  James J Heckman,et al.  Building Bridges between Structural and Program Evaluation Approaches to Evaluating Policy , 2010, Journal of economic literature.

[61]  L. Joppa,et al.  High and Far: Biases in the Location of Protected Areas , 2009, PloS one.

[62]  Dilip Mookherjee,et al.  Forests to the People: Decentralization and Forest Degradation in the Indian Himalayas , 2010 .

[63]  R. Prabhakar,et al.  Decentralization for cost-effective conservation , 2009, Proceedings of the National Academy of Sciences.

[64]  Katharine R. E. Sims Do Protected Areas Reduce Forest Fragmentation? A Microlandscapes Approach , 2014 .

[65]  Martin T. Ross,et al.  Climate Change and Conservation in Brazil: CGE Evaluation of Health and Wealth Impacts , 2009 .

[66]  R. Sierra,et al.  On the efficiency of environmental service payments: A forest conservation assessment in the Osa Peninsula, Costa Rica , 2006 .

[67]  Subhrendu K. Pattanayak,et al.  Do Payments for Environmental Services Affect Forest Cover? A Farm-Level Evaluation from Costa Rica , 2012, Land Economics.

[68]  C. Krebs Ecology: The Experimental Analysis of Distribution and Abundance , 1973 .

[69]  NICK SALAFSKY,et al.  What Conservation Can Learn from Other Fields about Monitoring and Evaluation , 2003 .

[70]  James N Sanchirico,et al.  Land market feedbacks can undermine biodiversity conservation. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[71]  Bruce B. Collette,et al.  The Impact of Conservation on the Status of the World’s Vertebrates , 2010, Science.

[72]  Michael Greenstone,et al.  Quasi-Experimental and Experimental Approaches to Environmental Economics , 2007 .

[73]  Partha Dasgupta,et al.  The Economics of Non-Convex Ecosystems: , 2004 .

[74]  W. Schlenker,et al.  Reduced-Form Versus Structural Modeling in Environmental and Resource Economics , 2009 .

[75]  K. Chomitz,et al.  Effectiveness of Strict vs. Multiple Use Protected Areas in Reducing Tropical Forest Fires: A Global Analysis Using Matching Methods , 2011, PloS one.

[76]  Manuel Frondel,et al.  Evaluating Environmental Programs: The Perspective of Modern Evaluation Research , 2001, SSRN Electronic Journal.

[77]  Devra G. Kleiman,et al.  Improving the Evaluation of Conservation Programs , 2000 .

[78]  S. Wunder,et al.  Designing payments for environmental services in theory and practice: An overview of the issues , 2008 .

[79]  James A. Robinson,et al.  Institutions as a Fundamental Cause of Long-Run Growth , 2005 .

[80]  M. Ravallion Evaluating Anti-Poverty Programs , 2005 .

[81]  Changing the deforestation impacts of Eco-/REDD payments: Evolution (2000-2005) in Costa Rica's PSA program , 2009 .

[82]  T. Besley,et al.  Pillars of Prosperity: The Political Economics of Development Clusters , 2011 .

[83]  C. Marshall,et al.  Has the Earth’s sixth mass extinction already arrived? , 2011, Nature.

[84]  Katharine R. E. Sims,et al.  Conditions associated with protected area success in conservation and poverty reduction , 2011, Proceedings of the National Academy of Sciences.