Estimating the effects of agri-environmental measures using difference-in-difference coarsened exact matching

Abstract This paper studies the effect of agri-environmental measures (AEMs) in improving greener farming practices. We focus on the quantification of the effectiveness of AEMs implemented in the Rural Development Programme of the Lombardy Region, during the 2007–2013 programming period. Our work attempts to address the well-known potential failures of these kinds of policy instruments – such as adverse selection effects – by relying on an innovative matching procedure, the coarsened exact matching (CEM). This methodology presents a number of interesting properties that are worth considering in policy-evaluation analyses. Our empirical analysis focuses on three AEM schemes protecting and enhancing the environment, Crops diversification, Grassland maintenance and Organic farming. Overall, our results suggest that AEMs were apparently effective in improving the farms’ environmental performances. However, our preliminary cost-benefit analysis highlights that the costs of implementing this policy, when compared to the additional results obtained, tend to be quite large.

[1]  Jørgen Primdahl,et al.  Current use of impact models for agri-environment schemes and potential for improvements of policy design and assessment. , 2010, Journal of environmental management.

[2]  R. Fraser.  Moral Hazard and Risk Management in Agri-environmental Policy , 2002 .

[3]  P. Gatto,et al.  Factors Affecting Farmers’ Participation in Agri‐environmental Measures: A Northern Italian Perspective , 2007 .

[4]  Leo Simon,et al.  Agri-environmental policies in the EU and United States: A comparison , 2008 .

[5]  M. Petrick,et al.  Regional employment impacts of Common Agricultural Policy measures in Eastern Germany: A difference-in-differences approach , 2011 .

[6]  K. Walker,et al.  The conservation of arable plants on cereal field margins: An assessment of new agri-environment scheme options in England, UK , 2007 .

[7]  Bill Slee,et al.  A review on cost-effectiveness analysis of agri-environmental measures related to the EU WFD: Key issues, methods, and applications , 2011 .

[8]  Jørgen Primdahl,et al.  Agri-environmental schemes and the European agricultural landscapes: the role of indicators as valuing tools for evaluation , 2000, Landscape Ecology.

[9]  P. Gibbons,et al.  The cost-effectiveness of agri-environment schemes for biodiversity conservation: A quantitative review , 2016 .

[10]  C. Weiß,et al.  Evaluating the effects of farm programmes: results from propensity score matching , 2009 .

[11]  P. Jayet,et al.  Agri-environmental schemes: Adverse selection, information structure and delegation , 2009 .

[12]  J. Subervie,et al.  How much green for the buck? Estimating additional and windfall effects of French agro-environmental schemes by DID-matching , 2010 .

[13]  Stefano M. Iacus,et al.  A Theory of Statistical Inference for Matching Methods in Causal Research , 2018, Political Analysis.

[14]  D. Rubin.  Estimating causal effects of treatments in randomized and nonrandomized studies. , 1974 .

[15]  E Andersen,et al.  Environmental effects of agri-environmental schemes in Western Europe. , 2003, Journal of environmental management.

[16]  D. Lindenmayer,et al.  A Novel and Cost-Effective Monitoring Approach for Outcomes in an Australian Biodiversity Conservation Incentive Program , 2012, PloS one.

[17]  J. Peterseil,et al.  Impact of the Austrian Agri-environmental scheme on diversity of landscapes, plants and birds , 2008 .

[18]  J Hunt,et al.  The multi-disciplinary evaluation of a national agri-environment scheme. , 2003, Journal of environmental management.

[19]  A. Olper,et al.  Do CAP Payments Reduce Farm Labour Migration? A Panel Data Analysis Across EU Regions , 2014 .

[20]  M. Raggi,et al.  Assessing the impact of RDP agri-environment measures on the use of nitrogen-based mineral fertilizers through spatial econometrics: The case study of Emilia-Romagna (Italy) , 2015 .

[21]  S. Reinhard,et al.  Evaluating the impact of rural development measures on nature value indicators at different spatial levels: Application to France and The Netherlands , 2015 .

[22]  S. Hynes,et al.  Modelling farmers' participation in an agri-environmental scheme using panel data: an application to the rural environment protection scheme in Ireland. , 2009 .

[23]  G. King,et al.  Causal Inference without Balance Checking: Coarsened Exact Matching , 2012, Political Analysis.

[24]  Carol Morris,et al.  Towards a geography of agri-environmental policies in England and Wales , 1997 .

[25]  G. C. Pacini,et al.  Increasing the cost-effectiveness of EU agri-environment policy measures through evaluation of farm and field-level environmental and economic performance , 2015 .

[26]  D. Macdonald,et al.  Optimizing agri-environment schemes to improve river health and conservation value , 2013 .

[27]  K. Falconer.  Farm-level constraints on agri-environmental scheme participation: a transactional perspective. , 2000 .

[28]  Sébastien Mary,et al.  Assessing the Impacts of Pillar 1 and 2 Subsidies on TFP in French Crop Farms , 2013 .

[29]  Christian Albert,et al.  Optimizing environmental measures for landscape multifunctionality: effectiveness, efficiency and recommendations for agri-environmental programs. , 2015, Journal of environmental management.

[30]  Š. Bojnec,et al.  Farm size and participation in agri-environmental measures: Farm-level evidence from Slovenia , 2015 .

[31]  Subhrendu K. Pattanayak,et al.  Money for Nothing? A Call for Empirical Evaluation of Biodiversity Conservation Investments , 2006, PLoS biology.

[32]  Petra E. Todd,et al.  Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme , 1997 .

[33]  William J. Sutherland,et al.  How effective are European agri‐environment schemes in conserving and promoting biodiversity? , 2003 .

[34]  L. Arata,et al.  The Impact of Agri-environmental Schemes on Farm Performance in Five E.U. Member States: A DID-Matching Approach , 2016, Land Economics.

[35]  Johannes Sauer,et al.  The impact of agri-environment schemes on farm productivity: a DID-matching approach , 2020, European Review of Agricultural Economics.

[36]  D B Rubin,et al.  Matching using estimated propensity scores: relating theory to practice. , 1996, Biometrics.

[37]  S. Wunder,et al.  Designing payments for environmental services in theory and practice: An overview of the issues , 2008 .

[38]  B. Matzdorf,et al.  Studies on Agri-environmental Measures: A Survey of the Literature , 2012, Environmental Management.

[39]  Combating moral hazard in agri-environmental schemes: a multiple-agent approach , 2005 .

[40]  G. King,et al.  Multivariate Matching Methods That Are Monotonic Imbalance Bounding , 2011 .

[41]  Alessandro Banterle,et al.  A diagnostic system to assess sustainability at a farm level: The SOSTARE model , 2015 .

[42]  J. Peerlings,et al.  Agri-environmental contracting of Dutch dairy farms: the role of manure policies and the occurrence of lock-in , 2008 .

[43]  B. Gerowitt,et al.  A survey of on-farm acceptance of low-input measures in intensive agriculture , 2007, Agronomy for Sustainable Development.

[44]  Wim Verbeke,et al.  Determinants of the Willingness of Belgian Farmers to Participate in Agri-environmental Measures , 2002 .

[45]  Bettina Matzdorf,et al.  How cost-effective are result-oriented agri-environmental measures? - An empirical analysis in Germany. , 2010 .

[46]  A. Olper,et al.  Agri-environmental measures adoption : New evidence from Lombardy region , 2008 .

[47]  Kyösti Pietola,et al.  Effciency and productivity of conventional and organic farms in Finland 1994--1997 , 2002 .

[48]  J. A. Gómez-Limón,et al.  Assessing the impact of agri-environmental schemes on the eco-efficiency of rain-fed agriculture , 2012 .

[49]  K. Salhofer,et al.  Self-selection as a problem in evaluating agri-environmental programs /доклад на 87 семинаре ЕААЕ, Assessing Rural Development Policies of the CAP, Vienna, Austria, 21-23 April 2004 , 2004 .

[50]  H. Burningham,et al.  Opportunities of, and constraints to, the use of intertidal agri-environment schemes for sustainable coastal defence: A case study of the Blackwater Estuary, southeast England , 2008 .

[51]  J. A. Gómez-Limón,et al.  Optimal Design of Agri‐environmental Schemes under Asymmetric Information for Improving Farmland Biodiversity , 2019 .

[52]  Céline Nauges,et al.  Evaluating Greening Farm Policies: A Structural Model for Assessing Agri-environmental Subsidies , 2014, Land Economics.

[53]  J. Swinnen,et al.  Jobs and agricultural policy: Impact of the common agricultural policy on EU agricultural employment , 2019, Food Policy.

[54]  G. R. Bolton,et al.  Short-term changes in soil nutrients and vegetation biomass and nutrient content following the introduction of extensive management in upland sown swards in Scotland, UK , 2005 .

[55]  G. Imbens,et al.  Large Sample Properties of Matching Estimators for Average Treatment Effects , 2004 .