Navigating the dilemmas of climate policy in Europe: evidence from policy evaluation studies

Climate change is widely recognised as a ‘wicked’ policy problem. Agreeing and implementing governance responses is proving extremely difficult. Policy makers in many jurisdictions now emphasise their ambition to govern using the best available evidence. One obvious source of such evidence is the evaluations of the performance of existing policies. But to what extent do these evaluations provide insights into the difficult dilemmas that governors typically encounter? We address this question by reviewing the content of 262 evaluation studies of European climate policies in the light of six kinds of dilemma found in the governance literature. We are interested in what these studies say about the performance of European climate policies and in their capacity to inform evidence-based policy-making. We find that the evaluations do arrive at common findings: that climate change is framed as a problem of market and/or state failure; that voluntary measures tend to be ineffective; that market-based instruments tend to be regressive; that EU-level policies have driven climate policies in the latecomer EU Member States; and that lack of monitoring and weak enforcement are major obstacles to effective policy implementation. However, we also conclude that the evidence base these studies represent is surprisingly weak for such a high profile area. There is too little systematic climate policy evaluation work in the EU to support systematic evidence-based policy making. This reduces the scope for sound policy making in the short run and is a constraint to policy learning in the longer term.

[1]  Paolo Agnolucci,et al.  Use of economic instruments in the German renewable electricity policy , 2006 .

[2]  Andrew Jordan,et al.  The Implementation of EU Environmental Policy; A Policy Problem without a Political Solution? , 1999 .

[3]  J. Aerts,et al.  Post-2012 climate policy dilemmas: a review of proposals , 2008 .

[4]  Irma Méndez,et al.  Public Policy: An Introduction to the Theory and Practice of Policy Analysis , 1996 .

[5]  Claudia Pahl-Wostl,et al.  Research, part of a Special Feature on New Methods for Adaptive Water Management Adaptive Water Governance: Assessing the Institutional Prescriptions of Adaptive (Co-)Management from a Governance Perspective and Defining a Research Agenda , 2009 .

[6]  B. Nykvist,et al.  The use and non-use of policy appraisal tools in public policy making: an analysis of three European countries and the European Union , 2008 .

[7]  Paul Upham,et al.  The international challenge of climate change: UK leadership in the G8 and EU , 2004 .

[8]  E. Woerdman,et al.  Global Warming and Social Innovation , 2002 .

[9]  Karoline S. Rogge,et al.  Increasing the ambition of EU Emissions Trading. A report to Greenpeace International , 2006 .

[10]  B. Guy Peters,et al.  Instruments of Government: Perceptions and Contexts , 1989, Journal of Public Policy.

[11]  K. Neuhoff,et al.  CO2 cost pass-through and windfall profits in the power sector , 2006 .

[12]  Federico Ferrario,et al.  Implications of announced phase II national allocation plans for the EU ETS , 2006 .

[13]  Jamil Khan,et al.  Evaluation of the Energy Audit Programme in Finland , 2006 .

[14]  C. Egenhofer,et al.  The EU Emissions Trading Scheme: Taking Stock and Looking Ahead. CEPS ECP Report No. 2, 19 July 2006 , 2006 .

[15]  Andrew Kerr Serendipity is not a strategy: the impact of national climate programmes on greenhouse‐gas emissions , 2007 .

[16]  Lars J Nilsson,et al.  From theory based policy evaluation to SMART policy design: Lessons learned from 20 ex-post evaluations fo energy efficiency instruments , 2007 .

[17]  Staffan Jacobsson,et al.  The politics and policy of energy system transformation—explaining the German diffusion of renewable energy technology , 2006 .

[18]  Rolf Wüstenhagen,et al.  Green Energy Market Development in Germany: Effective Public Policy and Emerging Customer Demand , 2006 .

[19]  J. Rosenau Governance Without Government: Governance, order, and change in world politics , 1992 .

[20]  Michael Grubb,et al.  Allowance allocation in the European emissions trading system: a commentary , 2005, Climate Policy.

[21]  Hans Bressers,et al.  Economic Instruments for Environmental Protection: Can We Trust the “Magic Carpet”? , 1999 .

[22]  E. E. Massey,et al.  Assessing adaptation in 29 European countries , 2008 .

[23]  Christian Egenhofer,et al.  Business Consequences of the EU Emissions Trading Scheme. CEPS Task Force Reports No. 53, 1 February 2005 , 2005 .

[24]  F. Lévêque,et al.  Voluntary approaches for environmental protection in the European Union – a survey , 2000 .

[25]  C. Brooks Climatic Change , 1913, Nature.

[26]  Daniel L. Stufflebeam,et al.  The Metaevaluation Imperative , 2001 .

[27]  S. Tiezzi The welfare effects and the distributive impact of carbon taxation on Italian households , 2005 .

[28]  Catherine Mitchell,et al.  Effectiveness through risk reduction: a comparison of the renewable obligation in England and Wales and the feed-in system in Germany , 2006 .

[29]  Claudio M. Radaelli,et al.  Whither better regulation for the Lisbon agenda? , 2007 .

[30]  C. Weiss The many meanings of research utilization. , 1979 .

[31]  Christian Egenhofer,et al.  Revisiting EU Policy Options for Tackling Climate Change: A Social Cost-Benefit Analysis of GHG Emissions Reduction Strategies. CEPS Paperbacks. November 2006 , 2006 .

[32]  S. Sorrell,et al.  Carbon trading in the policy mix , 2003 .

[33]  Richard D. Morgenstern,et al.  Reality Check : The Nature and Performance of Voluntary Environmental Programs in the United States, Europe, and Japan , 2007 .

[34]  François Lévêque,et al.  Environmental Policy in Europe , 1996 .

[35]  Alexander J. Dickson,et al.  Audit of UK Greenhouse Gas emissions to 2020: will current government policies achieve significant reductions? , 2007 .

[36]  G. Glass,et al.  Meta-analysis in social research , 1981 .

[37]  A. Denny Ellerman,et al.  Over-Allocation or Abatement? A Preliminary Analysis of the EU Emissions Trading Scheme Based on the 2005 Emissions Data , 2006 .

[38]  H. Davies,et al.  Using Evidence: How research can inform public services , 2007 .

[39]  S. Ramesohl,et al.  Voluntary agreements on energy efficiency in industry — not a golden key, but another contribution to improve climate policy mixes , 2002 .

[40]  G. Luderer Greenhouse gas emission trends and projections in Europe 2006 , 2007 .

[41]  P. Pierson Not Just What, but When: Timing and Sequence in Political Processes , 2000, Studies in American Political Development.

[42]  J. Schleich,et al.  Greenhouse gas reductions in Germany and the UK - Coincidence or policy induced? , 2001 .

[43]  Paul A. Sabatier,et al.  Top-Down and Bottom-Up Approaches to Implementation Research: a Critical Analysis and Suggested Synthesis , 1986, Journal of Public Policy.

[44]  J. Proops,et al.  The distributional effects of carbon and energy taxes: the cases of France, Spain, Italy, Germany and UK , 2002 .

[45]  Andrew Jordan,et al.  New Instruments of Environmental Governance , 2003 .

[46]  Stefan Thomas,et al.  Target 2020 : policies and measures to reduce greenhouse gas emissions in the EU ; final report , 2005 .

[47]  A. Jordan The Politics of Multilevel Environmental Governance: Subsidiarity and Environmental Policy in the European Union , 2000 .