Data, concepts and methods for large‐n comparative climate change adaptation policy research: A systematic literature review

Climate change adaptation research is dominated by in‐depth, qualitative, single‐ or small‐n case studies that have resulted in rich and in‐depth understanding on adaptation processes and decision making in specific locations. Recently, the number of comparative adaptation policy cases has increased, focusing on examining, describing, and/or explaining how countries, regions, and vulnerable groups are adapting across a larger sample of contexts and over time. There are, however, critical empirical, conceptual and methodological choices and challenges for comparative adaptation research. This article systematically captures and assesses the current state of larger‐n (n ≥ 20 cases) comparative adaptation policy literature. We systematically analyze 72 peer‐reviewed articles to identify the key choices and challenges authors face when conducting their research. We find among others that almost all studies use nonprobability sampling methods, few existing comparative adaptation datasets exist, most studies use easy accessible data which might not be most appropriate for the research question, many struggle to disentangle rhetoric from reality in adaptation, and very few studies engage in critical reflection of their conceptual, data and methodological choices and the implications for their findings. We conclude that efforts to increase data availability and use of more rigorous methodologies are necessary to advance comparative adaptation research. This article is categorized under: Vulnerability and Adaptation to Climate Change > Learning from Cases and Analogies

[1]  R. Biesbroek,et al.  Comparing apples and oranges: The dependent variable problem in comparing and evaluating climate change adaptation policies , 2013 .

[2]  Chen Chen,et al.  Opinion: Big data has big potential for applications to climate change adaptation , 2016, Proceedings of the National Academy of Sciences.

[3]  James D. Ford,et al.  How to Track Adaptation to Climate Change: A Typology of Approaches for National-Level Application , 2013 .

[4]  James D. Ford,et al.  Systematic review approaches for climate change adaptation research , 2015, Regional Environmental Change.

[5]  C. Chen,et al.  A global assessment of adaptation investment from the perspectives of equity and efficiency , 2016, Mitigation and Adaptation Strategies for Global Change.

[6]  Lea Berrang-Ford,et al.  What does the Paris Agreement mean for adaptation? , 2017 .

[7]  Scott E. Kalafatis Comparing Climate Change Policy Adoption and Its Extension across Areas of City Policymaking , 2018 .

[8]  Megan C. Maloney,et al.  Climate adaptation heuristics and the science/policy divide , 2015, Mitigation and Adaptation Strategies for Global Change.

[9]  Benjamin L. Preston,et al.  Climate adaptation planning in practice: an evaluation of adaptation plans from three developed nations , 2011 .

[10]  S. Juhola,et al.  Adaptive climate change governance for urban resilience , 2015 .

[11]  Jian-yun Zhang,et al.  Potential impact of climate change on future water demand in Yulin city, Northwest China , 2013, Mitigation and Adaptation Strategies for Global Change.

[12]  S. Hughes,et al.  Perceptions of urban climate hazards and their effects on adaptation agendas , 2017, Mitigation and Adaptation Strategies for Global Change.

[13]  Richard Kinley Climate change after Paris: from turning point to transformation , 2017, Green Planet Blues.

[14]  Debra Javeline,et al.  The Most Important Topic Political Scientists Are Not Studying: Adapting to Climate Change , 2014, Perspectives on Politics.

[15]  James D. Ford,et al.  National-level factors affecting planned, public adaptation to health impacts of climate change , 2013 .

[16]  Linda Shi,et al.  Explaining Progress in Climate Adaptation Planning Across 156 U.S. Municipalities , 2015, Planning for Climate Change.

[17]  R. Biesbroek,et al.  Measuring Progress on Climate Change Adaptation Policy by Dutch Water Boards , 2017, Water Resources Management.

[18]  Teresa Ribera,et al.  Global adaptation after Paris , 2016, Science.

[19]  Alexander C. E. Aylett Institutionalizing the urban governance of climate change adaptation: Results of an international survey , 2015 .

[20]  James D. Ford,et al.  The status of climate change adaptation in Africa and Asia , 2015, Regional Environmental Change.

[21]  James D. Ford,et al.  Adapting to health impacts of climate change: a study of UNFCCC Annex I parties , 2011 .

[22]  Climate adaptation research for the next generation , 2013 .

[23]  Ellen M. Bassett,et al.  Innovation and Climate Action Planning , 2010 .

[24]  James D. Ford,et al.  Climate change adaptation planning in large cities: A systematic global assessment , 2016 .

[25]  S. Cooper,et al.  Climate change performance measurement, control and accountability in English local authority areas , 2011 .

[26]  Xue Li,et al.  Content analysis for the U.S. coastal states' climate action plans in managing the risks of extreme climate events and disasters , 2013 .

[27]  James D. Ford,et al.  Adaptation tracking for a post-2015 climate agreement , 2015 .

[28]  James D. Ford,et al.  A systematic review of observed climate change adaptation in developed nations , 2011 .

[29]  M. Purdon Advancing Comparative Climate Change Politics: Theory and Method , 2015, Global Environmental Politics.

[30]  H. Bulkeley,et al.  A survey of urban climate change experiments in 100 cities , 2013, Global environmental change : human and policy dimensions.

[31]  Rui Wang Adopting Local Climate Policies , 2013 .

[32]  R. Bierbaum,et al.  A typology of adaptation actions: A global look at climate adaptation actions financed through the Global Environment Facility , 2014 .

[33]  M. Petticrew,et al.  Systematic Reviews in the Social Sciences , 2006 .

[34]  J. Tosun,et al.  Legislative Dynamics of Mitigation and Adaptation Framework Policies in the EU , 2017, European Policy Analysis.

[35]  John D. Wilkerson,et al.  Large-Scale Computerized Text Analysis in Political Science: Opportunities and Challenges , 2017 .

[36]  S. Brody,et al.  Moving from agenda to action: evaluating local climate change action plans , 2010 .

[37]  J. Ford,et al.  What drives national adaptation? A global assessment , 2014, Climatic Change.

[38]  H. Zeeb,et al.  Using a Social Justice and Health Framework to Assess European Climate Change Adaptation Strategies , 2014, International journal of environmental research and public health.

[39]  D. Moher,et al.  Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement , 2009, BMJ : British Medical Journal.

[40]  Sierra C. Woodruff,et al.  Numerous strategies but limited implementation guidance in US local adaptation plans , 2016 .

[41]  Elisabeth M. Hamin,et al.  Climate change adaptation in coastal Australia: An audit of planning practice , 2013 .

[42]  N. Holvoet,et al.  Gender sensitivity of Sub-Saharan Africa National Adaptation Programmes of Action: findings from a desk review of 31 countries , 2014 .

[43]  J. Flacke,et al.  The Influence of Drivers and Barriers on Urban Adaptation and Mitigation Plans—An Empirical Analysis of European Cities , 2015, PloS one.

[44]  Milind Kandlikar,et al.  Measuring and tracking the flow of climate change adaptation aid to the developing world , 2016 .

[45]  H. Westskog,et al.  Overcoming Barriers to Climate Change Adaptation—A Question of Multilevel Governance? , 2010 .

[46]  Lynn P. Nygaard,et al.  Why different interpretations of vulnerability matter in climate change discourses , 2007 .

[47]  T. Carter,et al.  Europe adapts to climate change: comparing national adaptation strategies , 2010 .

[48]  Catrien J.A.M. Termeer,et al.  The role of knowledge and power in climate change adaptation governance: a systematic literature review , 2013 .

[49]  Reinhard Steurer,et al.  The Governance of Climate Change Adaptation in 10 OECD Countries: Challenges and Approaches , 2012 .

[50]  James D. Ford,et al.  The 4Cs of adaptation tracking: consistency, comparability, comprehensiveness, coherency , 2015, Mitigation and Adaptation Strategies for Global Change.

[51]  B. Locatelli,et al.  Addressing Climate Change Mitigation and Adaptation Together: A Global Assessment of Agriculture and Forestry Projects , 2016, Environmental Management.

[52]  D. Huitema,et al.  The emergence of climate change adaptation as a new field of public policy in Europe , 2016, Regional Environmental Change.

[53]  James D. Ford,et al.  Public Health Adaptation to Climate Change in Large Cities , 2016, International journal of health services : planning, administration, evaluation.

[54]  Constanze Haug,et al.  Mainstreaming climate change in regional development policy in Europe: five insights from the 2007–2013 programming period , 2015, Regional Environmental Change.

[55]  F. Weiler,et al.  Allocation of aid for adaptation to climate change: Do vulnerable countries receive more support? , 2017, International Environmental Agreements: Politics, Law and Economics.

[56]  André Schaffrin,et al.  Toward a Comparative Measure of Climate Policy Output , 2015 .

[57]  R. Swart,et al.  Science of adaptation to climate change and science for adaptation , 2014, Front. Environ. Sci..

[58]  B. Smit,et al.  Case study and analogue methodologies in climate change vulnerability research , 2010 .

[59]  H. Bulkeley,et al.  Government by experiment? Global cities and the governing of climate change , 2013 .

[60]  A. Michaelowa,et al.  Equity and cost-effectiveness of multilateral adaptation finance: are they friends or foes? , 2014, International Environmental Agreements: Politics, Law and Economics.

[61]  O Heidrich,et al.  National climate policies across Europe and their impacts on cities strategies. , 2016, Journal of environmental management.

[62]  D. Huitema,et al.  Climate policy innovation:The adoption and diffusion of adaptation policies across Europe , 2014 .

[63]  Aniruddh Mohan,et al.  Plus ça change, plus c’est la même chose: Adaptation in the Paris Agreement , 2016 .

[64]  H. Bulkeley,et al.  Climate justice and global cities: Mapping the emerging discourses , 2013 .

[65]  Scott E. Kalafatis When do climate change, sustainability, and economic development considerations overlap in cities? , 2018 .

[66]  R. Steurer,et al.  Why popular support tools on climate change adaptation have difficulties in reaching local policy‐makers: Qualitative insights from the UK and Germany , 2018 .

[67]  A. Kirilenko,et al.  Public microblogging on climate change: One year of Twitter worldwide , 2014 .

[68]  R. Dawson,et al.  Assessment of the climate preparedness of 30 urban areas in the UK , 2013, Climatic Change.

[69]  S. Agrawala,et al.  PROGRESS ON ADAPTATION TO CLIMATE CHANGE IN DEVELOPED COUNTRIES AN ANALYSIS OF BROAD TRENDS , 2006 .

[70]  R. Dawson,et al.  Climate change response in Europe: what’s the reality? Analysis of adaptation and mitigation plans from 200 urban areas in 11 countries , 2013, Climatic Change.

[71]  Carrie L. Mitchell,et al.  Tipping Toward Transformation: Progress, Patterns and Potential for Climate Change Adaptation in the Global South , 2017 .

[72]  Johanna Nalau,et al.  Is adaptation a local responsibility , 2015 .

[73]  W. Adger,et al.  Assessment of institutional capacity to adapt to climate change in transboundary river basins , 2013, Climatic Change.

[74]  G. Feola,et al.  Success and Failure of Grassroots Innovations for Addressing Climate Change: The Case of the Transition Movement , 2014 .

[75]  Chris Koski,et al.  Environmental Harm or Natural Hazard? Problem Identification and Adaptation in U.S. Municipal Climate Action Plans , 2016 .

[76]  Sierra Woodruff,et al.  Looking under the hood of local adaptation plans: shedding light on the actions prioritized to build local resilience to climate change , 2017, Mitigation and Adaptation Strategies for Global Change.

[77]  Diana King,et al.  A framework for examining adaptation readiness , 2015, Mitigation and Adaptation Strategies for Global Change.

[78]  Livia Bizikova,et al.  Review of key initiatives and approaches to adaptation planning at the national level in semi-arid areas , 2015, Regional Environmental Change.

[79]  Matthew Dornan,et al.  International financing for climate change adaptation in small island developing states , 2017, Regional Environmental Change.

[80]  P. Kabat,et al.  On the nature of barriers to climate change adaptation , 2013, Regional Environmental Change.

[81]  Caroline A Sullivan,et al.  Are We There Yet? NSW local governments’ progress on climate change , 2014 .

[82]  J. Ford,et al.  National-level progress on adaptation , 2016 .

[83]  J. Ford,et al.  Operationalizing longitudinal approaches to climate change vulnerability assessment , 2017 .

[84]  Scott E. Kalafatis Identifying the Potential for Climate Compatible Development Efforts and the Missing Links , 2017 .

[85]  David R. Jones,et al.  Synthesising qualitative and quantitative evidence: A review of possible methods , 2005 .

[86]  Rebecca J. Romsdahl,et al.  An Examination of Local Climate Change Policies in the Great Plains , 2014 .

[87]  David M. Blei,et al.  Probabilistic topic models , 2012, Commun. ACM.