Reduced global warming from CMIP6 projections when weighting models by performance and independence

Abstract. The sixth Coupled Model Intercomparison Project (CMIP6) constitutes the latest update on expected future climate change based on a new generation of climate models. To extract reliable estimates of future warming and related uncertainties from these models, the spread in their projections is often translated into probabilistic estimates such as mean and likely range. Here, we use a model weighting approach, which accounts for a model's historical performance based on several diagnostics as well as possible model inter-dependence within the CMIP6 ensemble, to calculate constrained distributions of global mean temperature change. We investigate the skill of our approach in a perfect model test, where we remove each CMIP6 model from the ensemble in turn, use it as pseudo-observation in the historical period, and evaluate the weighted CMIP6 ensemble against it in the future. This is complemented by a second perfect model test drawing on the previous-generation CMIP5 models as pseudo-observations. In addition, we show that our independence diagnostics correctly clusters models known to be similar based on a CMIP6 family tree, which enables applying a weighting based on the degree of inter-model dependence. We then apply the weighting approach, based on two observational estimates (ERA5 and MERRA2), to constrain CMIP6 projections in weak (SSP1-2.6) and strong (SSP5-8.5) climate change scenarios. Our results show a reduction in projected mean warming for both scenarios because some CMIP6 models with high future warming receive systematically lower performance weights. The mean of end-of-century warming (2081–2100 relative to 1995–2014) for SSP5-8.5 with weighting is 3.7 °C, compared to 4.1 °C without weighting; the likely (66 %) uncertainty range is 3.1 °C to 4.6 °C, a decrease of 13 %. For SSP1-2.6, weighted end-of-century warming is 1 °C (0.7 °C to 1.4 °C). Applying the weighting to estimates of Transient Climate Response (TCR) yields 1.9 °C (1.6 °C to 2.1 °C – a reduction in the likely uncertainty range of 46 %), which is consistent with estimates from previous model generations and other lines of evidence.

[1]  Liu Xinwu This is How the Discussion Started , 1981 .

[2]  H. Hersbach Decomposition of the Continuous Ranked Probability Score for Ensemble Prediction Systems , 2000 .

[3]  F. Giorgi,et al.  Calculation of average, uncertainty range, and reliability of regional climate changes from AOGCM simulations via the reliability ensemble averaging (REA) method , 2002 .

[4]  S. Solomon The Physical Science Basis : Contribution of Working Group I to the Fourth Assessment Report of the Intergovernmental Panel on Climate Change , 2007 .

[5]  Reto Knutti,et al.  The use of the multi-model ensemble in probabilistic climate projections , 2007, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[6]  Charles Doutriaux,et al.  Performance metrics for climate models , 2008 .

[7]  M. Bosilovich,et al.  Modern Era Retrospective-Analysis for Research and Applications , 2009 .

[8]  E. Hawkins,et al.  The Potential to Narrow Uncertainty in Regional Climate Predictions , 2009 .

[9]  F. Giorgi,et al.  Does the model regional bias affect the projected regional climate change? An analysis of global model projections , 2010 .

[10]  C. Deser,et al.  Uncertainty in climate change projections: the role of internal variability , 2012, Climate Dynamics.

[11]  Reto Knutti,et al.  Challenges in Combining Projections from Multiple Climate Models , 2010 .

[12]  Reto Knutti,et al.  The end of model democracy? , 2010 .

[13]  Daniel Müllner,et al.  Modern hierarchical, agglomerative clustering algorithms , 2011, ArXiv.

[14]  Thomas Reichler,et al.  On the Effective Number of Climate Models , 2011 .

[15]  A. Thomson,et al.  The representative concentration pathways: an overview , 2011 .

[16]  R. Knutti,et al.  Climate model genealogy , 2011 .

[17]  C. Bishop,et al.  Climate model dependence and the replicate Earth paradigm , 2013, Climate Dynamics.

[18]  T. Andrews,et al.  Evaluating adjusted forcing and model spread for historical and future scenarios in the CMIP5 generation of climate models , 2013 .

[19]  Keywan Riahi,et al.  A new scenario framework for climate change research: the concept of shared socioeconomic pathways , 2013, Climatic Change.

[20]  Reto Knutti,et al.  Climate model genealogy: Generation CMIP5 and how we got there , 2013 .

[21]  Reto Knutti,et al.  A Representative Democracy to Reduce Interdependency in a Multimodel Ensemble , 2015 .

[22]  K.,et al.  The Community Earth System Model (CESM) large ensemble project: a community resource for studying climate change in the presence of internal climate variability , 2015 .

[23]  C. Bishop,et al.  Climate Model Dependence and the Ensemble Dependence Transformation of CMIP Projections , 2015 .

[24]  Veronika Eyring,et al.  Overview of the Coupled Model Intercomparison Project Phase 6 (CMIP6) experimental design and organization , 2015 .

[25]  Julien Boé,et al.  Can metric-based approaches really improve multi-model climate projections? The case of summer temperature change in France , 2015, Climate Dynamics.

[26]  Reto Knutti,et al.  Addressing interdependency in a multimodel ensemble by interpolation of model properties , 2015 .

[27]  J. Annan,et al.  On the meaning of independence in climate science , 2016 .

[28]  R. Knutti,et al.  Skill and independence weighting for multi-model assessments , 2016 .

[29]  Ramón de Elía,et al.  Is Institutional Democracy a Good Proxy for Model Independence , 2016 .

[30]  F. Zwiers,et al.  A new statistical approach to climate change detection and attribution , 2016, Climate Dynamics.

[31]  Ruth Lorenz,et al.  A climate model projection weighting scheme accounting for performance and interdependence , 2017 .

[32]  G. Hegerl,et al.  Beyond equilibrium climate sensitivity , 2017 .

[33]  Bin Zhao,et al.  The Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA-2). , 2017, Journal of climate.

[34]  Karsten Lehmann,et al.  Selecting a climate model subset to optimise key ensemble properties , 2017 .

[35]  Julien Boé,et al.  Interdependency in Multimodel Climate Projections: Component Replication and Result Similarity , 2018 .

[36]  D. Stone,et al.  Calibrating Climate Model Ensembles for Assessing Extremes in a Changing Climate , 2018, Journal of Geophysical Research: Atmospheres.

[37]  J. Jungclaus,et al.  Max Planck Institute Earth System Model (MPI-ESM1.2) for High-Resolution Model Intercomparison Project (HighResMIP) , 2018 .

[38]  Prospects and Caveats of Weighting Climate Models for Summer Maximum Temperature Projections Over North America , 2018 .

[39]  Dai Yamazaki,et al.  Description and basic evaluation of simulated mean state, internal variability, and climate sensitivity in MIROC6 , 2018, Geoscientific Model Development.

[40]  M. Mills,et al.  High Climate Sensitivity in the Community Earth System Model Version 2 (CESM2) , 2019, Geophysical Research Letters.

[41]  Bettina K. Gier,et al.  Taking climate model evaluation to the next level , 2019, Nature Climate Change.

[42]  Robert Pincus,et al.  ESD Reviews: Model dependence in multi-model climate ensembles: weighting, sub-selection and out-of-sample testing , 2019, Earth System Dynamics.

[43]  H. Tsujino,et al.  The Meteorological Research Institute Earth System Model Version 2.0, MRI-ESM2.0: Description and Basic Evaluation of the Physical Component , 2019, Journal of the Meteorological Society of Japan. Ser. II.

[44]  H. Douville,et al.  Evaluation of CMIP6 DECK Experiments With CNRM‐CM6‐1 , 2019, Journal of Advances in Modeling Earth Systems.

[45]  Philip W. Jones,et al.  The DOE E3SM Coupled Model Version 1: Overview and Evaluation at Standard Resolution , 2019, Journal of Advances in Modeling Earth Systems.

[46]  Alexander J. Winkler,et al.  Developments in the MPI‐M Earth System Model version 1.2 (MPI‐ESM1.2) and Its Response to Increasing CO2 , 2019, Journal of advances in modeling earth systems.

[47]  R. Knutti,et al.  Quantifying uncertainty in European climate projections using combined performance-independence weighting , 2019, Environmental Research Letters.

[48]  T. Andrews,et al.  Forcings, Feedbacks, and Climate Sensitivity in HadGEM3‐GC3.1 and UKESM1 , 2019, Journal of Advances in Modeling Earth Systems.

[49]  T. Mauritsen,et al.  Emergent constraints on Earth’s transient and equilibrium response to doubled CO2 from post-1970s global warming , 2019, Nature Geoscience.

[50]  B. Stevens,et al.  The Max Planck Institute Grand Ensemble: Enabling the Exploration of Climate System Variability , 2019, Journal of Advances in Modeling Earth Systems.

[51]  T. Zhou,et al.  Climate Sensitivity and Feedbacks of a New Coupled Model CAMS-CSM to Idealized CO2 Forcing: A Comparison with CMIP5 Models , 2019, Journal of Meteorological Research.

[52]  J. Jungclaus,et al.  Max Planck Institute Earth System Model (MPI-ESM1.2) for the High-Resolution Model Intercomparison Project (HighResMIP) , 2018, Geoscientific Model Development.

[53]  N. Gillett,et al.  The Canadian Earth System Model version 5 (CanESM5.0.3) , 2019, Geoscientific Model Development.

[54]  Young-Oh Kim,et al.  Spatiotemporal Reliability Ensemble Averaging of Multimodel Simulations , 2019, Geophysical Research Letters.

[55]  Christopher J. Smith,et al.  Latest climate models confirm need for urgent mitigation , 2019, Nature Climate Change.

[56]  R. Knutti,et al.  A weighting scheme to incorporate large ensembles in multi-model ensemble projections , 2019 .

[57]  A. Ito,et al.  Description of the MIROC-ES2L Earth system model and evaluation of its climate–biogeochemical processes and feedbacks , 2019 .

[58]  P. Cox,et al.  An emergent constraint on Transient Climate Response from simulated historical warming in CMIP6 models , 2020 .

[59]  M. Webb,et al.  An Assessment of Earth's Climate Sensitivity Using Multiple Lines of Evidence , 2020, Reviews of geophysics.

[60]  Christopher J. Smith,et al.  Past warming trend constrains future warming in CMIP6 models , 2020, Science Advances.

[61]  P. Cox,et al.  Emergent constraints on transient climate response (TCR) and equilibrium climate sensitivity (ECS) from historical warming in CMIP5 and CMIP6 models , 2020 .

[62]  C. Deser,et al.  Partitioning climate projection uncertainty with multiple large ensembles and CMIP5/6 , 2020, Earth System Dynamics.

[63]  Flavio Lehner,et al.  Partitioning climate projection uncertainty with multiple Large Ensembles and CMIP5/6 , 2020 .

[64]  Jason Lowe,et al.  Quantifying uncertainty in projections of future European climate: a multi-model multi-method approach , 2020 .

[65]  Bin Wang,et al.  Improved historical simulation by enhancing moist physical parameterizations in the climate system model NESM3.0 , 2020, Climate Dynamics.

[66]  A. Ito,et al.  Development of the MIROC-ES2L Earth system model and the evaluation of biogeochemical processes and feedbacks , 2020, Geoscientific Model Development.

[67]  K. Taylor,et al.  Causes of Higher Climate Sensitivity in CMIP6 Models , 2020, Geophysical Research Letters.

[68]  L. Mu,et al.  Simulations for CMIP6 With the AWI Climate Model AWI‐CM‐1‐1 , 2020, Journal of Advances in Modeling Earth Systems.

[69]  R. Vautard,et al.  Future continental summer warming constrained by the present-day seasonal cycle of surface hydrology , 2020, Scientific Reports.

[70]  R. Knutti,et al.  An investigation of weighting schemes suitable for incorporating large ensembles into multi-model ensembles , 2020 .

[71]  G. Hegerl,et al.  Comparing Methods to Constrain Future European Climate Projections Using a Consistent Framework , 2020, Journal of Climate.

[72]  Christopher J. Smith,et al.  Past warming trend constrains future warming in CMIP6 models , 2020, Science Advances.

[73]  M. Kunze,et al.  Projecting ozone hole recovery using an ensemble of chemistry–climate models weighted by model performance and independence , 2020, Atmospheric Chemistry and Physics.

[74]  N. Gillett,et al.  Climate Model Projections of 21st Century Global Warming Constrained Using the Observed Warming Trend , 2020 .