On structural errors in emergent constraints

Abstract. Studies of emergent constraints have frequently proposed that a single metric alone can constrain future responses of the Earth system to anthropogenic emissions. The prevalence of this thinking has led to literature and messaging which is sometimes confusing to policymakers, with a series of studies over the last decade making confident, yet contradictory, claims on the probability bounds of key climate variables. Here, we illustrate that emergent constraints are more likely to occur where the variance across an ensemble of climate models of both observable and future climate arises from common structural assumptions and few degrees of freedom. Such cases are likely to occur when processes are represented in a common, oversimplified fashion throughout the ensemble, about which we have the least confidence in performance out of sample. We consider these issues in the context of a number of published constraints, and argue that the application of emergent constraints alone to estimate uncertainties in unknown climate responses can potentially lead to bias and overconfidence in constrained projections. Together with statistical robustness and plausibility of mechanism, assessments of climate responses must include multiple lines of evidence to identify biases that arise from common oversimplified modeling assumptions which impact both present and future climate simulations in order to mitigate against the influence of common structural biases.

[1]  A. Holtslag,et al.  Role of land-surface temperature feedback on model performance for the stable boundary layer , 2007 .

[2]  P. Cox,et al.  Theoretical foundations of emergent constraints: relationships between climate sensitivity and global temperature variability in conceptual models , 2018, 1810.12765.

[3]  Andrew Gettelman,et al.  The Art and Science of Climate Model Tuning , 2017 .

[4]  J. Randerson,et al.  Causes of variation in soil carbon simulations from CMIP5 Earth system models and comparison with observations , 2012 .

[5]  Tim N. Palmer,et al.  Using numerical weather prediction to assess climate models , 2007 .

[6]  M. Allen,et al.  Constraints on climate change from a multi‐thousand member ensemble of simulations , 2005 .

[7]  C. Bretherton,et al.  Variability in modeled cloud feedback tied to differences in the climatological spatial pattern of clouds , 2018, Climate Dynamics.

[8]  Anja Rammig,et al.  Amazon forest response to CO2 fertilization dependent on plant phosphorus acquisition , 2019, Nature Geoscience.

[9]  Cecile Hannay,et al.  Practice and philosophy of climate model tuning across six U.S. modeling centers. , 2017, Geoscientific model development.

[10]  A. Timmermann,et al.  Using palaeo-climate comparisons to constrain future projections in CMIP5 , 2013 .

[11]  Philip G. Sansom,et al.  How Are Emergent Constraints Quantifying Uncertainty and What Do They Leave Behind? , 2019, Bulletin of the American Meteorological Society.

[12]  G. Boer,et al.  Inferring climate sensitivity from volcanic events , 2007 .

[13]  G. Tselioudis,et al.  CMIP5 models' shortwave cloud radiative response and climate sensitivity linked to the climatological Hadley cell extent , 2017, Geophysical research letters.

[14]  A. Arneth,et al.  Response of simulated burned area to historical changes in environmental and anthropogenic factors: a comparison of seven fire models , 2019, Biogeosciences.

[15]  S. Bony,et al.  Sugar, Gravel, Fish, and Flowers: Dependence of Mesoscale Patterns of Trade‐Wind Clouds on Environmental Conditions , 2020, Geophysical research letters.

[16]  A. Hall,et al.  What Controls the Strength of Snow-Albedo Feedback? , 2007 .

[17]  Kathy Steppe,et al.  Responses of tree species to heat waves and extreme heat events. , 2015, Plant, cell & environment.

[18]  T. Lenton,et al.  Climate tipping points — too risky to bet against , 2019, Nature.

[19]  Peter Challenor,et al.  The impact of structural error on parameter constraint in a climate model , 2016 .

[20]  Reto Knutti,et al.  A Representative Democracy to Reduce Interdependency in a Multimodel Ensemble , 2015 .

[21]  B. Sanderson Relating climate sensitivity indices to projection uncertainty , 2019, Earth System Dynamics.

[22]  P. Cox,et al.  An observation-based constraint on permafrost loss as a function of global warming , 2017 .

[23]  R. Knutti,et al.  Reduced global warming from CMIP6 projections when weighting models by performance and independence , 2020, Earth System Dynamics.

[24]  Francis W. Zwiers,et al.  Use of models in detection and attribution of climate change , 2011 .

[25]  Pieter de Wilde,et al.  Towards probabilistic performance metrics for climate change impact studies , 2011 .

[26]  K. Taylor,et al.  Forcing, feedbacks and climate sensitivity in CMIP5 coupled atmosphere‐ocean climate models , 2012 .

[27]  Forrest M. Hoffman,et al.  The International Land Model Benchmarking (ILAMB) System: Design, Theory, and Implementation , 2018, Journal of Advances in Modeling Earth Systems.

[28]  P. Cox Emergent Constraints on Climate-Carbon Cycle Feedbacks , 2014, Current Climate Change Reports.

[29]  Liming Zhou,et al.  Evaluation of simulated climatological diurnal temperature range in CMIP5 models from the perspective of planetary boundary layer turbulent mixing , 2017, Climate Dynamics.

[30]  R. Knutti,et al.  Skill and independence weighting for multi-model assessments , 2016 .

[31]  J. Lamarque,et al.  Nitrogen Availability Reduces CMIP5 Projections of Twenty-First-Century Land Carbon Uptake* , 2015 .

[32]  G. Meehl,et al.  The seasonal cycle in coupled ocean-atmosphere general circulation models , 2000 .

[33]  Patrick C. Taylor,et al.  A Framework for Evaluating Climate Model Performance Metrics , 2016 .

[34]  M. Webb,et al.  Structural similarities and differences in climate responses to CO2 increase between two perturbed physics ensembles. , 2010 .

[35]  Bettina K. Gier,et al.  Taking climate model evaluation to the next level , 2019, Nature Climate Change.

[36]  F. Woodward,et al.  Assessing uncertainties in a second-generation dynamic vegetation model caused by ecological scale limitations. , 2010, The New phytologist.

[37]  Dean N. Williams,et al.  A Global Repository for Planet-Sized Experiments and Observations , 2016 .

[38]  David M. H. Sexton,et al.  Multivariate probabilistic projections using imperfect climate models. Part II: robustness of methodological choices and consequences for climate sensitivity , 2012, Climate Dynamics.

[39]  G. Svensson,et al.  Evaluation of Near-Surface Variables and the Vertical Structure of the Boundary Layer in CMIP5 Models , 2015 .

[40]  James D. Annan,et al.  A Bayesian framework for emergent constraints: case studies of climate sensitivity with PMIP , 2020 .

[41]  D. Klocke,et al.  Tuning the climate of a global model , 2012 .

[42]  S. Klein,et al.  Low‐cloud optical depth feedback in climate models , 2013 .

[43]  Jeffrey Park,et al.  Climate sensitivity constrained by CO2 concentrations over the past 420 million years , 2007, Nature.

[44]  B. Santer,et al.  Climate constraint reflects forced signal , 2018, Nature.

[45]  B. Santer,et al.  Effect of climate sensitivity on the Response to Volcanic Forcing , 2005 .

[46]  Christopher J. Smith,et al.  Past warming trend constrains future warming in CMIP6 models , 2020, Science Advances.

[47]  Charles Doutriaux,et al.  Performance metrics for climate models , 2008 .

[48]  Pierre Friedlingstein,et al.  Uncertainties in CMIP5 Climate Projections due to Carbon Cycle Feedbacks , 2014 .

[49]  B. Sanderson On the estimation of systematic error in regression-based predictions of climate sensitivity , 2013, Climatic Change.

[50]  A spatial emergent constraint on the sensitivity of soil carbon turnover to global warming , 2020, Nature communications.

[51]  Alice Boit,et al.  Resilience of Amazon forests emerges from plant trait diversity , 2016 .

[52]  M. Webb,et al.  Multivariate probabilistic projections using imperfect climate models part I: outline of methodology , 2012, Climate Dynamics.

[53]  Michael Goldstein,et al.  History matching for exploring and reducing climate model parameter space using observations and a large perturbed physics ensemble , 2013, Climate Dynamics.

[54]  W. Ingram,et al.  Climate feedbacks determined using radiative kernels in a multi-thousand member ensemble of AOGCMs , 2010 .

[55]  G. Hegerl,et al.  Climate sensitivity constrained by temperature reconstructions over the past seven centuries , 2006, Nature.

[56]  R. Knutti,et al.  Quantifying uncertainty in European climate projections using combined performance-independence weighting , 2019, Environmental Research Letters.

[57]  V. Brovkin,et al.  Nitrogen cycling in CMIP6 land surface models: progress and limitations , 2020, Biogeosciences.

[58]  H. Shiogama,et al.  Low clouds link equilibrium climate sensitivity to hydrological sensitivity , 2018, Nature Climate Change.

[59]  Martin B. Stolpe,et al.  Assumptions for emergent constraints , 2018, Nature.

[60]  M. Yoshimori,et al.  Can the Last Glacial Maximum constrain climate sensitivity? , 2012 .

[61]  Jonathan Rougier,et al.  Probabilistic Inference for Future Climate Using an Ensemble of Climate Model Evaluations , 2007 .

[62]  Estimating the Transient Climate Response from Observed Warming , 2018, Journal of Climate.

[63]  B. Tian Spread of model climate sensitivity linked to double‐Intertropical Convergence Zone bias , 2015 .

[64]  S. Klein,et al.  Emergent Constraints for Cloud Feedbacks , 2015, Current Climate Change Reports.

[65]  Veronika Eyring,et al.  Overview of the Coupled Model Intercomparison Project Phase 6 (CMIP6) experimental design and organization , 2015 .

[66]  C. Zhai,et al.  Long‐term cloud change imprinted in seasonal cloud variation: More evidence of high climate sensitivity , 2015 .

[67]  T. Andrews,et al.  Equilibrium Climate Sensitivity Estimated by Equilibrating Climate Models , 2020, Geophysical Research Letters.

[68]  Model structures amplify uncertainty in predicted soil carbon responses to climate change , 2018, Nature Communications.

[69]  Florent Brient Reducing Uncertainties in Climate Projections with Emergent Constraints: Concepts, Examples and Prospects , 2019, Advances in Atmospheric Sciences.

[70]  P. Cox,et al.  Emergent constraint on equilibrium climate sensitivity from global temperature variability , 2018, Nature.

[71]  Martin B. Stolpe,et al.  Assumptions for emergent constraints , 2018, Nature.

[72]  D. Stephenson,et al.  On the Robustness of Emergent Constraints Used in Multimodel Climate Change Projections of Arctic Warming , 2012 .

[73]  C. Hannay,et al.  The path to CAM6: coupled simulations with CAM5.4 and CAM5.5 , 2017 .

[74]  Stephen A. Klein,et al.  Progressing emergent constraints on future climate change , 2019, Nature Climate Change.

[75]  T. Mauritsen,et al.  Emergent constraints on Earth’s transient and equilibrium response to doubled CO2 from post-1970s global warming , 2019, Nature Geoscience.

[76]  P. Cox,et al.  An emergent constraint on Transient Climate Response from simulated historical warming in CMIP6 models , 2020 .

[77]  S. Klein,et al.  Evaluating Emergent Constraints on Equilibrium Climate Sensitivity , 2018 .

[78]  Reto Knutti,et al.  Constraints on Model Response to Greenhouse Gas Forcing and the Role of Subgrid-Scale Processes , 2008 .

[79]  X. Zeng,et al.  Soil microbial respiration from observations and Earth System Models , 2013 .

[80]  M. Webb,et al.  An Assessment of Earth's Climate Sensitivity Using Multiple Lines of Evidence , 2020, Reviews of geophysics.

[81]  Leonard A. Smith,et al.  Uncertainty in predictions of the climate response to rising levels of greenhouse gases , 2005, Nature.

[82]  S. Bony,et al.  Spread in model climate sensitivity traced to atmospheric convective mixing , 2014, Nature.

[83]  C. Heinze,et al.  Ocean biogeochemistry in the Norwegian Earth System Model version 2 (NorESM2) , 2020, Geoscientific Model Development.

[84]  T. Schneider,et al.  Constraints on Climate Sensitivity from Space-Based Measurements of Low-Cloud Reflection , 2016 .

[85]  C. Bretherton,et al.  Combining Emergent Constraints for Climate Sensitivity , 2020 .

[86]  S. Klein,et al.  Are climate model simulations of clouds improving? An evaluation using the ISCCP simulator , 2012 .

[87]  R. Knutti,et al.  Predictor Screening, Calibration, and Observational Constraints in Climate Model Ensembles: An Illustration Using Climate Sensitivity , 2013 .

[88]  R. Knutti,et al.  Constraints on the transient climate response from observed global temperature and ocean heat uptake , 2008 .

[89]  J. Chambers,et al.  Forest responses to simulated elevated CO2 under alternate hypotheses of size‐ and age‐dependent mortality , 2020, Global change biology.

[90]  K. Taylor,et al.  Causes of Higher Climate Sensitivity in CMIP6 Models , 2020, Geophysical Research Letters.

[91]  John M. Edwards,et al.  Representation of Boundary-Layer Processes in Numerical Weather Prediction and Climate Models , 2020, Boundary-Layer Meteorology.

[92]  Yadvinder Malhi,et al.  Drivers and mechanisms of tree mortality in moist tropical forests. , 2018, The New phytologist.

[93]  B. Stevens,et al.  What could we learn about climate sensitivity from variability in the surface temperature record? , 2020, Earth System Dynamics.

[94]  C. Leith Climate Response and Fluctuation Dissipation , 1975 .

[95]  S. Bony,et al.  Shallowness of tropical low clouds as a predictor of climate models’ response to warming , 2016, Climate Dynamics.

[96]  S. Klein,et al.  On the spread of changes in marine low cloud cover in climate model simulations of the 21st century , 2014, Climate Dynamics.

[97]  Liu Xinwu This is How the Discussion Started , 1981 .

[98]  Pierre Friedlingstein,et al.  Carbon–concentration and carbon–climate feedbacks in CMIP6 models and their comparison to CMIP5 models , 2019, Biogeosciences.

[99]  M. Kimoto,et al.  Lower-Tropospheric Mixing as a Constraint on Cloud Feedback in a Multiparameter Multiphysics Ensemble , 2016 .

[100]  J. Fasullo,et al.  Constraints on Climate Sensitivity from Radiation Patterns in Climate Models , 2011 .

[101]  S. Emori,et al.  Perturbed physics ensemble using the MIROC5 coupled atmosphere–ocean GCM without flux corrections: experimental design and results , 2012, Climate Dynamics.

[102]  S. Bony,et al.  Shallow clouds and water vapor, circulation and climate sensitivity , 2018 .

[103]  A. Hall,et al.  An emergent constraint on future Arctic sea-ice albedo feedback , 2019, Nature Climate Change.

[104]  T. Palmer Short-term tests validate long-term estimates of climate change , 2020, Nature.

[105]  S. Chatterjee,et al.  Influential Observations, High Leverage Points, and Outliers in Linear Regression , 1986 .

[106]  Ruth Lorenz,et al.  A climate model projection weighting scheme accounting for performance and interdependence , 2017 .

[107]  Weimin Zheng,et al.  Automatic tuning of the Community Atmospheric Model (CAM5) by using short-term hindcasts with an improved downhill simplex optimization method , 2018, Geoscientific Model Development.

[108]  D. Saint‐Martin,et al.  Transient Climate Response in a Two-Layer Energy-Balance Model. Part I: Analytical Solution and Parameter Calibration Using CMIP5 AOGCM Experiments , 2013 .

[109]  R. Kubo The fluctuation-dissipation theorem , 1966 .

[110]  Coralia Cartis,et al.  Calibrating climate models using inverse methods: case studies with HadAM3, HadAM3P and HadCM3 , 2017 .

[111]  Philip W. Jones,et al.  The DOE E3SM Coupled Model Version 1: Overview and Evaluation at Standard Resolution , 2019, Journal of Advances in Modeling Earth Systems.

[112]  P. O’Gorman Sensitivity of tropical precipitation extremes to climate change , 2012 .

[113]  N. Zeng,et al.  To what extent can interannual CO2 variability constrain carbon cycle sensitivity to climate change in CMIP5 Earth System Models? , 2014 .

[114]  Olivier Geoffroy,et al.  Transient Climate Response in a Two-Layer Energy-Balance Model. Part II: Representation of the Efficacy of Deep-Ocean Heat Uptake and Validation for CMIP5 AOGCMs , 2013 .

[115]  H. Fredriksen,et al.  Emergent constraints on climate sensitivity , 2018, Nature.

[116]  H. Douville,et al.  Midlatitude Summer Drying: An Underestimated Threat in CMIP5 Models? , 2017 .

[117]  K. Trenberth,et al.  Simulation of Present-Day and Twenty-First-Century Energy Budgets of the Southern Oceans , 2010 .

[118]  B. Santer,et al.  Statistical significance of climate sensitivity predictors obtained by data mining , 2014 .

[119]  A. Hall,et al.  On the persistent spread in snow-albedo feedback , 2012, Climate Dynamics.

[120]  E. Gloor,et al.  Forest carbon sink neutralized by pervasive growth-lifespan trade-offs , 2020, Nature Communications.

[121]  G. Meehl,et al.  Constraining Climate Sensitivity from the Seasonal Cycle in Surface Temperature , 2006 .

[122]  Ke Zhang,et al.  Ecosystem heterogeneity determines the ecological resilience of the Amazon to climate change , 2015, Proceedings of the National Academy of Sciences.

[123]  Jean-Pascal van Ypersele de Strihou Climate Change 2014 - Synthesis Report , 2015 .

[124]  P. Cox,et al.  Sensitivity of tropical carbon to climate change constrained by carbon dioxide variability , 2013, Nature.

[125]  P. Cox,et al.  Emergent constraints on climate‐carbon cycle feedbacks in the CMIP5 Earth system models , 2014 .

[126]  F. Zwiers,et al.  A new statistical approach to climate change detection and attribution , 2016, Climate Dynamics.

[127]  E. M. Volodin Relation between temperature sensitivity to doubled carbon dioxide and the distribution of clouds in current climate models , 2008 .

[128]  A. Hall,et al.  September sea-ice cover in the Arctic Ocean projected to vanish by 2100 , 2009 .

[129]  Benjamin M. Sanderson,et al.  A Multimodel Study of Parametric Uncertainty in Predictions of Climate Response to Rising Greenhouse Gas Concentrations , 2011 .

[130]  H. Douville,et al.  Land Surface Cooling Induced by Sulfate Geoengineering Constrained by Major Volcanic Eruptions , 2018, Geophysical Research Letters.

[131]  Prospects and Caveats of Weighting Climate Models for Summer Maximum Temperature Projections Over North America , 2018 .

[132]  C. Zhai,et al.  Weakening and strengthening structures in the Hadley Circulation change under global warming and implications for cloud response and climate sensitivity , 2014 .