Earth System Model Evaluation Tool (ESMValTool) v2.0 – diagnostics for emergent constraints and future projections from Earth system models in CMIP

Abstract. The Earth System Model Evaluation Tool (ESMValTool), a community diagnostics and performance metrics tool for evaluation and analysis of Earth system models (ESMs) is designed to facilitate a more comprehensive and rapid comparison of single or multiple models participating in the coupled model intercomparison project (CMIP). The ESM results can be compared against observations or reanalysis data as well as against other models including predecessor versions of the same model. The updated and extended version 2.0 of the ESMValTool includes several new analysis scripts such as large-scale diagnostics for evaluation of ESMs as well as diagnostics for extreme events, regional model and impact evaluation. In this paper, the newly implemented climate metrics such as effective climate sensitivity (ECS) and transient climate response (TCR) as well as emergent constraints for various climate-relevant feedbacks and diagnostics for future projections from ESMs are described and illustrated with examples using results from the well-established model ensemble CMIP5. The emergent constraints implemented include ECS, snow-albedo effect, climate-carbon cycle feedback, hydrologic cycle intensification, future Indian summer monsoon precipitation, and year of disappearance of summer Arctic sea ice. The diagnostics included in ESMValTool v2.0 to analyze future climate projections from ESMs include analysis scripts to reproduce selected figures of chapter 12 of the Intergovernmental Panel on Climate Change’s (IPCC) Fifth Assessment report (AR5) and various multi-model statistics.

[1]  Y. Hong,et al.  The TRMM Multisatellite Precipitation Analysis (TMPA): Quasi-Global, Multiyear, Combined-Sensor Precipitation Estimates at Fine Scales , 2007 .

[2]  양민선.  IPCC(Intergovernmental Panel on climate Change) 외 , 2008 .

[3]  David R. Doelling,et al.  Observed changes in top-of-the-atmosphere radiation and upper-ocean heating consistent within uncertainty , 2012 .

[4]  P. Cox,et al.  Sensitivity of tropical carbon to climate change constrained by carbon dioxide variability , 2013, Nature.

[5]  Klaus Zimmermann,et al.  Earth System Model Evaluation Tool (ESMValTool) v2.0 – technical overview , 2020, Geoscientific Model Development.

[6]  P. Cox,et al.  Emergent constraints on climate‐carbon cycle feedbacks in the CMIP5 Earth system models , 2014 .

[7]  E. M. Volodin.  Relation between temperature sensitivity to doubled carbon dioxide and the distribution of clouds in current climate models , 2008 .

[8]  Claire E. Bulgin,et al.  Sea surface temperature datasets for climate applications from Phase 1 of the European Space Agency Climate Change Initiative (SST CCI) , 2014 .

[9]  W. Collins,et al.  Evaluation of climate models , 2013 .

[10]  P. Cox,et al.  Projected land photosynthesis constrained by changes in the seasonal cycle of atmospheric CO2 , 2016, Nature.

[11]  K. Hasselmann.  Stochastic climate models Part I. Theory , 1976 .

[12]  M. Kimoto,et al.  Precipitation Reproducibility over Tropical Oceans and Its Relationship to the Double ITCZ Problem in CMIP3 and MIROC5 Climate Models , 2011 .

[13]  Nuno Carvalhais,et al.  Review on ESMValTool v2.0 – Extended set of large-scale diagnostics for quasi-operational and comprehensive evaluation of Earth system models in CMIP , 2019 .

[14]  Jonathan M. Gregory,et al.  Transient climate response estimated from radiative forcing and observed temperature change , 2008 .

[15]  John M. Haynes,et al.  COSP: Satellite simulation software for model assessment , 2011 .

[16]  Elizabeth C. Kent,et al.  Global analyses of sea surface temperature, sea ice, and night marine air temperature since the late nineteenth century , 2003 .

[17]  J. Thepaut,et al.  The ERA‐Interim reanalysis: configuration and performance of the data assimilation system , 2011 .

[18]  G. Tselioudis,et al.  CMIP5 models' shortwave cloud radiative response and climate sensitivity linked to the climatological Hadley cell extent , 2017, Geophysical research letters.

[19]  A. Hall,et al.  Using the current seasonal cycle to constrain snow albedo feedback in future climate change , 2006 .

[20]  S. Gualdi,et al.  The Double-ITCZ Syndrome in Coupled General Circulation Models: The Role of Large-Scale Vertical Circulation Regimes , 2010 .

[21]  Bettina K. Gier,et al.  Taking climate model evaluation to the next level , 2019, Nature Climate Change.

[22]  Veronika Eyring,et al.  Evaluation of Climate Models. In: Climate Change 2013: The Physical Science Basis. Contribution of Working Group I to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change , 2013 .

[23]  M. Schulz,et al.  On the spatio-temporal representativeness of observations , 2017 .

[24]  Simon Read,et al.  ESMValTool (v1.0) – a community diagnostic and performance metrics tool for routine evaluation of Earth system models in CMIP , 2015 .

[25]  J. Fyfe,et al.  Ice-free Arctic projections under the Paris Agreement , 2018, Nature Climate Change.

[26]  Christopher D. Barnet,et al.  Accuracy of geophysical parameters derived from Atmospheric Infrared Sounder/Advanced Microwave Sounding Unit as a function of fractional cloud cover , 2006 .

[27]  S. Bony,et al.  Spread in model climate sensitivity traced to atmospheric convective mixing , 2014, Nature.

[28]  William B. Rossow,et al.  The International Satellite Cloud Climatology Project H-Series climate data record product , 2017 .

[29]  A. Lauer,et al.  Constraining Uncertainties in CMIP5 Projections of September Arctic Sea Ice Extent with Observations , 2020, Journal of Climate.

[30]  N. Loeb,et al.  Surface Irradiances Consistent With CERES-Derived Top-of-Atmosphere Shortwave and Longwave Irradiances , 2013 .

[31]  P. Cox,et al.  Emergent constraint on equilibrium climate sensitivity from global temperature variability , 2018, Nature.

[32]  Veronika Eyring,et al.  Constraining Future Summer Austral Jet Stream Positions in the CMIP5 Ensemble by Process-Oriented Multiple Diagnostic Regression* , 2016 .

[33]  François Massonnet,et al.  Using climate models to estimate the quality of global observational data sets , 2016, Science.

[34]  F. Wentz,et al.  How Much More Rain Will Global Warming Bring? , 2007, Science.

[35]  P. Jones,et al.  Quantifying uncertainties in global and regional temperature change using an ensemble of observational estimates: The HadCRUT4 data set , 2012 .

[36]  C. Tebaldi,et al.  Long-term Climate Change: Projections, Commitments and Irreversibility , 2013 .

[37]  David R. Doelling,et al.  Toward Optimal Closure of the Earth's Top-of-Atmosphere Radiation Budget , 2009 .

[38]  W. Rossow,et al.  ISCCP Cloud Data Products , 1991 .

[39]  Mark A. Liniger,et al.  Can multi‐model combination really enhance the prediction skill of probabilistic ensemble forecasts? , 2007 .

[40]  T. Schneider,et al.  Constraints on Climate Sensitivity from Space-Based Measurements of Low-Cloud Reflection , 2016 .

[41]  Karl E. Taylor,et al.  An overview of CMIP5 and the experiment design , 2012 .

[42]  Francisco J. Doblas-Reyes,et al.  Uncertainty propagation in observational references to climate model scales , 2017 .

[43]  Atul K. Jain,et al.  Global Carbon Budget 2018 , 2014, Earth System Science Data.

[44]  S. Xie,et al.  Western Pacific emergent constraint lowers projected increase in Indian summer monsoon rainfall. , 2017 .

[45]  Reto Knutti,et al.  A Representative Democracy to Reduce Interdependency in a Multimodel Ensemble , 2015 .

[46]  R. Schnur,et al.  Climate-carbon cycle feedback analysis: Results from the C , 2006 .

[47]  Nuno Carvalhais,et al.  Earth System Model Evaluation Tool (ESMValTool) v2.0 – an extended set of large-scale diagnostics for quasi-operational and comprehensive evaluation of Earth system models in CMIP , 2020, Geoscientific Model Development.

[48]  R. Reynolds,et al.  The NCEP/NCAR 40-Year Reanalysis Project , 1996, Renewable Energy.

[49]  M. Holland,et al.  Constraining projections of summer Arctic sea ice , 2012 .

[50]  M. Zelinka,et al.  An observational radiative constraint on hydrologic cycle intensification , 2015, Nature.

[51]  Brian C. O'Neill,et al.  The Scenario Model Intercomparison Project (ScenarioMIP) for CMIP6 , 2016 .

[52]  Jonathan M. Gregory,et al.  A new method for diagnosing radiative forcing and climate sensitivity , 2004 .

[53]  J. Janowiak,et al.  The Version 2 Global Precipitation Climatology Project (GPCP) Monthly Precipitation Analysis (1979-Present) , 2003 .

[54]  B. Tian.  Spread of model climate sensitivity linked to double‐Intertropical Convergence Zone bias , 2015 .

[55]  Veronika Eyring,et al.  Overview of the Coupled Model Intercomparison Project Phase 6 (CMIP6) experimental design and organization , 2015 .

[56]  Ruth Lorenz,et al.  A climate model projection weighting scheme accounting for performance and interdependence , 2017 .

[57]  Benjamin Müller,et al.  Benchmarking CMIP5 models with a subset of ESA CCI Phase 2 data using the ESMValTool , 2017 .

[58]  A. Lacis,et al.  Calculation of radiative fluxes from the surface to top of atmosphere based on ISCCP and other global data sets: Refinements of the radiative transfer model and the input data , 2004 .

[59]  Muyin Wang,et al.  A sea ice free summer Arctic within 30 years? , 2009 .