Causal networks for climate model evaluation and constrained projections

Global climate models are central tools for understanding past and future climate change. The assessment of model skill, in turn, can benefit from modern data science approaches. Here we apply causal discovery algorithms to sea level pressure data from a large set of climate model simulations and, as a proxy for observations, meteorological reanalyses. We demonstrate how the resulting causal networks (fingerprints) offer an objective pathway for process-oriented model evaluation. Models with fingerprints closer to observations better reproduce important precipitation patterns over highly populated areas such as the Indian subcontinent, Africa, East Asia, Europe and North America. We further identify expected model interdependencies due to shared development backgrounds. Finally, our network metrics provide stronger relationships for constraining precipitation projections under climate change as compared to traditional evaluation metrics for storm tracks or precipitation itself. Such emergent relationships highlight the potential of causal networks to constrain longstanding uncertainties in climate change projections. Algorithms to assess causal relationships in data sets have seen increasing applications in climate science in recent years. Here, the authors show that these techniques can help to systematically evaluate the performance of climate models and, as a result, to constrain uncertainties in future climate change projections.

[1]  Bettina K. Gier,et al.  Taking climate model evaluation to the next level , 2019, Nature Climate Change.

[2]  Drew T. Shindell,et al.  Climate response to regional radiative forcing during the twentieth century , 2009 .

[3]  Annette Osprey,et al.  A large ozone-circulation feedback and its implications for global warming assessments , 2014, Nature climate change.

[4]  Philippe Ciais,et al.  European land CO2 sink influenced by NAO and East-Atlantic Pattern coupling , 2016, Nature Communications.

[5]  Masson-Delmotte,et al.  The Physical Science Basis , 2007 .

[6]  Reto Knutti,et al.  Addressing interdependency in a multimodel ensemble by interpolation of model properties , 2015 .

[7]  J. Lamarque,et al.  The HadGEM2-ES implementation of CMIP5 centennial simulations , 2011 .

[8]  R. Knutti,et al.  Skill and independence weighting for multi-model assessments , 2016 .

[9]  R. Reynolds,et al.  The NCEP/NCAR 40-Year Reanalysis Project , 1996, Renewable Energy.

[10]  Simon Read,et al.  ESMValTool (v1.0) – a community diagnostic and performance metrics tool for routine evaluation of Earth system models in CMIP , 2015 .

[11]  Kevin E. Trenberth,et al.  Progress during TOGA in understanding and modeling global teleconnections associated with tropical sea surface temperatures , 1998 .

[12]  C. Bishop,et al.  Climate Model Dependence and the Ensemble Dependence Transformation of CMIP Projections , 2015 .

[13]  Peter Braesicke,et al.  The Impact of Stratospheric Ozone Feedbacks on Climate Sensitivity Estimates , 2018 .

[14]  Ruth Lorenz,et al.  A climate model projection weighting scheme accounting for performance and interdependence , 2017 .

[15]  S. McGregor,et al.  The influence of non-stationary teleconnections on palaeoclimate reconstructions of ENSO variance using a pseudoproxy framework , 2015 .

[16]  Veronika Eyring,et al.  A Strategy for Process-Oriented Validation of Coupled Chemistry- Climate Models , 2005 .

[17]  Peter Spirtes,et al.  Introduction to Causal Inference , 2010, J. Mach. Learn. Res..

[18]  V. Brovkin,et al.  Impact of soil moisture‐climate feedbacks on CMIP5 projections: First results from the GLACE‐CMIP5 experiment , 2013 .

[19]  C. Jones,et al.  Development and evaluation of an Earth-System model - HadGEM2 , 2011 .

[20]  Ian T. Jolliffe,et al.  Empirical orthogonal functions and related techniques in atmospheric science: A review , 2007 .

[21]  Jonathan F. Donges,et al.  Using Causal Effect Networks to Analyze Different Arctic Drivers of Midlatitude Winter Circulation , 2016 .

[22]  Jakob Runge,et al.  Early prediction of extreme stratospheric polar vortex states based on causal precursors , 2017 .

[23]  Andrew Gettelman,et al.  The Art and Science of Climate Model Tuning , 2017 .

[24]  Corinne Le Quéré,et al.  Climate Change 2013: The Physical Science Basis , 2013 .

[25]  Veronika Eyring,et al.  Overview of the Coupled Model Intercomparison Project Phase 6 (CMIP6) experimental design and organization , 2015 .

[26]  H. Kaiser The varimax criterion for analytic rotation in factor analysis , 1958 .

[27]  Imme Ebert-Uphoff,et al.  Causal Discovery for Climate Research Using Graphical Models , 2012 .

[28]  Francis W. Zwiers,et al.  Patterns of change: whose fingerprint is seen in global warming? , 2011 .

[29]  Joëlle Gergis,et al.  Long-term stationarity of El Niño–Southern Oscillation teleconnections in southeastern Australia , 2016, Climate Dynamics.

[30]  Milan Paluš,et al.  Non-random correlation structures and dimensionality reduction in multivariate climate data , 2015, Climate Dynamics.

[31]  U. Ulbrich,et al.  Changing Northern Hemisphere Storm Tracks in an Ensemble of IPCC Climate Change Simulations , 2008 .

[32]  A. Banerjee,et al.  Climate Informatics , 2013 .

[33]  Elizabeth A. Stuart,et al.  Introduction to Causal Inference Approaches , 2019, Health Services Evaluation.

[34]  Sang-Wook Yeh,et al.  ENSO Atmospheric Teleconnections and Their Response to Greenhouse Gas Forcing , 2018 .

[35]  S. Bony,et al.  Spread in model climate sensitivity traced to atmospheric convective mixing , 2014, Nature.

[36]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[37]  P. Nowack,et al.  Using machine learning to build temperature-based ozone parameterizations for climate sensitivity simulations , 2018, Environmental Research Letters.

[38]  J. Bjerknes ATMOSPHERIC TELECONNECTIONS FROM THE EQUATORIAL PACIFIC1 , 1969 .

[39]  Tamas Bodai,et al.  Predictability of threshold exceedances in dynamical systems , 2014, 1408.1001.

[40]  I. Ebert‐Uphoff,et al.  A new type of climate network based on probabilistic graphical models: Results of boreal winter versus summer , 2012 .

[41]  David J. Karoly,et al.  Southern Hemisphere Circulation Features Associated with El Niño-Southern Oscillation Events , 1989 .

[42]  Nitesh V. Chawla,et al.  Computational Intelligent Data Analysis for Sustainable Development , 2013 .

[43]  M. Blackmon,et al.  A Climatological Spectral Study of the 500 mb Geopotential Height of the Northern Hemisphere. , 1976 .

[44]  J. David Neelin,et al.  Analyzing ENSO Teleconnections in CMIP Models as a Measure of Model Fidelity in Simulating Precipitation , 2013 .

[45]  J Runge,et al.  Causal network reconstruction from time series: From theoretical assumptions to practical estimation. , 2018, Chaos.

[46]  P. Jones,et al.  Updated high‐resolution grids of monthly climatic observations – the CRU TS3.10 Dataset , 2014 .

[47]  L. Chen,et al.  A comprehensive evaluation of precipitation simulations over China based on CMIP5 multimodel ensemble projections , 2014 .

[48]  Joachim Denzler,et al.  Deep learning and process understanding for data-driven Earth system science , 2019, Nature.

[49]  W. Collins,et al.  Evaluation of climate models , 2013 .

[50]  Michael P. Byrne,et al.  Trends in continental temperature and humidity directly linked to ocean warming , 2018, Proceedings of the National Academy of Sciences.

[51]  Bryan Lawrence,et al.  Storing and manipulating environmental big data with JASMIN , 2013, 2013 IEEE International Conference on Big Data.

[52]  R. Vautard,et al.  Singular spectrum analysis in nonlinear dynamics, with applications to paleoclimatic time series , 1989 .

[53]  Dino Sejdinovic,et al.  Detecting and quantifying causal associations in large nonlinear time series datasets , 2017, Science Advances.

[54]  Yohai Kaspi,et al.  Challenges and opportunities for improved understanding of regional climate dynamics , 2018, Nature Climate Change.

[55]  B. Santer,et al.  Detecting greenhouse-gas-induced climate change with an optimal fingerprint method , 1996 .

[56]  Jürgen Kurths,et al.  Identifying causal gateways and mediators in complex spatio-temporal systems , 2015, Nature Communications.

[57]  Veronika Eyring,et al.  Constraining Future Summer Austral Jet Stream Positions in the CMIP5 Ensemble by Process-Oriented Multiple Diagnostic Regression* , 2016 .

[58]  Jürgen Kurths,et al.  Complex networks reveal global pattern of extreme-rainfall teleconnections , 2019, Nature.

[59]  Jorgen S. Frederiksen,et al.  Review of Tropical‐Extratropical Teleconnections on Intraseasonal Time Scales , 2017 .

[60]  Reto Knutti,et al.  The end of model democracy? , 2010 .

[61]  Richard J. Graham,et al.  Can climate projection uncertainty be constrained over Africa using metrics of contemporary performance? , 2016, Climatic Change.

[62]  Stephen A. Klein,et al.  Progressing emergent constraints on future climate change , 2019, Nature Climate Change.

[63]  Pierre Friedlingstein,et al.  Uncertainties in CMIP5 Climate Projections due to Carbon Cycle Feedbacks , 2014 .

[64]  J. Thepaut,et al.  The ERA‐Interim reanalysis: configuration and performance of the data assimilation system , 2011 .

[65]  T. Shepherd Atmospheric circulation as a source of uncertainty in climate change projections , 2014 .

[66]  Angelo Riccio,et al.  Stratosphere-resolving CMIP5 models simulate different changes in the Southern Hemisphere , 2018, Climate Dynamics.

[67]  K. Taylor,et al.  The Community Climate System Model , 2001 .

[68]  Ilias Fountalis,et al.  Dimensionality Reduction and Network Inference for Climate Data Using δ‐MAPS: Application to the CESM Large Ensemble Sea Surface Temperature , 2019, Journal of Advances in Modeling Earth Systems.

[69]  UK,et al.  The forced response of the El Niño–Southern Oscillation-Indian monsoon teleconnection in ensembles of Earth System Models , 2018, Journal of Climate.

[70]  K. Taylor Summarizing multiple aspects of model performance in a single diagram , 2001 .

[71]  Veronika Eyring,et al.  Evaluation of Climate Models. In: Climate Change 2013: The Physical Science Basis. Contribution of Working Group I to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change , 2013 .

[72]  R. Knutti,et al.  Robustness and uncertainties in the new CMIP5 climate model projections , 2013 .

[73]  E. Guilyardi,et al.  ENSO representation in climate models: from CMIP3 to CMIP5 , 2013, Climate Dynamics.

[74]  Peter Braesicke,et al.  On the role of ozone feedback in the ENSO amplitude response under global warming , 2017, Geophysical research letters.

[75]  C. Bishop,et al.  Climate model dependence and the replicate Earth paradigm , 2013, Climate Dynamics.

[76]  Andrew Charlton-Perez,et al.  Stratospheric Communication of El Niño Teleconnections to European Winter , 2009 .

[77]  Peter Braesicke,et al.  Might dimming the sun change atmospheric ENSO teleconnections as we know them , 2011 .

[78]  W. Kruskal,et al.  Use of Ranks in One-Criterion Variance Analysis , 1952 .

[79]  Robert C. Wolpert,et al.  A Review of the , 1985 .

[80]  Karl E. Taylor,et al.  An overview of CMIP5 and the experiment design , 2012 .

[81]  Imme Ebert-Uphoff,et al.  Weakening of atmospheric information flow in a warming climate in the Community Climate System Model , 2014 .

[82]  Bernhard Schölkopf,et al.  Inferring causation from time series in Earth system sciences , 2019, Nature Communications.