Learning forecasts of rare stratospheric transitions from short simulations

Rare events arising in nonlinear atmospheric dynamics remain hard to predict and attribute. We address the problem of forecasting rare events in a prototypical example, Sudden Stratospheric Warmings (SSWs). Approximately once every other winter, the boreal stratospheric polar vortex rapidly breaks down, shifting midlatitude surface weather patterns for months. We focus on two key quantities of interest: the probability of an SSW occurring, and the expected lead time if it does occur, as functions of initial condition. These optimal forecasts concretely measure the event’s progress. Direct numerical simulation can estimate them in principle, but is prohibitively expensive in practice: each rare event requires a long integration to observe, and the cost of each integration grows with model complexity. We describe an alternative approach using integrations that are short compared to the timescale of the warming event. We compute the probability and lead time efficiently by solving equations involving the transition operator, which encodes all information about the dynamics. We relate these optimal forecasts to a small number of interpretable physical variables, suggesting optimal measurements for forecasting. We illustrate the methodology on a prototype SSW model developed by Holton and Mass (1976) and modified by stochastic forcing. While highly idealized, this model captures the essential nonlinear dynamics of SSWs and exhibits the key forecasting challenge: the dramatic separation in timescales between a single event and the return time between successive events. Our methodology is designed to fully exploit high-dimensional data from models and observations, and has the potential to identify detailed predictors of many complex rare events in meteorology.

[1]  Valerio Lucarini A New Mathematical Framework for Atmospheric Blocking Events , 2021 .

[2]  D. Giannakis,et al.  Koopman analysis of the long-term evolution in a turbulent convection cell , 2018, Journal of Fluid Mechanics.

[3]  S. Yoden Bifurcation Properties of a Stratospheric Vacillation Model , 1987 .

[4]  Prabhat,et al.  Physics-informed machine learning: case studies for weather and climate modelling , 2021, Philosophical Transactions of the Royal Society A.

[5]  S. Yoden Dynamical Aspects of Stratospheric Vacillations in a Highly Truncated Model. , 1987 .

[6]  Themistoklis P. Sapsis,et al.  Sequential sampling strategy for extreme event statistics in nonlinear dynamical systems , 2018, Proceedings of the National Academy of Sciences.

[7]  J. Charney,et al.  Multiple Flow Equilibria in the Atmosphere and Blocking , 1979 .

[8]  Matthias Troyer,et al.  Solving the quantum many-body problem with artificial neural networks , 2016, Science.

[9]  Daniel N. Baker,et al.  Simulation of the 23 July 2012 extreme space weather event: What if this extremely rare CME was Earth directed? , 2013 .

[10]  F. Bouchet,et al.  Computation of extreme heat waves in climate models using a large deviation algorithm , 2017, Proceedings of the National Academy of Sciences.

[11]  A. Timmermann,et al.  A Nonlinear Theory for El Niño Bursting , 2003 .

[12]  Valerio Lucarini,et al.  Effects of stochastic parametrization on extreme value statistics. , 2019, Chaos.

[13]  Georg A. Gottwald,et al.  Stochastic Climate Theory , 2016, 1612.07474.

[14]  Christopher Grassotti,et al.  The Response of Damaging Winds of a Simulated Tropical Cyclone to Finite-Amplitude Perturbations of Different Variables , 2006 .

[15]  L. Polvani,et al.  A New Look at Stratospheric Sudden Warmings. Part I: Climatology and Modeling Benchmarks , 2007 .

[16]  Brian F. Farrell,et al.  A Stochastically Excited Linear System as a Model for Quasigeostrophic Turbulence:Analytic Results for One- and Two-Layer Fluids , 1995 .

[17]  E. Lorenz Deterministic nonperiodic flow , 1963 .

[18]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[19]  Nan Chen,et al.  An MCMC Algorithm for Parameter Estimation in Signals with Hidden Intermittent Instability , 2014, SIAM/ASA J. Uncertain. Quantification.

[20]  Frederic Vitart,et al.  The sub-seasonal to seasonal prediction project (S2S) and the prediction of extreme events , 2018, npj Climate and Atmospheric Science.

[21]  V. Lucarini,et al.  A new mathematical framework for atmospheric blocking events , 2019, Climate Dynamics.

[22]  Eric Vanden-Eijnden,et al.  Rogue waves and large deviations in deep sea , 2017, Proceedings of the National Academy of Sciences.

[23]  B. Øksendal Stochastic differential equations : an introduction with applications , 1987 .

[24]  Frank Noé,et al.  Markov state models of biomolecular conformational dynamics. , 2014, Current opinion in structural biology.

[25]  Karthik Kashinath,et al.  Towards physically consistent data-driven weather forecasting: Integrating data assimilation with equivariance-preserving deep spatial transformers , 2021, ArXiv.

[26]  P. Koltai,et al.  Transition paths of marine debris and the stability of the garbage patches. , 2020, Chaos.

[27]  Erik H. Thiede,et al.  Galerkin approximation of dynamical quantities using trajectory data. , 2018, The Journal of chemical physics.

[28]  PierGianLuca Porta Mana,et al.  Toward a stochastic parameterization of ocean mesoscale eddies , 2014 .

[29]  Xiongzhi Chen Brownian Motion and Stochastic Calculus , 2008 .

[30]  Amy H. Butler,et al.  Defining Sudden Stratospheric Warmings , 2015 .

[31]  V. Pande,et al.  Using massively parallel simulation and Markovian models to study protein folding: examining the dynamics of the villin headpiece. , 2006, The Journal of chemical physics.

[32]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[33]  Andrew J. Majda,et al.  Beating the curse of dimension with accurate statistics for the Fokker–Planck equation in complex turbulent systems , 2017, Proceedings of the National Academy of Sciences.

[34]  T. Sapsis Statistics of Extreme Events in Fluid Flows and Waves , 2021 .

[35]  Bo Lin,et al.  Computing Committor Functions for the Study of Rare Events Using Deep Learning , 2018, The Journal of Chemical Physics.

[36]  J. G. Esler,et al.  Noise‐induced vortex‐splitting stratospheric sudden warmings , 2019, Quarterly Journal of the Royal Meteorological Society.

[37]  A. Majda,et al.  Predicting observed and hidden extreme events in complex nonlinear dynamical systems with partial observations and short training time series. , 2020, Chaos.

[38]  Jonathan Weare,et al.  Particle filtering with path sampling and an application to a bimodal ocean current model , 2009, J. Comput. Phys..

[39]  Michael Ghil,et al.  Persistent Anomalies, Blocking and Variations in Atmospheric Predictability , 1985 .

[40]  R. Durrett Probability: Theory and Examples , 1993 .

[41]  Grant M. Rotskoff,et al.  Learning with rare data: Using active importance sampling to optimize objectives dominated by rare events , 2020, 2008.06334.

[42]  J. Kurths,et al.  Statistical analysis of tipping pathways in agent-based models , 2021, The European Physical Journal Special Topics.

[43]  F. Bouchet,et al.  Computation of Extreme Values of Time Averaged Observables in Climate Models with Large Deviation Techniques , 2019, Journal of Statistical Physics.

[44]  Eric Vanden-Eijnden,et al.  Experimental Evidence of Hydrodynamic Instantons: The Universal Route to Rogue Waves , 2019, Physical Review X.

[45]  Lexing Ying,et al.  Solving for high-dimensional committor functions using artificial neural networks , 2018, Research in the Mathematical Sciences.

[46]  E. Vanden-Eijnden,et al.  Data Assimilation in the Low Noise Regime with Application to the Kuroshio , 2012, 1202.4952.

[47]  C. Mass,et al.  Stratospheric Vacillation Cycles , 1976 .

[48]  E. Fischer,et al.  Influence of blocking on Northern European and Western Russian heatwaves in large climate model ensembles , 2018 .

[49]  B. Christiansen Chaos, Quasiperiodicity, and Interannual Variability: Studies of a Stratospheric Vacillation Model , 2000 .

[50]  C. Schütte,et al.  Supplementary Information for “ Constructing the Equilibrium Ensemble of Folding Pathways from Short Off-Equilibrium Simulations ” , 2009 .

[51]  F. Bouchet,et al.  A New Interpretation of Vortex-Split Sudden Stratospheric Warmings in Terms of Equilibrium Statistical Mechanics , 2017, 1702.03716.

[52]  Jonathan Weare,et al.  Path Properties of Atmospheric Transitions: Illustration with a Low-Order Sudden Stratospheric Warming Model , 2020, Journal of the Atmospheric Sciences.

[53]  Fei Lu,et al.  Data-driven model reduction, Wiener projections, and the Koopman-Mori-Zwanzig formalism , 2019, J. Comput. Phys..

[54]  Martin Leutbecher,et al.  A Spectral Stochastic Kinetic Energy Backscatter Scheme and Its Impact on Flow-Dependent Predictability in the ECMWF Ensemble Prediction System , 2009 .

[55]  Chatipat Lorpaiboon,et al.  Long-Time-Scale Predictions from Short-Trajectory Data: A Benchmark Analysis of the Trp-Cage Miniprotein. , 2020, Journal of chemical theory and computation.

[56]  J. G. Charney,et al.  Propagation of planetary‐scale disturbances from the lower into the upper atmosphere , 1961 .

[57]  Eric Vanden-Eijnden,et al.  Transition-path theory and path-finding algorithms for the study of rare events. , 2010, Annual review of physical chemistry.

[58]  R. Zwanzig Nonequilibrium statistical mechanics , 2001, Physics Subject Headings (PhySH).

[59]  Vijay S. Pande,et al.  Everything you wanted to know about Markov State Models but were afraid to ask. , 2010, Methods.

[60]  Andrew J. Majda,et al.  Low-Order Stochastic Mode Reduction for a Prototype Atmospheric GCM , 2006 .

[61]  T. Birner,et al.  Sudden Stratospheric Warmings as Noise-Induced Transitions , 2008 .

[62]  Andrew J. Majda,et al.  A mathematical framework for stochastic climate models , 2001 .

[63]  John D. Chodera,et al.  Long-Time Protein Folding Dynamics from Short-Time Molecular Dynamics Simulations , 2006, Multiscale Model. Simul..

[64]  T. Sapsis,et al.  A variational approach to probing extreme events in turbulent dynamical systems , 2017, Science Advances.

[65]  Paris Perdikaris,et al.  Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations , 2019, J. Comput. Phys..

[66]  F. Bouchet,et al.  Multistability and rare spontaneous transitions between climate and jet configurations in a barotropic model of the Jovian mid-latitude troposphere , 2020 .

[67]  Timothy D. Sauer,et al.  Time-Scale Separation from Diffusion-Mapped Delay Coordinates , 2013, SIAM J. Appl. Dyn. Syst..

[68]  A. Majda,et al.  Extraction and prediction of indices for monsoon intraseasonal oscillations: an approach based on nonlinear Laplacian spectral analysis , 2017, Climate Dynamics.

[69]  K. Hasselmann Stochastic climate models Part I. Theory , 1976 .

[70]  F. Noé,et al.  Collective variables for the study of long-time kinetics from molecular trajectories: theory and methods. , 2017, Current opinion in structural biology.

[71]  Francis W. Zwiers,et al.  Edinburgh Research Explorer Understanding, modeling and predicting weather and climate extremes: Challenges and opportunities , 2022 .

[72]  Alexis Tantet,et al.  An early warning indicator for atmospheric blocking events using transfer operators. , 2015, Chaos.

[73]  Andrew J. Majda,et al.  Strategies for Reduced-Order Models for Predicting the Statistical Responses and Uncertainty Quantification in Complex Turbulent Dynamical Systems , 2018, SIAM Rev..

[74]  W. E,et al.  Towards a Theory of Transition Paths , 2006 .

[75]  Hao Wu,et al.  VAMPnets for deep learning of molecular kinetics , 2017, Nature Communications.

[76]  Bruno Tuffin,et al.  Rare events, splitting, and quasi-Monte Carlo , 2007, TOMC.

[77]  R. Binzel The Torino Impact Hazard Scale , 2000 .

[78]  A. Ruzmaikin,et al.  A Simple Model of Stratospheric Dynamics Including Solar Variability , 2003 .

[79]  Freddy Bouchet,et al.  Control and instanton trajectories for random transitions in turbulent flows , 2011 .

[80]  Frank Noé,et al.  An Introduction to Markov State Models and Their Application to Long Timescale Molecular Simulation , 2014, Advances in Experimental Medicine and Biology.

[81]  Freddy Bouchet,et al.  Langevin Dynamics, Large Deviations and Instantons for the Quasi-Geostrophic Model and Two-Dimensional Euler Equations , 2014, 1403.0216.

[82]  Arnulf Jentzen,et al.  Solving high-dimensional partial differential equations using deep learning , 2017, Proceedings of the National Academy of Sciences.

[83]  A. Majda,et al.  Nonlinear Laplacian spectral analysis for time series with intermittency and low-frequency variability , 2012, Proceedings of the National Academy of Sciences.

[84]  Fuqing Zhang,et al.  Effects of Moist Convection on Hurricane Predictability , 2009 .

[85]  F. Noé,et al.  Transition networks for modeling the kinetics of conformational change in macromolecules. , 2008, Current opinion in structural biology.

[86]  D. Abbot,et al.  Maximizing Simulated Tropical Cyclone Intensity With Action Minimization , 2019, Journal of Advances in Modeling Earth Systems.

[87]  Ashesh Chattopadhyay,et al.  Analog forecasting of extreme-causing weather patterns using deep learning , 2019, ArXiv.

[88]  D. Giannakis,et al.  Nonparametric forecasting of low-dimensional dynamical systems. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[89]  T. Matsuno,et al.  A Dynamical Model of the Stratospheric Sudden Warming , 1971 .

[90]  Eric Vanden-Eijnden,et al.  Transition Path Theory for Markov Jump Processes , 2009, Multiscale Model. Simul..

[91]  Stefan Duffner,et al.  Machine Learning of committor functions for predicting high impact climate events , 2019, 1910.11736.

[92]  Daan Crommelin,et al.  Regime Transitions and Heteroclinic Connections in a Barotropic Atmosphere , 2003 .

[93]  Lexing Ying,et al.  Solving for high dimensional committor functions using neural network with online approximation to derivatives , 2020, ArXiv.

[94]  Freddy Bouchet,et al.  Rare Event Sampling Methods. , 2019, Chaos.

[95]  Thomas Bolton,et al.  Applications of Deep Learning to Ocean Data Inference and Subgrid Parameterization , 2019, Journal of Advances in Modeling Earth Systems.

[96]  Philipp Metzner,et al.  Illustration of transition path theory on a collection of simple examples. , 2006, The Journal of chemical physics.

[97]  Ilias Bilionis,et al.  Probabilistic solvers for partial differential equations , 2016, 1607.03526.

[98]  F. Bouchet,et al.  Rare Event Algorithm Links Transitions in Turbulent Flows with Activated Nucleations. , 2018, Physical Review Letters.

[99]  J. Pitman,et al.  Kac's moment formula and the Feynman-Kac formula for additive functionals of a Markov process , 1999 .

[100]  Aaron R. Dinner,et al.  Integrated Variational Approach to Conformational Dynamics: A Robust Strategy for Identifying Eigenfunctions of Dynamical Operators , 2020 .

[101]  T. Birner,et al.  Stratospheric Wave-Mean Flow Feedbacks and Sudden Stratospheric Warmings in a Simple Model Forced by Upward Wave Activity Flux , 2014 .

[102]  Jonathan Weare,et al.  Practical rare event sampling for extreme mesoscale weather. , 2019, Chaos.