Predicting stochastic systems by noise sampling, and application to the El Niño-Southern Oscillation

Interannual and interdecadal prediction are major challenges of climate dynamics. In this article we develop a prediction method for climate processes that exhibit low-frequency variability (LFV). The method constructs a nonlinear stochastic model from past observations and estimates a path of the “weather” noise that drives this model over previous finite-time windows. The method has two steps: (i) select noise samples—or “snippets”—from the past noise, which have forced the system during short-time intervals that resemble the LFV phase just preceding the currently observed state; and (ii) use these snippets to drive the system from the current state into the future. The method is placed in the framework of pathwise linear-response theory and is then applied to an El Niño–Southern Oscillation (ENSO) model derived by the empirical model reduction (EMR) methodology; this nonlinear model has 40 coupled, slow, and fast variables. The domain of validity of this forecasting procedure depends on the nature of the system’s pathwise response; it is shown numerically that the ENSO model’s response is linear on interannual time scales. As a result, the method’s skill at a 6- to 16-month lead is highly competitive when compared with currently used dynamic and statistic prediction methods for the Niño-3 index and the global sea surface temperature field.

[1]  V. Volterra.  Fluctuations in the Abundance of a Species considered Mathematically , 1926, Nature.

[2]  C. S. Holling,et al.  The functional response of predators to prey density and its role in mimicry and population regulation. , 1965 .

[3]  E. Lorenz.  Atmospheric Predictability as Revealed by Naturally Occurring Analogues , 1969 .

[4]  T. P. Barnett,et al.  Multifield Analog Prediction of Short-Term Climate Fluctuations Using a Climate State vector , 1978 .

[5]  G. P. King,et al.  Extracting qualitative dynamics from experimental data , 1986 .

[6]  R. Preisendorfer,et al.  Principal Component Analysis in Meteorology and Oceanography , 1988 .

[7]  R. Vautard,et al.  Singular spectrum analysis in nonlinear dynamics, with applications to paleoclimatic time series , 1989 .

[8]  M. Ghil,et al.  Interdecadal oscillations and the warming trend in global temperature time series , 1991, Nature.

[9]  Zoltan Toth,et al.  Estimation of Atmospheric Predictability by Circulation Analogs , 1991 .

[10]  Michael Ghil,et al.  Adaptive filtering and prediction of the Southern Oscillation index , 1992 .

[11]  R. Vautard,et al.  Singular-spectrum analysis: a toolkit for short, noisy chaotic signals , 1992 .

[12]  Wang Shaowu,et al.  An analogue‐dynamical long‐range numerical weather prediction system incorporating historical evolution , 1993 .

[13]  Michael Ghil,et al.  El Ni�o on the Devil's Staircase: Annual Subharmonic Steps to Chaos , 1994, Science.

[14]  H. V. D. Dool,et al.  Searching for analogues, how long must we wait? , 1994 .

[15]  M. Plank.  Hamiltonian structures for the n‐dimensional Lotka–Volterra equations , 1995 .

[16]  Michael Ghil,et al.  Quasi-quadrennial and quasi-biennial variability in the equatorial Pacific , 1995 .

[17]  Prashant D. Sardeshmukh,et al.  The Optimal Growth of Tropical Sea Surface Temperature Anomalies , 1995 .

[18]  Y. Kuznetsov.  Elements of Applied Bifurcation Theory , 2023, Applied Mathematical Sciences.

[19]  M. Allen,et al.  Distinguishing modulated oscillations from coloured noise in multivariate datasets , 1996 .

[20]  Cécile Penland,et al.  A stochastic model of IndoPacific sea surface temperature anomalies , 1996 .

[21]  Michael Ghil,et al.  Recent forecast skill for the El Niño/Southern Oscillation , 1998 .

[22]  J. David Neelin,et al.  ENSO theory , 1998 .

[23]  Balaji Rajagopalan,et al.  Analyses of global sea surface temperature 1856–1991 , 1998 .

[24]  A. Barnston,et al.  Predictive Skill of Statistical and Dynamical Climate Models in SST Forecasts during the 1997-98 El Niño Episode and the 1998 La Niña Onset. , 1999 .

[25]  The Nonnormal Nature of El Niño and Intraseasonal Variability , 1999 .

[26]  J. David Neelin,et al.  Variations in ENSO Phase Locking , 2000 .

[27]  Michael Ghil,et al.  A boolean delay equation model of ENSO variability , 2001 .

[28]  Michael Ghil,et al.  ADVANCED SPECTRAL METHODS FOR CLIMATIC TIME SERIES , 2002 .

[29]  A. Majda,et al.  Quantifying predictability in a model with statistical features of the atmosphere , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[30]  R. Kleeman.  Measuring Dynamical Prediction Utility Using Relative Entropy , 2002 .

[31]  Alexandre J. Chorin,et al.  Optimal prediction with memory , 2002 .

[32]  Michael Ghil,et al.  “Waves” vs. “particles” in the atmosphere's phase space: A pathway to long-range forecasting? , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[33]  A. Timmermann,et al.  A Nonlinear Mechanism for Decadal El NiñO Amplitude Changes , 2002 .

[34]  Michael Ghil,et al.  Multilevel Regression Modeling of Nonlinear Processes: Derivation and Applications to Climatic Variability , 2005 .

[35]  Michael Ghil,et al.  A Hierarchy of Data-Based ENSO Models , 2005 .

[36]  Michael Ghil,et al.  Empirical mode reduction in a model of extratropical low-frequency variability , 2006 .

[37]  Michael Ghil,et al.  Spatio-temporal filling of missing points in geophysical data sets , 2006 .

[38]  Michael Ghil,et al.  A delay differential model of ENSO variability: parametric instability and the distribution of extremes , 2007, 0712.1312.

[39]  Michael Ghil,et al.  Climate dynamics and fluid mechanics: Natural variability and related uncertainties , 2008, 1006.2864.

[40]  Fumio Nakajima.  The paradox of enrichment , 2008 .

[41]  S. Kravtsov.  2 Empirical model reduction and the modelling hierarchy in climate dynamics and the geosciences , 2009 .

[42]  D. Ruelle.  A review of linear response theory for general differentiable dynamical systems , 2009, 0901.0484.

[43]  Andrew J. Majda,et al.  A New Algorithm for Low-Frequency Climate Response , 2009 .

[44]  Michael Ghil,et al.  Oscillatory Climate Modes in the Eastern Mediterranean and Their Synchronization with the North Atlantic Oscillation , 2010 .

[45]  Andrew J. Majda,et al.  Linear response theory for statistical ensembles in complex systems with time-periodic forcing , 2010 .

[46]  Michael Ghil,et al.  Stochastic climate dynamics: Random attractors and time-dependent invariant measures , 2011 .

[47]  M. Ghil,et al.  Signatures of Nonlinear Dynamics in an Idealized Atmospheric Model , 2011 .

[48]  L. Roques,et al.  Probing chaos and biodiversity in a simple competition model , 2011 .