S2S reboot: An argument for greater inclusion of machine learning in subseasonal to seasonal forecasts

The discipline of seasonal climate prediction began as an exercise in simple statistical techniques. However, today the large government forecast centers almost exclusively rely on complex fully coupled dynamical forecast systems for their subseasonal to seasonal (S2S) predictions while statistical techniques are mostly neglected and those techniques still in use have not been updated in decades. In this Opinion Article, we argue that new statistical techniques mostly developed outside the field of climate science, collectively referred to as machine learning, can be adopted by climate forecasters to increase the accuracy of S2S predictions. We present an example of where unsupervised learning demonstrates higher accuracy in a seasonal prediction than the state-of-the-art dynamical systems. We also summarize some relevant machine learning methods that are most applicable to climate prediction. Finally, we show by comparing real-time dynamical model forecasts with observations from winter 2017/2018 that dynamical model forecasts are almost entirely insensitive to polar vortex (PV) variability and the impact on sensible weather. Instead, statistical forecasts more accurately predicted the resultant sensible weather from a mid-winter PV disruption than the dynamical forecasts. The important implication from the poor dynamical forecasts is that if Arctic change influences mid-latitude weather through PV variability, then the ability of dynamical models to demonstrate the existence of such a pathway is compromised. We conclude by suggesting that S2S prediction will be most beneficial to the public by incorporating mixed or a hybrid of dynamical forecasts and updated statistical techniques such as machine learning. This article is categorized under: Climate Models and Modeling > Knowledge Generation with Models.

[1]  J. García-Serrano,et al.  The Influence of Autumnal Eurasian Snow Cover on Climate and Its Link with Arctic Sea Ice Cover , 2017 .

[2]  Xiaofeng Meng,et al.  Wind Power Forecasts Using Gaussian Processes and Numerical Weather Prediction , 2014, IEEE Transactions on Power Systems.

[3]  A. Troccoli,et al.  Seasonal climate forecasting , 2010 .

[4]  Jong-Seong Kug,et al.  Seasonal climate predictability with Tier-one and Tier-two prediction systems , 2008 .

[5]  A. James Wagner,et al.  Medium- and Long-Range Forecasting , 1989 .

[6]  T. Barnett,et al.  Long-Lead Seasonal ForecastsWhere Do We Stand? , 1994 .

[7]  Hengchun Ye,et al.  Trends and variability in rain‐on‐snow events , 2015 .

[8]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[9]  T. P. Barnett,et al.  Statistical Prediction of North American Air Temperatures from Pacific Predictors , 1981 .

[10]  T. Barnett,et al.  Origins and Levels of Monthly and Seasonal Forecast Skill for United States Surface Air Temperatures Determined by Canonical Correlation Analysis , 1987 .

[11]  A. Barnston,et al.  The North American multimodel ensemble: Phase-1 seasonal-to-interannual prediction; phase-2 toward developing intraseasonal prediction , 2014 .

[12]  Julia Slingo,et al.  The Simulation of Peak and Delayed ENSO Teleconnections , 2003 .

[13]  J. Cohen,et al.  Running hot and cold: Decadal fluctuations in planetary wave forcing modulate global warming in late boreal winter. , 2009 .

[14]  Mark P. Baldwin,et al.  Stratospheric Harbingers of Anomalous Weather Regimes , 2001, Science.

[15]  Robert E. Livezey,et al.  NCEP Forecasts of the El Niño of 1997–98 and Its U.S. Impacts , 1999 .

[16]  Arun Kumar,et al.  Eurasian snow cover variability and links to winter climate in the CMIP5 models , 2015, Climate Dynamics.

[17]  David L. T. Anderson,et al.  Evaluation of Atmospheric Fields from the ECMWF Seasonal Forecasts over a 15-Year Period , 2005 .

[18]  Dara Entekhabi,et al.  Linking Siberian Snow Cover to Precursors of Stratospheric Variability , 2013 .

[19]  Dong Yu,et al.  Deep Learning: Methods and Applications , 2014, Found. Trends Signal Process..

[20]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[21]  H. Douville,et al.  The CNRM-CM5.1 global climate model: description and basic evaluation , 2013, Climate Dynamics.

[22]  Markus Gross,et al.  The Met Office Unified Model Global Atmosphere 6.0/6.1 and JULES Global Land 6.0/6.1 configurations , 2017 .

[23]  Karl Pfeiffer,et al.  Warm Arctic episodes linked with increased frequency of extreme winter weather in the United States , 2018, Nature Communications.

[24]  Hurd C. Willett,et al.  Thirty-day forecasting : a review of a ten-year experiment , 1953 .

[25]  Jakob Runge,et al.  Early prediction of extreme stratospheric polar vortex states based on causal precursors , 2017 .

[26]  David L. T. Anderson,et al.  Did the ECMWF seasonal forecast model outperform statistical ENSO forecast models over the last 15 years , 2005 .

[27]  J. Wallace,et al.  Teleconnections in the Geopotential Height Field during the Northern Hemisphere Winter , 1981 .

[28]  E. Sanchez-Gomez,et al.  Multi-model assessment of linkages between eastern Arctic sea-ice variability and the Euro-Atlantic atmospheric circulation in current climate , 2017, Climate Dynamics.

[29]  Elizabeth C. Kent,et al.  Global analyses of sea surface temperature, sea ice, and night marine air temperature since the late nineteenth century , 2003 .

[30]  Seong-Joong Kim,et al.  The Melting Arctic and Midlatitude Weather Patterns: Are They Connected?* , 2015 .

[31]  A. Barnston,et al.  Skill of Real-Time Seasonal ENSO Model Predictions During 2002–11: Is Our Capability Increasing? , 2012 .

[32]  Timo Vihma,et al.  Effects of Arctic Sea Ice Decline on Weather and Climate: A Review , 2014, Surveys in Geophysics.

[33]  Judah Cohen,et al.  A new index for more accurate winter predictions , 2011 .

[34]  Christopher G. Fletcher,et al.  Improved Skill of Northern Hemisphere Winter Surface Temperature Predictions Based on Land–Atmosphere Fall Anomalies , 2007 .

[35]  R. Reynolds,et al.  The NCEP/NCAR 40-Year Reanalysis Project , 1996, Renewable Energy.

[36]  Eli Tziperman,et al.  Warm Arctic, Cold Continents: A Common Pattern Related to Arctic Sea Ice Melt, Snow Advance, and Extreme Winter Weather , 2013 .

[37]  Benjamin Kirtman,et al.  Multiseasonal predictions with a coupled tropical ocean-global atmosphere system , 1997 .

[38]  Robert E. Livezey,et al.  An operational multifield analog/antianalog prediction system for United States seasonal temperatures: 1. System design and winter experiments , 1988 .

[39]  R. Barzilay,et al.  High-Risk Breast Lesions: A Machine Learning Model to Predict Pathologic Upgrade and Reduce Unnecessary Surgical Excision. , 2017, Radiology.

[40]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[41]  Amy H. Butler,et al.  El Niño, La Niña, and stratospheric sudden warmings: A reevaluation in light of the observational record , 2011 .

[42]  Robert E. Livezey,et al.  THE FIRST DECADE OF LONG-LEAD U.S. SEASONAL FORECASTS Insights from a Skill Analysis , 2008 .

[43]  Dim Coumou,et al.  More-Persistent Weak Stratospheric Polar Vortex States Linked to Cold Extremes , 2017 .

[44]  Judah Cohen,et al.  An observational analysis: Tropical relative to Arctic influence on midlatitude weather in the era of Arctic amplification , 2016 .

[45]  A. Barnston,et al.  Classification, seasonality and persistence of low-frequency atmospheric circulation patterns , 1987 .

[46]  Eli Tziperman,et al.  The combined influences of autumnal snow and sea ice on Northern Hemisphere winters , 2016 .

[47]  Dim Coumou,et al.  Changes in meandering of the Northern Hemisphere circulation , 2016 .

[48]  E. Tziperman,et al.  Winter Precipitation Forecast in the European and Mediterranean Regions Using Cluster Analysis , 2017 .

[49]  Changhyun Yoo,et al.  Observed connection between stratospheric sudden warmings and the Madden‐Julian Oscillation , 2012 .

[50]  Lisa M. Goddard,et al.  IMPROVING SEASONAL PREDICTION PRACTICES THROUGH ATTRIBUTION OF CLIMATE VARIABILITY , 2005 .

[51]  Lennart Bengtsson,et al.  Coupled general circulation modeling of the tropical Pacific , 1998 .

[52]  Francisco J. Doblas-Reyes,et al.  Seasonal climate predictability and forecasting: status and prospects , 2013 .

[53]  A. Scaife,et al.  The association between stratospheric weak polar vortex events and cold air outbreaks in the Northern Hemisphere , 2010 .

[54]  Trevor Hastie,et al.  An Introduction to Statistical Learning , 2013, Springer Texts in Statistics.

[55]  Judah Cohen,et al.  Tropospheric Precursors and Stratospheric Warmings , 2011 .

[56]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[57]  Thomas M. Smith,et al.  Specification and Prediction of Global Surface Temperature and Precipitation from Global SST Using CCA , 1996 .

[58]  Y. Peings,et al.  Snow-(N)AO Teleconnection and Its Modulation By the Quasi-Biennal Oscillation , 2017 .

[59]  Johann S. Hawe,et al.  Crowdsourced analysis of clinical trial data to predict amyotrophic lateral sclerosis progression , 2014, Nature Biotechnology.

[60]  Petri Räisänen,et al.  The Influence of Eurasian Snow Extent on the Northern Extratropical Stratosphere in a QBO Resolving Model , 2017 .

[61]  H. Chipman,et al.  BART: Bayesian Additive Regression Trees , 2008, 0806.3286.

[62]  Jonathan F. Donges,et al.  Using Causal Effect Networks to Analyze Different Arctic Drivers of Midlatitude Winter Circulation , 2016 .

[63]  Mojib Latif,et al.  A review of the predictability and prediction of ENSO , 1998 .

[64]  Kristian Mogensen,et al.  ECMWF seasonal forecast system 3 and its prediction of sea surface temperature , 2011 .

[65]  Dara Entekhabi,et al.  Recent Arctic amplification and extreme mid-latitude weather , 2014 .

[66]  H. V. D. Dool,et al.  A global monthly land surface air temperature analysis for 1948-present , 2008 .

[67]  A. Gelfand,et al.  Gaussian predictive process models for large spatial data sets , 2008, Journal of the Royal Statistical Society. Series B, Statistical methodology.