On the reliability of seasonal climate forecasts

Seasonal climate forecasts are being used increasingly across a range of application sectors. A recent UK governmental report asked: how good are seasonal forecasts on a scale of 1–5 (where 5 is very good), and how good can we expect them to be in 30 years time? Seasonal forecasts are made from ensembles of integrations of numerical models of climate. We argue that ‘goodness’ should be assessed first and foremost in terms of the probabilistic reliability of these ensemble-based forecasts; reliable inputs are essential for any forecast-based decision-making. We propose that a ‘5’ should be reserved for systems that are not only reliable overall, but where, in particular, small ensemble spread is a reliable indicator of low ensemble forecast error. We study the reliability of regional temperature and precipitation forecasts of the current operational seasonal forecast system of the European Centre for Medium-Range Weather Forecasts, universally regarded as one of the world-leading operational institutes producing seasonal climate forecasts. A wide range of ‘goodness’ rankings, depending on region and variable (with summer forecasts of rainfall over Northern Europe performing exceptionally poorly) is found. Finally, we discuss the prospects of reaching ‘5’ across all regions and variables in 30 years time.

[1]  Nils Wedi,et al.  High-Resolution Global Climate Simulations with the ECMWF Model in Project Athena: Experimental Design, Model Climate, and Seasonal Forecast Skill , 2012 .

[2]  Simon J. Mason,et al.  On Using ``Climatology'' as a Reference Strategy in the Brier and Ranked Probability Skill Scores , 2004 .

[3]  Raquel V. Francisco,et al.  Uncertainties in regional climate change prediction: a regional analysis of ensemble simulations with the HADCM2 coupled AOGCM , 2000 .

[4]  Andrew Dawson,et al.  Simulating regime structures in weather and climate prediction models , 2012 .

[5]  M. Iredell,et al.  The NCEP Climate Forecast System Version 2 , 2014 .

[6]  Tim N. Palmer,et al.  On the predictability of the extreme summer 2003 over Europe , 2009 .

[7]  Adam A. Scaife,et al.  Impact of the QBO on surface winter climate , 2009 .

[8]  Antje Weisheimer,et al.  Assessment of representations of model uncertainty in monthly and seasonal forecast ensembles , 2011 .

[9]  J. Shukla,et al.  Current status of ENSO prediction skill in coupled ocean–atmosphere models , 2008 .

[10]  A. H. Murphy.  A New Vector Partition of the Probability Score , 1973 .

[11]  M. Balmaseda,et al.  Global seasonal rainfall forecasts using a coupled ocean–atmosphere model , 1998, Nature.

[12]  T. Palmer,et al.  Stochastic representation of model uncertainties in the ECMWF ensemble prediction system , 2007 .

[13]  Elisa Manzini,et al.  Impact of the Stratosphere on the Winter Tropospheric Teleconnections between ENSO and the North Atlantic and European Region , 2009 .

[14]  W. Briggs.  Statistical Methods in the Atmospheric Sciences , 2007 .

[15]  Kristian Mogensen,et al.  ECMWF seasonal forecast system 3 and its prediction of sea surface temperature , 2011 .

[16]  Antonio J. Busalacchi,et al.  An Earth-system prediction initiative for the twenty-first century , 2010 .

[17]  M. Rodwell,et al.  Toward Seamless Prediction: Calibration of Climate Change Projections Using Seasonal Forecasts , 2008 .

[18]  Roberto Buizza,et al.  The new ECMWF seasonal forecast system (system 4) , 2011 .

[19]  T. Palmer.  A CERN for climate change , 2011 .

[20]  Alberto Arribas,et al.  The GloSea4 Ensemble Prediction System for Seasonal Forecasting , 2011 .

[21]  I. Jolliffe,et al.  Forecast verification : a practitioner's guide in atmospheric science , 2011 .

[22]  Peter J. Webster,et al.  Seasonal prediction skill of ECMWF System 4 and NCEP CFSv2 retrospective forecast for the Northern Hemisphere Winter , 2012, Climate Dynamics.

[23]  Tim Palmer,et al.  The prospects for seasonal forecasting—A review paper , 1994 .

[24]  Antje Weisheimer,et al.  Addressing model error through atmospheric stochastic physical parametrizations: impact on the coupled ECMWF seasonal forecasting system , 2014, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[25]  J. Janowiak,et al.  The Version 2 Global Precipitation Climatology Project (GPCP) Monthly Precipitation Analysis (1979-Present) , 2003 .

[26]  The extreme forecast index at the seasonal scale , 2013 .

[27]  Tim Palmer.  Towards the probabilistic Earth‐system simulator: a vision for the future of climate and weather prediction , 2012 .

[28]  J. Thepaut,et al.  The ERA‐Interim reanalysis: configuration and performance of the data assimilation system , 2011 .

[29]  T. Palmer,et al.  ENSEMBLES: A new multi‐model ensemble for seasonal‐to‐annual predictions—Skill and progress beyond DEMETER in forecasting tropical Pacific SSTs , 2009 .

[30]  G. Brier.  VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY , 1950 .

[31]  T. Palmer.  A nonlinear dynamical perspective on model error: A proposal for non‐local stochastic‐dynamic parametrization in weather and climate prediction models , 2001 .

[32]  E. Lorenz.  Deterministic nonperiodic flow , 1963 .

[33]  Mark A. Cane,et al.  Experimental forecasts of El Niño , 1986, Nature.

[34]  Renate Hagedorn,et al.  Toward a new generation of world climate research and computing facilities , 2010 .

[35]  T. Palmer,et al.  Towards the probabilistic Earth‐system simulator: a vision for the future of climate and weather prediction , 2012 .