Recalibrating Decadal Climate Predictions – What is an adequate model for the drift?

Abstract. Near-term climate predictions such as decadal climate forecasts are increasingly being used to guide adaptation measures. To ensure the applicability of these probabilistic predictions, inherent systematic errors of the prediction system must be corrected. In this context, decadal climate predictions have further characteristic features, such as the long time horizon, the lead-time dependent systematic errors (drift) and the errors in the representation of long-term changes and variability. These features are compounded by small ensemble sizes to describe forecast uncertainty and a relatively short period for which typically pairs of re-forecasts and observations are available to estimate calibration parameters. With DeFoReSt (DecadalClimate Forecast Recalibration Strategy), Pasternack et al. (2018) proposed a parametric post-processing approach to tackle these problems. The original approach of DeFoReSt assumes third order polynomials in lead time to capture conditional and unconditional biases, second order for dispersion, first order for start time dependency. In this study, we propose not to restrict orders a priori but use a systematic model selection strategy to obtain model orders from the data based on non-homogeneous boosting. The introduced boosted recalibration estimates the coefficients of the statistical model, while the most relevant predictors are selected automatically by keeping the coefficients of the less important predictors to zero. Through toy model simulations with differently constructed systematic errors, we show the advantages of boosted recalibration over DeFoReSt. Finally, we apply boosted recalibration and DeFoReSt to decadal surface temperature forecasts from the MiKlip Prototype system. We show that boosted recalibration performs equally well as DeFoReSt and yet offers a greater flexibility.

[1]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[2]  C. Kottmeier,et al.  Skill and added value of the MiKlip regional decadal prediction system for temperature over Europe , 2019, Tellus A: Dynamic Meteorology and Oceanography.

[3]  Armin Köhl,et al.  Evaluation of the GECCO2 ocean synthesis: transports of volume, heat and freshwater in the Atlantic , 2015 .

[4]  Thomas M. Hamill,et al.  Verification of Eta–RSM Short-Range Ensemble Forecasts , 1997 .

[5]  John F. Scinocca,et al.  Statistical adjustment of decadal predictions in a changing climate , 2012 .

[6]  J. Thepaut,et al.  The ERA‐Interim reanalysis: configuration and performance of the data assimilation system , 2011 .

[7]  Johanna Baehr,et al.  Forecast skill of multi‐year seasonal means in the decadal prediction system of the Max Planck Institute for Meteorology , 2012 .

[8]  A. Raftery,et al.  Strictly Proper Scoring Rules, Prediction, and Estimation , 2007 .

[9]  Barbara Früh,et al.  User-oriented global predictions of the GPCC drought index for the next decade , 2019, Meteorologische Zeitschrift.

[10]  P. Jones,et al.  Quantifying uncertainties in global and regional temperature change using an ensemble of observational estimates: The HadCRUT4 data set , 2012 .

[11]  David B. Stephenson,et al.  Best Practices for Postprocessing Ensemble Climate Forecasts. Part I: Selecting Appropriate Recalibration Methods , 2016 .

[12]  Detlef Stammer,et al.  Initializing Decadal Climate Predictions with the GECCO Oceanic Synthesis: Effects on the North Atlantic , 2009 .

[13]  Andreas Hense,et al.  A new non-Gaussian evaluation method for ensemble forecasts based on analysis rank histograms , 2011 .

[14]  Jeffrey L. Anderson A Method for Producing and Evaluating Probabilistic Forecasts from Ensemble Model Integrations , 1996 .

[15]  Ecmwf Newsletter,et al.  EUROPEAN CENTRE FOR MEDIUM-RANGE WEATHER FORECASTS , 2004 .

[16]  Peter Buhlmann,et al.  BOOSTING ALGORITHMS: REGULARIZATION, PREDICTION AND MODEL FITTING , 2007, 0804.2752.

[17]  Christopher Kadow,et al.  Improved forecast skill in the tropics in the new MiKlip decadal climate predictions , 2013 .

[18]  Andreas S. Weigend,et al.  Predicting Daily Probability Distributions of S&P500 Returns , 1998 .

[19]  Torsten Hothorn,et al.  Boosting additive models using component-wise P-Splines , 2008, Comput. Stat. Data Anal..

[20]  Johanna Baehr,et al.  Multiyear Prediction of Monthly Mean Atlantic Meridional Overturning Circulation at 26.5°N , 2012, Science.

[21]  U. Ulbrich,et al.  A classification algorithm for selective dynamical downscaling of precipitation extremes , 2017, Hydrology and Earth System Sciences.

[22]  Henning W. Rust,et al.  MiKlip - a National Research Project on Decadal Climate Prediction , 2016 .

[23]  W. Hazeleger,et al.  Skill in the trend and internal variability in a multi-model decadal prediction ensemble , 2010 .

[24]  M. Liniger,et al.  Parametric decadal climate forecast recalibration (DeFoReSt 1.0) , 2017 .

[25]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[26]  Renate Hagedorn,et al.  Ensemble prediction: a pedagogical perspective , 2008 .

[27]  P. Jones,et al.  Hemispheric and large-scale land-surface air temperature variations: An extensive revision and an update to 2010: LAND-SURFACE TEMPERATURE VARIATIONS , 2012 .

[28]  J. Marotzke,et al.  Full-field initialized decadal predictions with the MPI earth system model: an initial shock in the North Atlantic , 2018, Climate Dynamics.

[29]  Anton H. Westveld,et al.  Calibrated Probabilistic Forecasting Using Ensemble Model Output Statistics and Minimum CRPS Estimation , 2005 .

[30]  W. Müller,et al.  Probabilistic evaluation of decadal prediction skill regarding Northern Hemisphere winter storms , 2016 .

[31]  P. Jones,et al.  Uncertainty estimates in regional and global observed temperature changes: A new data set from 1850 , 2006 .

[32]  B. Yu,et al.  Boosting with the L_2-Loss: Regression and Classification , 2001 .

[33]  Liu Xinwu This is How the Discussion Started , 1981 .

[34]  Mark A. Liniger,et al.  Methodological aspects of the validation of decadal predictions , 2013 .

[35]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[36]  A. Sterl,et al.  The ERA‐40 re‐analysis , 2005 .