Multi‐model spread and probabilistic seasonal forecasts in PROVOST

The skill of the PROVOST (PRediction Of climate Variations On Seasonal to interannual Time-scales) long-range multi-model ensemble integrations is analysed. The ensemble PROVOST forecasts result from integrating three different models over the period 1979–93 using analysed sea surface temperatures. For each model, a set of nine-member ensembles have been run from consecutive European Centre for Medium-Range Weather Forecasts re-analyses. Using the full set of models, a large multi-model ensemble has been constructed and verified. Positive skill is found for forecasts of geopotential at 500 hPa, temperature at 850 hPa and precipitation. Skilful forecasts tend to occur at the same time in most of the models when skill is computed over large areas; the European region is poorly forecast. The skill commonality may be due to the use of either similar initial conditions or boundary conditions. Skill is shown to be at a maximum in late winter and early spring in mid latitudes. No means have been found for linearly predicting the skill of the ensemble mean using the ensemble spread. The multi-model ensemble improves the skill of the individual models only marginally when verifying the ensemble mean. However, when using the full ensemble in a probabilistic formulation, the multi-model approach offers a systematic improvement. The improvement arises both from the use of different models in the ensemble and from the higher ensemble size obtained by combining all of the models for building the multi-model ensemble. It is shown that a part of the skill improvement in the tropics is due to the multi-model approach, mainly in spring and summer. On the other hand, most of the gain in the extratropics comes from the increase in ensemble size.

[1]  K. Miyakoda,et al.  One-Month Forecast Experiments—without Anomaly Boundary Forcings , 1986 .

[2]  P. L. Houtekamer,et al.  Global and Local Skill Forecasts , 1993 .

[3]  Thomas M. Smith,et al.  Improved Global Sea Surface Temperature Analyses Using Optimum Interpolation , 1994 .

[4]  M. Hoerling,et al.  Prospects and Limitations of Seasonal Atmospheric GCM Predictions , 1995 .

[5]  Klaus Fraedrich,et al.  Combining Predictive Schemes in Long-Range Forecasting , 1989 .

[6]  R. E. Livezey,et al.  SST-Forced Seasonal Simulation and Prediction Skill for Versions of the NCEP/MRF Model , 1996 .

[7]  T. Barnett.  Monte Carlo climate forecasting , 1995 .

[8]  R. Clemen.  Combining forecasts: A review and annotated bibliography , 1989 .

[9]  Edward S. Epstein,et al.  A Scoring System for Probability Forecasts of Ranked Categories , 1969 .

[10]  T. Palmer,et al.  Atmospheric Seasonal Predictability and Estimates of Ensemble Size , 1997 .

[11]  F. Atger,et al.  The Skill of Ensemble Prediction Systems , 1999 .

[12]  Timothy W. Barker,et al.  The Relationship between Spread and Forecast Error in Extended-range Forecasts , 1991 .

[13]  C. Leith.  Theoretical Skill of Monte Carlo Forecasts , 1974 .

[14]  Mojib Latif,et al.  Decadal climate variability over the North Pacific and North America: Dynamics and predictability , 1996 .

[15]  Jeffrey L. Anderson.  A Method for Producing and Evaluating Probabilistic Forecasts from Ensemble Model Integrations , 1996 .

[16]  Caren Marzban,et al.  Bayesian Probability and Scalar Performance Measures in Gaussian Models , 1998 .

[17]  Eugenia Kalnay,et al.  Three years of operational prediction of forecast skill at NMC , 1995 .

[18]  Eugenia Kalnay,et al.  Operational Ensemble Prediction at the National Meteorological Center: Practical Aspects , 1993 .

[19]  P. D. Thompson,et al.  How to Improve Accuracy by Combining Independent Forecasts , 1977 .

[20]  Robert L. Vislocky,et al.  Improved Model Output Statistics Forecasts through Model Consensus , 1995 .

[21]  T. Hamill,et al.  Evaluation of Eta-RSM Ensemble Probabilistic Precipitation Forecasts , 1998 .

[22]  E. Epstein,et al.  Stochastic dynamic prediction1 , 1969 .

[23]  Zoltan Toth,et al.  An Ensemble Forecasting Primer , 1997 .

[24]  R. Sadourny,et al.  Potential Predictability of European Winters from the Analysis of Seasonal Simulations with an AGCM , 1999 .

[25]  Roberto Buizza,et al.  Impact of Ensemble Size on Ensemble Prediction , 1998 .

[26]  Thomas M. Hamill,et al.  Verification of Eta–RSM Short-Range Ensemble Forecasts , 1997 .

[27]  Mats Hamrud,et al.  Impact of model resolution and ensemble size on the performance of an Ensemble Prediction System , 1998 .

[28]  T. Palmer.  Extended-range atmospheric prediction and the Lorenz model , 1993 .

[29]  A. H. Murphy.  A Note on the Ranked Probability Score , 1971 .

[30]  K. Miyakoda,et al.  Feasibility of Seasonal Forecasts Inferred from Multiple GCM Simulations , 1995 .

[31]  E. Epstein,et al.  Stochastic dynamic prediction , 1969 .

[32]  Estimates of the autocorrelations and spectra of seasonal mean temperatures over North America , 1977 .

[33]  Phillip A. Arkin,et al.  Analyses of Global Monthly Precipitation Using Gauge Observations, Satellite Estimates, and Numerical Model Predictions , 1996 .

[34]  A. H. Murphy.  Climatology, Persistence, and Their Linear Combination as Standards of Reference in Skill Scores , 1992 .

[35]  R. E. Livezey.  Variability of Skill of Long-Range Forecasts and Implications for their Use and Value , 1990 .

[36]  Tim Palmer,et al.  The prospects for seasonal forecasting—A review paper , 1994 .

[37]  Tim N. Palmer,et al.  Extended‐range predictions with ECMWF models: Time‐lagged ensemble forecasting , 1990 .

[38]  J. Shukla,et al.  Predictability in the midst of chaos: A scientific basis for climate forecasting , 1998, Science.

[39]  David B. Stephenson,et al.  Statistical methods for interpreting Monte Carlo ensemble forecasts , 2000 .

[40]  Andrew F. Loughe,et al.  The Relationship between Ensemble Spread and Ensemble Mean Skill , 1998 .