Medium‐range multimodel ensemble combination and calibration

As part of its contribution to The Observing System Research and Predictability Experiment (THORPEX), the Met Office has developed a global, 15 day multimodel ensemble. The multimodel ensemble combines ensembles from the European Centre for Medium-Range Weather Forecasts (ECMWF), Met Office and National Centers for Environmental Prediction (NCEP) and is calibrated to give further improvements. The ensemble post-processing includes bias correction, model-dependent weights and variance adjustment, all of which are based on linear-filter estimates using past forecast-verification pairs, calculated separately for each grid point and forecast lead time. Verification shows that the multimodel ensemble gives an improvement in comparison with a calibrated single-model ensemble, particularly for surface temperature. However, the benefits are smaller for mean-sea-level pressure (mslp) and 500 hPa height. This is attributed to the higher degree of forecast-error similarity between the component ensembles for mslp and 500 hPa height than for temperature. The results also show only small improvements from the use of the model-dependent weights and the variance adjustment. This is because the component ensembles have similar levels of skill, and the multimodel ensemble variance is already generally well calibrated. In conclusion, we demonstrate that the multimodel ensemble does give benefit over a single-model ensemble. However, as expected, the benefits are small if the ensembles are similar to each other and further post-processing gives only relatively small improvements. © Crown Copyright 2009. Reproduced with the permission of HMSO. Published by John Wiley & Sons Ltd.

[1]  G. Shutts,et al.  Sub‐gridscale parametrization from the perspective of a computer games animator , 2007 .

[2]  Renate Hagedorn,et al.  Probabilistic Forecast Calibration Using ECMWF and GFS Ensemble Reforecasts. Part II: Precipitation , 2008 .

[3]  Witold F. Krajewski,et al.  Estimation of the mean field bias of radar rainfall estimates , 1991 .

[4]  John G. Proakis,et al.  Probability, random variables and stochastic processes , 1985, IEEE Trans. Acoust. Speech Signal Process..

[5]  R. J. Graham,et al.  Joint Medium-Range Ensembles from The Met. Office and ECMWF Systems , 2000 .

[6]  J. Noilhan,et al.  Key results and implications from phase 1(c) of the Project for Intercomparison of Land-surface Parametrization Schemes , 1999 .

[7]  Francisco J. Doblas-Reyes,et al.  Forecast assimilation: a unified framework for the combination of multi-model weather and climate predictions , 2005 .

[8]  Chermelle Engel,et al.  Operational Consensus Forecasts , 2005 .

[9]  F. Molteni,et al.  The ECMWF Ensemble Prediction System: Methodology and validation , 1996 .

[10]  Reto Knutti,et al.  The use of the multi-model ensemble in probabilistic climate projections , 2007, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[11]  Mark A. Liniger,et al.  Can multi‐model combination really enhance the prediction skill of probabilistic ensemble forecasts? , 2007 .

[12]  Thomas M. Hamill,et al.  Measuring forecast skill: is it real skill or is it the varying climatology? , 2006 .

[13]  David S. Richardson,et al.  On the effect of ensemble size on the discrete and continuous ranked probability scores , 2008 .

[14]  David S. Richardson,et al.  Benefits of increased resolution in the ECMWF ensemble system and comparison with poor‐man's ensembles , 2003 .

[15]  A. Raftery,et al.  Using Bayesian Model Averaging to Calibrate Forecast Ensembles , 2005 .

[16]  Malaquias Peña,et al.  Consolidation of Multimodel Forecasts by Ridge Regression: Application to Pacific Sea Surface Temperature , 2008 .

[17]  Daniel S. Wilks,et al.  Comparison of ensemble‐MOS methods in the Lorenz '96 setting , 2006 .

[18]  Neill E. Bowler,et al.  The MOGREPS short‐range ensemble prediction system , 2008 .

[19]  Renate Hagedorn,et al.  The rationale behind the success of multi-model ensembles in seasonal forecasting-II , 2005 .

[20]  R. Clark,et al.  Multi‐model multi‐analysis ensembles in quasi‐operational medium‐range forecasting , 2002 .

[21]  T. Palmer,et al.  Analysis and model dependencies in medium‐range ensembles: Two transplant case‐studies , 1999 .

[22]  F. Zwiers,et al.  Climate Predictions with Multimodel Ensembles , 2002 .

[23]  Renate Hagedorn,et al.  The rationale behind the success of multi-model ensembles in seasonal forecasting — I. Basic concept , 2005 .

[24]  M. Homleid,et al.  Diurnal Corrections of Short-Term Surface Temperature Forecasts Using the Kalman Filter , 1995 .

[25]  Renate Hagedorn,et al.  Probabilistic Forecast Calibration Using ECMWF and GFS Ensemble Reforecasts. Part I: Two-Meter Temperatures , 2008 .

[26]  M. Kendall,et al.  The advanced theory of statistics , 1945 .

[27]  Andrew P. Morse,et al.  DEVELOPMENT OF A EUROPEAN MULTIMODEL ENSEMBLE SYSTEM FOR SEASONAL-TO-INTERANNUAL PREDICTION (DEMETER) , 2004 .

[28]  P. L. Houtekamer,et al.  A System Simulation Approach to Ensemble Prediction , 1996 .

[29]  Marcel Vallée,et al.  The Canadian Updateable Model Output Statistics (UMOS) System: Design and Development Tests , 2002 .

[30]  Thomas M. Hamill,et al.  Ensemble Reforecasting: Improving Medium-Range Forecast Skill Using Retrospective Forecasts , 2004 .

[31]  T. N. Krishnamurti,et al.  Improved Weather and Seasonal Climate Forecasts from Multimodel Superensemble. , 1999, Science.

[32]  T. N. Krishnamurti,et al.  Interpretation of Seasonal Climate Forecast Using Brier Skill Score, The Florida State University Superensemble, and the AMIP-I Dataset , 2002 .

[33]  Valery J. Dagostaro,et al.  New NGM-Based MOS Guidance for Maximum/Minimum Temperature, Probability of Precipitation, Cloud Amount, and Surface Wind , 1990 .

[34]  T. Palmer,et al.  Stochastic representation of model uncertainties in the ECMWF ensemble prediction system , 2007 .

[35]  Eugenia Kalnay,et al.  Ensemble Forecasting at NMC: The Generation of Perturbations , 1993 .

[36]  J Berner,et al.  Impact of a quasi-stochastic cellular automaton backscatter scheme on the systematic error and seasonal prediction skill of a global climate model , 2008, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[37]  R. Buizza,et al.  A Comparison of the ECMWF, MSC, and NCEP Global Ensemble Prediction Systems , 2005 .

[38]  Daily Forecast Skill of Multi-Center Grand Ensemble , 2007 .

[39]  Roberto Buizza,et al.  TIGGE: Preliminary results on comparing and combining ensembles , 2008 .

[40]  W. Briggs Statistical Methods in the Atmospheric Sciences , 2007 .

[41]  A. Raftery,et al.  Calibrated Surface Temperature Forecasts from the Canadian Ensemble Prediction System Using Bayesian Model Averaging , 2007 .

[42]  Chris Chatfield,et al.  The Analysis of Time Series: An Introduction , 1981 .