Locally Calibrated Probabilistic Temperature Forecasting Using Geostatistical Model Averaging and Local Bayesian Model Averaging

AbstractThe authors introduce two ways to produce locally calibrated grid-based probabilistic forecasts of temperature. Both start from the Global Bayesian model averaging (Global BMA) statistical postprocessing method, which has constant predictive bias and variance across the domain, and modify it to make it local. The first local method, geostatistical model averaging (GMA), computes the predictive bias and variance at observation stations and interpolates them using a geostatistical model. The second approach, Local BMA, estimates the parameters of BMA at a grid point from stations that are close to the grid point and similar to it in elevation and land use. The results of these two methods applied to the eight-member University of Washington Mesoscale Ensemble (UWME) are given for the 2006 calendar year. GMA was calibrated and sharper than Global BMA, with prediction intervals that were 8% narrower than Global BMA on average. Examples using sparse and dense training networks of stations are shown. Th...

[1]  D. P. DEE,et al.  Bias and data assimilation , 2005 .

[2]  C. Bishop,et al.  Improvement of ensemble reliability with a new dressing kernel , 2005 .

[3]  Thomas M. Hamill,et al.  Ensemble Reforecasting: Improving Medium-Range Forecast Skill Using Retrospective Forecasts , 2004 .

[4]  T. Hamill.  Interpretation of Rank Histograms for Verifying Ensemble Forecasts , 2001 .

[5]  J. M. Sloughter,et al.  Probabilistic Wind Speed Forecasting Using Ensembles and Bayesian Model Averaging , 2010 .

[6]  Jeremy Berkowitz.  Testing Density Forecasts, With Applications to Risk Management , 2001 .

[7]  Susan Joslyn,et al.  PROBCAST: A Web-Based Portal to Mesoscale Probabilistic Forecasts , 2009 .

[8]  T. Hamill,et al.  A Comparison of Probabilistic Forecasts from Bred, Singular-Vector, and Perturbed Observation Ensembles , 2000 .

[9]  Leonard A. Smith,et al.  Combining dynamical and statistical ensembles , 2003 .

[10]  Noel A Cressie,et al.  Statistics for Spatial Data, Revised Edition. , 1994 .

[11]  A. Gelfand,et al.  A bivariate space-time downscaler under space and time misalignment. , 2010, The annals of applied statistics.

[12]  Noel A Cressie,et al.  Statistics for Spatial Data. , 1992 .

[13]  Jeffrey A. Baars,et al.  Removal of Systematic Model Bias on a Model Grid , 2008 .

[14]  Harold E. Brooks,et al.  Using Ensembles for Short-Range Forecasting , 1999 .

[15]  Renate Hagedorn,et al.  Probabilistic Forecast Calibration Using ECMWF and GFS Ensemble Reforecasts. Part II: Precipitation , 2008 .

[16]  G. P. Cressman.  AN OPERATIONAL OBJECTIVE ANALYSIS SYSTEM , 1959 .

[17]  James V. Zidek,et al.  Combining Measurements and Physical Model Outputs for the Spatial Prediction of Hourly Ozone Space-Time Fields ∗ , 2008 .

[18]  Eugenia Kalnay,et al.  Ensemble Forecasting at NMC: The Generation of Perturbations , 1993 .

[19]  Daniel S. Wilks,et al.  Extending logistic regression to provide full‐probability‐distribution MOS forecasts , 2009 .

[20]  S. Sorooshian,et al.  Multi-model ensemble hydrologic prediction using Bayesian model averaging , 2007 .

[21]  Adrian E. Raftery,et al.  Combining Spatial Statistical and Ensemble Information in Probabilistic Weather Forecasts , 2007 .

[22]  R. Buizza,et al.  A Comparison of the ECMWF, MSC, and NCEP Global Ensemble Prediction Systems , 2005 .

[23]  Renate Hagedorn,et al.  Probabilistic Forecast Calibration Using ECMWF and GFS Ensemble Reforecasts. Part I: Two-Meter Temperatures , 2008 .

[24]  A. Raftery,et al.  Using Bayesian Model Averaging to Calibrate Forecast Ensembles , 2005 .

[25]  Richard Swinbank,et al.  Medium‐range multimodel ensemble combination and calibration , 2009 .

[26]  C. F. Sirmans,et al.  Spatial Modeling With Spatially Varying Coefficient Processes , 2003 .

[27]  Anthony S. Tay,et al.  Evaluating Density Forecasts with Applications to Financial Risk Management , 1998 .

[28]  T. Gneiting,et al.  The continuous ranked probability score for circular variables and its application to mesoscale forecast ensemble verification , 2006 .

[29]  F. Molteni,et al.  The ECMWF Ensemble Prediction System: Methodology and validation , 1996 .

[30]  Alan E Gelfand,et al.  A Spatio-Temporal Downscaler for Output From Numerical Models , 2010, Journal of agricultural, biological, and environmental statistics.

[31]  J. Chilès,et al.  Geostatistics: Modeling Spatial Uncertainty , 1999 .

[32]  R. L. Winkler,et al.  Scoring Rules for Continuous Probability Distributions , 1976 .

[33]  Roger Woodard,et al.  Interpolation of Spatial Data: Some Theory for Kriging , 1999, Technometrics.

[34]  A. Raftery,et al.  Probabilistic forecasts, calibration and sharpness , 2007 .

[35]  Anton H. Westveld,et al.  Calibrated Probabilistic Forecasting Using Ensemble Model Output Statistics and Minimum CRPS Estimation , 2005 .

[36]  R. Tibshirani,et al.  Varying‐Coefficient Models , 1993 .

[37]  J. Hacker,et al.  A Practical Approach to Sequential Estimation of Systematic Error on Near-Surface Mesoscale Grids , 2005 .

[38]  H. Hersbach.  Decomposition of the Continuous Ranked Probability Score for Ensemble Prediction Systems , 2000 .

[39]  David J. Stensrud,et al.  Prediction of Near-Surface Variables at Independent Locations from a Bias-Corrected Ensemble Forecasting System , 2006 .

[40]  F. Zwiers,et al.  Climate Predictions with Multimodel Ensembles , 2002 .

[41]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[42]  Mike Rees,et al.  5. Statistics for Spatial Data , 1993 .

[43]  J. M. Sloughter,et al.  Probabilistic Quantitative Precipitation Forecasting Using Bayesian Model Averaging , 2007 .

[44]  Richard L. Smith,et al.  Bayesian Modeling of Uncertainty in Ensembles of Climate Models , 2009 .

[45]  Reto Knutti,et al.  The use of the multi-model ensemble in probabilistic climate projections , 2007, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[46]  C. Leith.  Theoretical Skill of Monte Carlo Forecasts , 1974 .

[47]  E. Epstein,et al.  Stochastic dynamic prediction1 , 1969 .

[48]  E. Epstein,et al.  Stochastic dynamic prediction , 1969 .

[49]  Clifford F. Mass,et al.  Aspects of Effective Mesoscale, Short-Range Ensemble Forecasting , 2005 .

[50]  Bob Glahn,et al.  MOS Uncertainty Estimates in an Ensemble Framework , 2009 .

[51]  Thomas M. Hamill,et al.  Verification of Eta–RSM Short-Range Ensemble Forecasts , 1997 .

[52]  Alan E. Gelfand,et al.  Spatial process modelling for univariate and multivariate dynamic spatial data , 2005 .

[53]  Jorge Nocedal,et al.  A Limited Memory Algorithm for Bound Constrained Optimization , 1995, SIAM J. Sci. Comput..

[54]  Thomas M. Hamill,et al.  Comparison of Ensemble-MOS Methods Using GFS Reforecasts , 2007 .

[55]  Yulia R. Gel,et al.  Comparative Analysis of the Local Observation-Based (LOB) Method and the Nonparametric Regression-Based Method for Gridded Bias Correction in Mesoscale Weather Forecasting , 2007 .

[56]  V. Fortin,et al.  Probabilistic forecasting from ensemble prediction systems: Improving upon the best‐member method by using a different weight and dressing kernel for each member , 2006 .

[57]  A. Raftery,et al.  Strictly Proper Scoring Rules, Prediction, and Estimation , 2007 .

[58]  Leonard A. Smith,et al.  From ensemble forecasts to predictive distribution functions , 2008 .

[59]  P. L. Houtekamer,et al.  Methods for Ensemble Prediction , 1995 .

[60]  Bob Glahn,et al.  The Gridding of MOS , 2009 .

[61]  H. Glahn,et al.  The Use of Model Output Statistics (MOS) in Objective Weather Forecasting , 1972 .