Geostatistical Model Averaging for Locally Calibrated Probabilistic Quantitative Precipitation Forecasting

Accurate weather benefit many key societal functions and activities, including agriculture, transportation, recreation, and basic human and infrastructural safety. Over the past two decades, ensembles of numerical weather prediction models have been developed, in which multiple estimates of the current state of the atmosphere are used to generate probabilistic forecasts for future weather events. However, ensemble systems are uncalibrated and biased, and thus need to be statistically postprocessed. Bayesian model averaging (BMA) is a preferred way of doing this. Particularly for quantitative precipitation, biases and calibration errors depend critically on local terrain features. We introduce a geostatistical approach to modeling locally varying BMA parameters, as opposed to the extant method that holds parameters constant across the forecast domain. Degeneracies caused by enduring dry periods are overcome by Bayesian regularization and Laplace approximations. The new approach, called geostatistical model averaging (GMA), was applied to 48-hour-ahead forecasts of daily precipitation accumulation over the North American Pacific Northwest, using the eight-member University of Washington Mesoscale Ensemble. GMA had better aggregate and local calibration than the extant technique, and was sharper on average.

[1]  Claudia Czado,et al.  Predictive Model Assessment for Count Data , 2009, Biometrics.

[2]  Ross Ihaka,et al.  Gentleman R: R: A language for data analysis and graphics , 1996 .

[3]  F. Atger,et al.  Spatial and Interannual Variability of the Reliability of Ensemble-Based Probabilistic Forecasts: Consequences for Calibration , 2003 .

[4]  Roman Krzysztofowicz,et al.  The case for probabilistic forecasting in hydrology , 2001 .

[5]  A. Raftery,et al.  Using Bayesian Model Averaging to Calibrate Forecast Ensembles , 2005 .

[6]  William Kleiber Multivariate geostatistics and geostatistical model averaging , 2010 .

[7]  Susan Joslyn,et al.  Strategies in Naturalistic Decision-Making : A cognitive Task Analysis of Naval Weather Forecasting 1 , 2006 .

[8]  Daniela Cocchi,et al.  A Bayesian Hierarchical Approach to Ensemble Weather Forecasting , 2008 .

[9]  Roger Stern,et al.  The use of rainfall models in agricultural planning , 1982 .

[10]  Daniel S. Wilks,et al.  Extending logistic regression to provide full‐probability‐distribution MOS forecasts , 2009 .

[11]  E. Grimit,et al.  Initial Results of a Mesoscale Short-Range Ensemble Forecasting System over the Pacific Northwest , 2002 .

[12]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[13]  A. Raftery,et al.  Strictly Proper Scoring Rules, Prediction, and Estimation , 2007 .

[14]  C. Daly,et al.  A Statistical-Topographic Model for Mapping Climatological Precipitation over Mountainous Terrain , 1994 .

[15]  Noel A Cressie,et al.  Statistics for Spatial Data. , 1992 .

[16]  John A. Dutton OPPORTUNITIES AND PRIORITIES IN A NEW ERA FOR WEATHER AND CLIMATE SERVICES , 2002 .

[17]  John A. Dutton,et al.  OPPORTUNITIES AND PRIORITIES IN A NEW ERA FOR WEATHER AND CLIMATE SERVICES , 2002 .

[18]  M. G. Pittau,et al.  A weakly informative default prior distribution for logistic and other regression models , 2008, 0901.4011.

[19]  Alan E Gelfand,et al.  A Spatio-Temporal Downscaler for Output From Numerical Models , 2010, Journal of agricultural, biological, and environmental statistics.

[20]  Renate Hagedorn,et al.  Probabilistic Forecast Calibration Using ECMWF and GFS Ensemble Reforecasts. Part II: Precipitation , 2008 .

[21]  M. Schmeits,et al.  A Comparison between Raw Ensemble Output, (Modified) Bayesian Model Averaging, and Extended Logistic Regression Using ECMWF Ensemble Precipitation Reforecasts , 2010 .

[22]  David S. Richardson,et al.  ON THE ECONOMIC VALUE OF ENSEMBLE BASED WEATHER FORECASTS , 2001 .

[23]  Clifford F. Mass,et al.  Aspects of Effective Mesoscale, Short-Range Ensemble Forecasting , 2005 .

[24]  L. Tierney,et al.  Accurate Approximations for Posterior Moments and Marginal Densities , 1986 .

[25]  J. M. Sloughter,et al.  Probabilistic Quantitative Precipitation Forecasting Using Bayesian Model Averaging , 2007 .

[26]  Noel A Cressie,et al.  Statistics for Spatial Data, Revised Edition. , 1994 .

[27]  Thomas M. Hamill,et al.  Verification of Eta–RSM Short-Range Ensemble Forecasts , 1997 .

[28]  Donald B. Rubin,et al.  Multiple Imputation of Industry and Occupation Codes in Census Public-use Samples Using Bayesian Logistic Regression , 1991 .

[29]  Adrian E. Raftery,et al.  Weather Forecasting with Ensemble Methods , 2005, Science.

[30]  A. Raftery,et al.  Probabilistic Weather Forecasting for Winter Road Maintenance , 2010 .

[31]  T. Iversen,et al.  Evaluation of ‘GLAMEPS’—a proposed multimodel EPS for short range forecasting , 2011 .

[32]  Martyn P. Clark,et al.  Ensemble Bayesian model averaging using Markov Chain Monte Carlo sampling , 2008 .

[33]  A. H. Murphy,et al.  Economic value of weather and climate forecasts , 1997 .

[34]  Susan Joslyn,et al.  Strategies in naturalistic decision making , 2008 .

[35]  David J. Hand,et al.  Approximate repeated-measures shrinkage , 2011, Comput. Stat. Data Anal..

[36]  Thomas M. Hamill,et al.  Probabilistic Quantitative Precipitation Forecasts Based on Reforecast Analogs: Theory and Application , 2006 .

[37]  Alan Basist,et al.  Statistical Relationships between Topography and Precipitation Patterns , 1994 .

[38]  David Madigan,et al.  Large-Scale Bayesian Logistic Regression for Text Categorization , 2007, Technometrics.

[39]  Roger Woodard,et al.  Interpolation of Spatial Data: Some Theory for Kriging , 1999, Technometrics.

[40]  N. Cressie,et al.  Statistics for Spatial Data. , 1992 .

[41]  G. Brier VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY , 1950 .

[42]  Tim N. Palmer,et al.  The economic value of ensemble forecasts as a tool for risk assessment: From days to decades , 2002 .

[43]  Tilmann Gneiting,et al.  Probabilistic forecasts of wind speed: ensemble model output statistics by using heteroscedastic censored regression , 2010 .

[44]  A. Gelfand,et al.  A bivariate space-time downscaler under space and time misalignment. , 2010, The annals of applied statistics.

[45]  Adrian E. Raftery,et al.  Bayesian Regularization for Normal Mixture Estimation and Model-Based Clustering , 2007, J. Classif..

[46]  Thomas M. Hamill,et al.  Measuring forecast skill: is it real skill or is it the varying climatology? , 2006 .

[47]  Tilmann Gneiting,et al.  Editorial: Probabilistic forecasting , 2008 .

[48]  A. Raftery,et al.  Probabilistic forecasts, calibration and sharpness , 2007 .

[49]  L. Tierney,et al.  Fully Exponential Laplace Approximations to Expectations and Variances of Nonpositive Functions , 1989 .

[50]  Tilmann Gneiting,et al.  Calibrating Multimodel Forecast Ensembles with Exchangeable and Missing Members Using Bayesian Model Averaging , 2010 .

[51]  Adrian E. Raftery,et al.  Bias Correction and Bayesian Model Averaging for Ensemble Forecasts of Surface Wind Direction , 2010 .

[52]  Roderick Wong,et al.  Asymptotic approximations of integrals , 1989, Classics in applied mathematics.

[53]  J. M. Sloughter,et al.  Probabilistic Wind Speed Forecasting Using Ensembles and Bayesian Model Averaging , 2010 .

[54]  Adrian E. Raftery,et al.  Probabilistic Wind Speed Forecasting Using Ensembles and Bayesian Model Averaging , 2010 .

[55]  R. Tibshirani,et al.  Varying‐Coefficient Models , 1993 .

[56]  Adrian E. Raftery,et al.  Locally Calibrated Probabilistic Temperature Forecasting Using Geostatistical Model Averaging and Local Bayesian Model Averaging , 2011 .

[57]  Thomas M. Hamill,et al.  Ensemble Reforecasting: Improving Medium-Range Forecast Skill Using Retrospective Forecasts , 2004 .

[58]  Adrian E. Raftery,et al.  Probabilistic quantitative precipitation field forecasting using a two-stage spatial model , 2008, 0901.3484.

[59]  Dong-Jun Seo,et al.  A Nonparametric Postprocessor for Bias Correction of Hydrometeorological and Hydrologic Ensemble Forecasts , 2010 .

[60]  D. Rubin,et al.  The ECME algorithm: A simple extension of EM and ECM with faster monotone convergence , 1994 .

[61]  Jorge Nocedal,et al.  A Limited Memory Algorithm for Bound Constrained Optimization , 1995, SIAM J. Sci. Comput..