Impact of Bias-Correction Type and Conditional Training on Bayesian Model Averaging over the Northeast United States

AbstractThe performance of a multimodel ensemble over the northeast United States is evaluated before and after applying bias correction and Bayesian model averaging (BMA). The 13-member Stony Brook University (SBU) ensemble at 0000 UTC is combined with the 21-member National Centers for Environmental Prediction (NCEP) Short-Range Ensemble Forecast (SREF) system at 2100 UTC. The ensemble is verified using 2-m temperature and 10-m wind speed for the 2007–09 warm seasons, and for subsets of days with high ozone and high fire threat. The impacts of training period, bias-correction method, and BMA are explored for these potentially hazardous weather events using the most recent consecutive (sequential training) and most recent similar days (conditional training). BMA sensitivity to the selection of ensemble members is explored. A running mean difference between forecasts and observations using the last 14 days is better at removing temperature bias than is a cumulative distribution function (CDF) or linear re...

[1]  Isabel F. Trigo,et al.  Correction of 2 m-temperature forecasts using Kalman Filtering technique , 2008 .

[2]  Bob Glahn,et al.  MOS Uncertainty Estimates in an Ensemble Framework , 2009 .

[3]  Luca Delle Monache,et al.  Ozone ensemble forecasts: 2. A Kalman filter predictor bias correction , 2006 .

[4]  B. Colle,et al.  The Spatial and Temporal Variability of Convective Storms over the Northeast United States during the Warm Season , 2011 .

[5]  Fuqing Zhang,et al.  Evaluation of Planetary Boundary Layer Scheme Sensitivities for the Purpose of Parameter Estimation , 2010 .

[6]  P. Kinney,et al.  Associations of daily mortality and air pollution in Los Angeles County. , 1991, Environmental research.

[7]  H. Mao,et al.  Synoptic controls on summertime surface ozone in the northeastern United States , 2007 .

[8]  Thomas M. Hamill,et al.  Verification of Eta–RSM Short-Range Ensemble Forecasts , 1997 .

[9]  A. Raftery,et al.  Using Bayesian Model Averaging to Calibrate Forecast Ensembles , 2005 .

[10]  E. Kalnay,et al.  Ensemble Forecasting at NCEP and the Breeding Method , 1997 .

[11]  R. Burgan,et al.  Fuel Models and Fire Potential From Satellite and Surface Observations , 1998 .

[12]  B. Colle,et al.  The Spatial and Temporal Distribution of Organized Convective Structures over the Northeast and Their Ambient Conditions , 2010 .

[13]  Adrian E. Raftery,et al.  Locally Calibrated Probabilistic Temperature Forecasting Using Geostatistical Model Averaging and Local Bayesian Model Averaging , 2011 .

[14]  M. J. Schroeder,et al.  SYNOPTIC WEATHER TYPES ASSOCIATED WITH CRITICAL FIRE WEATHER , 1964 .

[15]  Fuqing Zhang,et al.  Evaluation of Three Planetary Boundary Layer Schemes in the WRF Model , 2010 .

[16]  S. Roy,et al.  An evaluation of the scale at which topographical features affect the convective boundary layer using large eddy simulations , 2000 .

[17]  L. Wilson,et al.  The Canadian Updateable Model Output Statistics (UMOS) System: Validation against Perfect Prog , 2003 .

[18]  W. Gallus,et al.  Evaluation of probabilistic precipitation forecasts determined from Eta and AVN forecasted amounts , 2007 .

[19]  Nelson L. Seaman,et al.  Mesoscale Meteorological Structure of a High-Ozone Episode during the 1995 NARSTO-Northeast Study , 2000 .

[20]  G. Powers,et al.  A Description of the Advanced Research WRF Version 3 , 2008 .

[21]  M. Schmeits,et al.  A Comparison between Raw Ensemble Output, (Modified) Bayesian Model Averaging, and Extended Logistic Regression Using ECMWF Ensemble Precipitation Reforecasts , 2010 .

[22]  Brian A. Colle,et al.  Multiseason Verification of the MM5. Part I: Comparison with the Eta Model over the Central and Eastern United States and Impact of MM5 Resolution , 2003 .

[23]  R. A. Fisher,et al.  On the dominance ratio , 1990 .

[24]  Brian A. Colle,et al.  Evaluation of a Mesoscale Short-Range Ensemble Forecast System over the Northeast United States , 2007 .

[25]  Mathias D. Müller,et al.  Effects of Model Resolution and Statistical Postprocessing on Shelter Temperature and Wind Forecasts , 2011 .

[26]  Luca Delle Monache,et al.  A Kalman-filter bias correction method applied to deterministic, ensemble averaged and probabilistic forecasts of surface ozone , 2008 .

[27]  T. Hamill,et al.  Evaluation of Eta-RSM Ensemble Probabilistic Precipitation Forecasts , 1998 .

[28]  Moti Segal,et al.  Does Increased Predicted Warm-Season Rainfall Indicate Enhanced Likelihood of Rain Occurrence? , 2004 .

[29]  L. Kalkstein,et al.  Quantitative analysis of summer air masses in the eastern United States and an application to human mortality , 1996 .

[30]  Jeffery C. Eidenshink,et al.  Forecasting distributions of large federal-lands fires utilizing satellite and gridded weather information , 2009 .

[31]  H. Glahn,et al.  The Use of Model Output Statistics (MOS) in Objective Weather Forecasting , 1972 .

[32]  Clifford F. Mass,et al.  Aspects of Effective Mesoscale, Short-Range Ensemble Forecasting , 2005 .

[33]  A. Raftery,et al.  Calibrated Surface Temperature Forecasts from the Canadian Ensemble Prediction System Using Bayesian Model Averaging , 2007 .

[34]  Scott L. Goodrick,et al.  The Effect of Model Resolution in Predicting Meteorological Parameters Used in Fire Danger Rating , 2004 .

[35]  D. Stensrud,et al.  Reliable Probabilistic Quantitative Precipitation Forecasts from a Short-Range Ensemble Forecasting System , 2007 .

[36]  Scott L. Goodrick,et al.  Evaluation of MM5 model resolution when applied to prediction of National Fire Danger Rating indexes , 2006 .

[37]  Youhua Tang,et al.  Bias-corrected ensemble and probabilistic forecasts of surface ozone over eastern North America during the summer of 2004 , 2006 .

[38]  Rohit Mathur,et al.  Assessment of an ensemble of seven real-time ozone forecasts over eastern North America during the summer of 2004 , 2005 .

[39]  J. Pleim.  A Combined Local and Nonlocal Closure Model for the Atmospheric Boundary Layer. Part II: Application and Evaluation in a Mesoscale Meteorological Model , 2007 .

[40]  J. M. Sloughter,et al.  Probabilistic Wind Speed Forecasting Using Ensembles and Bayesian Model Averaging , 2010 .

[41]  N. Mölders.  Comparison of Canadian Forest Fire Danger Rating System and National Fire Danger Rating System fire indices derived from Weather Research and Forecasting (WRF) model data for the June 2005 Interior Alaska wildfires , 2010 .

[42]  David J. Stensrud,et al.  Short-Range Ensemble Predictions of 2-m Temperature and Dewpoint Temperature over New England , 2003 .

[43]  A. Raftery,et al.  Calibrating Multimodel Forecast Ensembles with Exchangeable and Missing Members Using Bayesian Model Averaging , 2010 .

[44]  Richard T. McNider,et al.  An Optimal Model Output Calibration Algorithm Suitable for Objective Temperature Forecasting , 1999 .

[45]  Thomas M. Hamill,et al.  Probabilistic Quantitative Precipitation Forecasts Based on Reforecast Analogs: Theory and Application , 2006 .

[46]  N. Mölders.  Suitability of the Weather Research and Forecasting (WRF) Model to Predict the June 2005 Fire Weather for Interior Alaska , 2008 .

[47]  Roland B. Stull,et al.  Deterministic Ensemble Forecasts Using Gene-Expression Programming* , 2009 .

[48]  C. Huang,et al.  The development of extremely dry surface air due to vertical exchanges under the exit region of a jet streak , 2008 .

[49]  G. Grell,et al.  A description of the fifth-generation Penn State/NCAR Mesoscale Model (MM5) , 1994 .

[50]  Thomas M. Hamill.  Comments on “Calibrated Surface Temperature Forecasts from the Canadian Ensemble Prediction System Using Bayesian Model Averaging” , 2007 .

[51]  Martyn P. Clark,et al.  Ensemble Bayesian model averaging using Markov Chain Monte Carlo sampling , 2008 .

[52]  Rohit Mathur,et al.  Real-time bias-adjusted O3 and PM2.5 air quality index forecasts and their performance evaluations over the continental United States , 2010 .

[53]  J. Charney,et al.  Mesoscale model simulation of the meteorological conditions during the 2 June 2002 Double Trouble State Park wildfire , 2010 .

[54]  Marino Marrocu,et al.  A multi‐model/multi‐analysis limited area ensemble: calibration issues , 2008 .

[55]  Anton H. Westveld,et al.  Calibrated Probabilistic Forecasting Using Ensemble Model Output Statistics and Minimum CRPS Estimation , 2005 .

[56]  J. Whitaker,et al.  REFORECASTS An Important Dataset for Improving Weather Predictions , 2006 .

[57]  C. Lin,et al.  Observational Study of Wind Channeling within the St. Lawrence River Valley , 2009 .

[58]  Guillem Candille,et al.  The Multiensemble Approach: The NAEFS Example , 2009 .

[59]  G. Zängl,et al.  Systematic errors of QPF in low-mountain regions as revealed by MM5 simulations , 2008 .

[60]  Roman Krzysztofowicz,et al.  Probabilistic Forecasts from the National Digital Forecast Database , 2008 .

[61]  F. Anthony Eckel,et al.  Estimation of Ambiguity in Ensemble Forecasts , 2012 .

[62]  Synoptic-Scale Controls on the Sea Breeze of the Central New England Coast , 2003 .

[63]  R. Gaza.  Mesoscale Meteorology and High Ozone in the Northeast United States , 1998 .

[64]  Yulia R. Gel,et al.  Comparative Analysis of the Local Observation-Based (LOB) Method and the Nonparametric Regression-Based Method for Gridded Bias Correction in Mesoscale Weather Forecasting , 2007 .

[65]  David J. Stensrud,et al.  Bias‐corrected short‐range ensemble forecasts of near surface variables , 2005 .

[66]  Daniel S. Wilks,et al.  Extending logistic regression to provide full‐probability‐distribution MOS forecasts , 2009 .

[67]  Rohit Mathur,et al.  Bias adjustment techniques for improving ozone air quality forecasts , 2008 .

[68]  R. Stull,et al.  Kalman Filter and Analog Schemes to Postprocess Numerical Weather Predictions , 2011 .

[69]  Yan Qing,et al.  A Synoptic Climatology for Forest Fires in the NE US and Future Implications from GCM Simulations , 1994 .

[70]  Jeffrey A. Baars,et al.  Removal of Systematic Model Bias on a Model Grid , 2008 .

[71]  Warm Season Mesoscale Superensemble Precipitation Forecasts in the Southeastern United States , 2007 .

[72]  David S. Richardson,et al.  ‘Jumpiness’ of the ECMWF and Met Office EPS control and ensemble-mean forecasts , 2009 .

[73]  Marcel Vallée,et al.  The Canadian Updateable Model Output Statistics (UMOS) System: Design and Development Tests , 2002 .

[74]  Nelson L. Seaman,et al.  Meteorological modeling for air-quality assessments , 2000 .

[75]  G. Grell,et al.  A Kalman-filter bias correction of ozone deterministic, ensemble-averaged, and probabilistic forecasts , 2006 .

[76]  Sue Ellen Haupt,et al.  The Regime Dependence of Optimally Weighted Ensemble Model Consensus Forecasts of Surface Temperature , 2007 .

[77]  C. Bishop,et al.  Improvement of ensemble reliability with a new dressing kernel , 2005 .

[78]  J. M. Sloughter,et al.  Probabilistic Quantitative Precipitation Forecasting Using Bayesian Model Averaging , 2007 .