Comparison of prediction performance using statistical postprocessing methods

As the 2018 Winter Olympics are to be held in Pyeongchang, both general weather information on Pyeongchang and specific weather information on this region, which can affect game operation and athletic performance, are required. An ensemble prediction system has been applied to provide more accurate weather information, but it has bias and dispersion due to the limitations and uncertainty of its model. In this study, homogeneous and nonhomogeneous regression models as well as Bayesian model averaging (BMA) were used to reduce the bias and dispersion existing in ensemble prediction and to provide probabilistic forecast. Prior to applying the prediction methods, reliability of the ensemble forecasts was tested by using a rank histogram and a residualquantile-quantile plot to identify the ensemble forecasts and the corresponding verifications. The ensemble forecasts had a consistent positive bias, indicating over-forecasting, and were under-dispersed. To correct such biases, statistical post-processing methods were applied using fixed and sliding windows. The prediction skills of methods were compared by using the mean absolute error, root mean square error, continuous ranked probability score, and continuous ranked probability skill score. Under the fixed window, BMA exhibited better prediction skill than the other methods in most observation station. Under the sliding window, on the other hand, homogeneous and non-homogeneous regression models with positive regression coefficients exhibited better prediction skill than BMA. In particular, the homogeneous regression model with positive regression coefficients exhibited the best prediction skill.

[1]  H. Glahn,et al.  The Use of Model Output Statistics (MOS) in Objective Weather Forecasting , 1972 .

[2]  H. Glahn,et al.  The use of model output statistics (MOS) to estimate daily maximum temperatures , 1972 .

[3]  William H. Klein,et al.  forecasting local weather by means of model output statistics , 1974 .

[4]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[5]  Charles A. Ingene,et al.  Specification Searches: Ad Hoc Inference with Nonexperimental Data , 1980 .

[6]  A. H. Murphy,et al.  A General Framework for Forecast Verification , 1987 .

[7]  Andreas S. Weigend,et al.  Predicting Daily Probability Distributions of S&P500 Returns , 1998 .

[8]  Adrian E. Raftery,et al.  Bayesian model averaging: a tutorial (with comments by M. Clyde, David Draper and E. I. George, and a rejoinder by the authors , 1999 .

[9]  T. Hamill Interpretation of Rank Histograms for Verifying Ensemble Forecasts , 2001 .

[10]  A. Raftery,et al.  Using Bayesian Model Averaging to Calibrate Forecast Ensembles , 2005 .

[11]  Anton H. Westveld,et al.  Calibrated Probabilistic Forecasting Using Ensemble Model Output Statistics and Minimum CRPS Estimation , 2005 .

[12]  R. Buizza,et al.  A Comparison of the ECMWF, MSC, and NCEP Global Ensemble Prediction Systems , 2005 .

[13]  Adrian E. Raftery,et al.  Weather Forecasting with Ensemble Methods , 2005, Science.

[14]  W. Briggs Statistical Methods in the Atmospheric Sciences , 2007 .

[15]  A. Raftery,et al.  Strictly Proper Scoring Rules, Prediction, and Estimation , 2007 .

[16]  A. Raftery,et al.  Calibrated Surface Temperature Forecasts from the Canadian Ensemble Prediction System Using Bayesian Model Averaging , 2007 .

[17]  Tilmann Gneiting,et al.  Probabilistic forecasts, calibration and sharpness Series B Statistical methodology , 2007 .

[18]  Tim N. Palmer,et al.  Ensemble forecasting , 2008, J. Comput. Phys..

[19]  S. Vannitsem,et al.  A unified linear Model Output Statistics scheme for both deterministic and ensemble forecasts , 2009 .

[20]  松山 洋 「Statistical Methods in the Atmospheric Sciences(2nd edition), International Geophysics Series 91」, Daniel S. Wilks著, Academic Press, 2005年11月, 648頁, $94.95, ISBN978-0-12-751966-1(本だな) , 2010 .

[21]  Renate Hagedorn,et al.  Ensemble forecast post‐processing over Belgium: comparison of deterministic‐like and ensemble regression methods , 2010 .

[22]  C. Marzban,et al.  On the Effect of Correlations on Rank Histograms: Reliability of Temperature and Wind Speed Forecasts from Finescale Ensemble Reforecasts , 2011 .

[23]  T. Iversen,et al.  Evaluation of ‘GLAMEPS’—a proposed multimodel EPS for short range forecasting , 2011 .

[24]  Zoltan Toth,et al.  Bias Correction for Global Ensemble Forecast , 2012 .

[25]  M. Suh,et al.  Prospects of using Bayesian model averaging for the calibration of one-month forecasts of surface air temperature over South Korea , 2013, Asia-Pacific Journal of Atmospheric Sciences.

[26]  Z. B. Bouallègue,et al.  Enhancing COSMO-DE ensemble forecasts by inexpensive techniques , 2013 .