Estimation of Ambiguity in Ensemble Forecasts

AbstractAmbiguity is uncertainty in the prediction of forecast uncertainty, or in the forecast probability of a specific event, associated with random error in an ensemble forecast probability density function. In ensemble forecasting ambiguity arises from finite sampling and deficient simulation of the various sources of forecast uncertainty. This study introduces two practical methods of estimating ambiguity and demonstrates them on 5-day, 2-m temperature forecasts from the Japan Meteorological Agency’s Ensemble Prediction System. The first method uses the error characteristics of the calibrated ensemble as well as the ensemble spread to predict likely errors in forecast probability. The second method applies bootstrap resampling on the ensemble members to produce multiple likely values of forecast probability. Both methods include forecast calibration since ambiguity results from random and not systematic errors, which must be removed to reveal the ambiguity. Additionally, use of a more robust calibrat...

[1]  Neill E. Bowler,et al.  The MOGREPS short‐range ensemble prediction system , 2008 .

[2]  E. Lorenz.  Predictability of Weather and Climate: Predictability – a problem partly solved , 2006 .

[3]  Istvan Szunyogh,et al.  Predictability of the Performance of an Ensemble Forecast System: Predictability of the Space of Uncertainties , 2010 .

[4]  W. Briggs.  Statistical Methods in the Atmospheric Sciences , 2007 .

[5]  J. Whitaker,et al.  REFORECASTS An Important Dataset for Improving Weather Predictions , 2006 .

[6]  Jean-Raymond Bidlot,et al.  Potential Benefits of Using Probabilistic Forecasts for Waves and Marine Winds Based on the ECMWF Ensemble Prediction System , 2004 .

[7]  Eric R. Ziegel,et al.  Probability and Statistics for Engineering and the Sciences , 2004, Technometrics.

[8]  H. M. van den Dool,et al.  A New Look at Weather Forecasting through Analogues , 1989 .

[9]  R. Buizza,et al.  A Comparison of the ECMWF, MSC, and NCEP Global Ensemble Prediction Systems , 2005 .

[10]  Thomas M. Hamill,et al.  Predictability of Weather and Climate: Ensemble-based atmospheric data assimilation , 2006 .

[11]  F. Anthony Eckel,et al.  Calibrated Probabilistic Quantitative Precipitation Forecasts Based on the MRF Ensemble , 2012 .

[12]  D. Orrell,et al.  Model Error and Predictability over Different Timescales in the Lorenz '96 Systems , 2003 .

[13]  Geoff DiMego,et al.  21.3 The NOAA/NWS/NCEP Short Range Ensemble Forecast (SREF) system: Evaluation of an initial condition vs multiple model physics ensemble approach , 2004 .

[14]  Thomas S. Wallsten,et al.  Measuring Vague Uncertainties and Understanding Their Use in Decision Making , 1990 .

[15]  Colin Camerer,et al.  Recent developments in modeling preferences: Uncertainty and ambiguity , 1992 .

[16]  冨山 芳幸,et al.  「Completing the Forecast : Characterizing and Communicating Uncertainty for Better Decisions Using Weather and Climate Forecasts」, National Research Council著, The National Academies Press, 2006年, 112頁, 25.88ドル, ISBN-13:978-0-309-10255-1(本だな) , 2007 .

[17]  Sue Ellen Haupt,et al.  Ensemble Variance Calibration for Representing Meteorological Uncertainty for Atmospheric Transport and Dispersion Modeling , 2009 .

[18]  D. Wilks.  Effects of stochastic parametrizations in the Lorenz '96 system , 2005 .

[19]  Neill E. Bowler,et al.  On the Reliability and Calibration of Ensemble Forecasts , 2009 .

[20]  Clifford F. Mass,et al.  Measuring the Ensemble Spread–Error Relationship with a Probabilistic Approach: Stochastic Ensemble Results , 2007 .

[21]  A. Raftery,et al.  Using Bayesian Model Averaging to Calibrate Forecast Ensembles , 2005 .

[22]  mith,et al.  Evaluating Probabilistic Forecasts Using Information Theory , 2002 .

[23]  Thomas M. Hamill,et al.  Verification of Eta–RSM Short-Range Ensemble Forecasts , 1997 .

[24]  David S. Richardson,et al.  ON THE ECONOMIC VALUE OF ENSEMBLE BASED WEATHER FORECASTS , 2001 .

[25]  Clifford F. Mass,et al.  Aspects of Effective Mesoscale, Short-Range Ensemble Forecasting , 2005 .

[26]  D. Richardson.  Skill and relative economic value of the ECMWF ensemble prediction system , 2000 .

[27]  David S. Richardson,et al.  Measures of skill and value of ensemble prediction systems, their interrelationship and the effect of ensemble size , 2001 .