Assessment and weighting of meteorological ensemble forecast members based on supervised machine learning with application to runoff simulations and flood warning

Numerical weather forecasts, such as meteorological forecasts of precipitation, are inherently uncertain. These uncertainties depend on model physics as well as initial and boundary conditions. Since precipitation forecasts form the input into hydrological models, the uncertainties of the precipitation forecasts result in uncertainties of flood forecasts. In order to consider these uncertainties, ensemble prediction systems are applied. These systems consist of several members simulated by different models or using a single model under varying initial and boundary conditions. However, a too wide uncertainty range obtained as a result of taking into account members with poor prediction skills may lead to underestimation or exaggeration of the risk of hazardous events. Therefore, the uncertainty range of model-based flood forecasts derived from the meteorological ensembles has to be restricted.In this paper, a methodology towards improving flood forecasts by weighting ensemble members according to their skills is presented. The skill of each ensemble member is evaluated by comparing the results of forecasts corresponding to this member with observed values in the past. Since numerous forecasts are required in order to reliably evaluate the skill, the evaluation procedure is time-consuming and tedious. Moreover, the evaluation is highly subjective, because an expert who performs it makes his decision based on his implicit knowledge.Therefore, approaches for the automated evaluation of such forecasts are required. Here, we present a semi-automated approach for the assessment of precipitation forecast ensemble members. The approach is based on supervised machine learning and was tested on ensemble precipitation forecasts for the area of the Mulde river basin in Germany. Based on the evaluation results of the specific ensemble members, weights corresponding to their forecast skill were calculated. These weights were then successfully used to reduce the uncertainties within rainfall-runoff simulations and flood risk predictions.

[1]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[2]  Ian Witten,et al.  Data Mining , 2000 .

[3]  F. Anthony Eckel,et al.  Calibrated Probabilistic Quantitative Precipitation Forecasts Based on the MRF Ensemble , 2012 .

[4]  R. Moore,et al.  Ensemble Flood Forecasting , 2009 .

[5]  J. M. Sloughter,et al.  Probabilistic Quantitative Precipitation Forecasting Using Bayesian Model Averaging , 2007 .

[6]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[7]  Hoshin Vijai Gupta,et al.  Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling , 2009 .

[8]  T. N. Krishnamurti,et al.  Improved Weather and Seasonal Climate Forecasts from Multimodel Superensemble. , 1999, Science.

[9]  C. Keil,et al.  A Displacement and Amplitude Score Employing an Optical Flow Technique , 2009 .

[10]  Anton H. Westveld,et al.  Calibrated Probabilistic Forecasting Using Ensemble Model Output Statistics and Minimum CRPS Estimation , 2005 .

[11]  Keith Beven,et al.  The future of distributed models: model calibration and uncertainty prediction. , 1992 .

[12]  Matthias Steiner,et al.  A machine-learning approach to finding weather regimes and skillful predictor combinations for short-term storm forecasting [presentation] , 2008 .

[13]  Yufeng Kou,et al.  Abnormal Pattern Recognition in Spatial Data , 2006 .

[14]  Daniel Leuenberger,et al.  Best Member Selection for convective-scale ensembles , 2011 .

[15]  C. Simmer,et al.  Uncertainties in Weather Forecast – Reasons and Handling , 2011 .

[16]  Vivien Mallet,et al.  Automatic calibration of an ensemble for uncertainty estimation and probabilistic forecast: Application to air quality , 2011 .

[17]  T. Hamill,et al.  Stochastic forcing , ensemble prediction systems , and TIGGE , 2015 .

[18]  Göran Lindström,et al.  Development and test of the distributed HBV-96 hydrological model , 1997 .

[19]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[20]  Jörg Dietrich,et al.  Assessing uncertainties in flood forecasts for decision making: prototype of an operational flood management system integrating ensemble predictions , 2009 .

[21]  Bodo Ahrens,et al.  On the Weighting of Multimodel Ensembles in Seasonal and Short-Range Weather Forecasting , 2009 .

[22]  Thomas M. Hamill,et al.  Measuring forecast skill: is it real skill or is it the varying climatology? , 2006 .

[23]  Yan Wang,et al.  Framing Uncertainties in Flood Forecasting with Ensembles , 2011 .

[24]  Jason P. Evans,et al.  Optimally choosing small ensemble members to produce robust climate simulations , 2013 .

[25]  Christian Gagné,et al.  Simplifying a hydrological ensemble prediction system with a backward greedy selection of members – Part 1: Optimization criteria , 2011 .

[26]  R. Grayson,et al.  Hydrologic model assessment from automated spatial pattern comparison techniques , 2003 .

[27]  M. Baldauf,et al.  Operational Convective-Scale Numerical Weather Prediction with the COSMO Model: Description and Sensitivities , 2011 .

[28]  A. Raftery,et al.  Using Bayesian Model Averaging to Calibrate Forecast Ensembles , 2005 .

[29]  Florian Pappenberger,et al.  Ensemble flood forecasting: a review. , 2009 .

[30]  Ming Xue,et al.  Machine learning enhancement of Storm Scale Ensemble precipitation forecasts , 2012, CIDU.

[31]  M. Steiner,et al.  A MACHINE LEARNING APPROACH TO FINDING WEATHER REGIMES AND SKILLFUL PREDICTOR COMBINATIONS FOR SHORT-TERM STORM FORECASTING , 2008 .

[32]  J. Nash,et al.  River flow forecasting through conceptual models part I — A discussion of principles☆ , 1970 .

[33]  Vivien Mallet,et al.  Ozone ensemble forecast with machine learning algorithms , 2009 .

[34]  Juan José Rodríguez Diez,et al.  Rotation Forest: A New Classifier Ensemble Method , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.