Estimation of flood warning runoff thresholds in ungauged basins with asymmetric error functions

Abstract. In many real-world flood forecasting systems, the runoff thresholds for activating warnings or mitigation measures correspond to the flow peaks with a given return period (often 2 years, which may be associated with the bankfull discharge). At locations where the historical streamflow records are absent or very limited, the threshold can be estimated with regionally derived empirical relationships between catchment descriptors and the desired flood quantile. Whatever the function form, such models are generally parameterised by minimising the mean square error, which assigns equal importance to overprediction or underprediction errors. Considering that the consequences of an overestimated warning threshold (leading to the risk of missing alarms) generally have a much lower level of acceptance than those of an underestimated threshold (leading to the issuance of false alarms), the present work proposes to parameterise the regression model through an asymmetric error function, which penalises the overpredictions more. The estimates by models (feedforward neural networks) with increasing degree of asymmetry are compared with those of a traditional, symmetrically trained network, in a rigorous cross-validation experiment referred to a database of catchments covering the country of Italy. The analysis shows that the use of the asymmetric error function can substantially reduce the number and extent of overestimation errors, if compared to the use of the traditional square errors. Of course such reduction is at the expense of increasing underestimation errors, but the overall accurateness is still acceptable and the results illustrate the potential value of choosing an asymmetric error function when the consequences of missed alarms are more severe than those of false alarms.

[1]  Vijay P. Singh,et al.  Estimation of Mean Annual Flood in Indian Catchments Using Backpropagation Neural Network and M5 Model Tree , 2010 .

[2]  T.,et al.  Training Feedforward Networks with the Marquardt Algorithm , 2004 .

[3]  Witold F. Krajewski,et al.  On the Uncertainties of Flash Flood Guidance: Toward Probabilistic Forecasting of Flash Floods , 2006 .

[4]  Marco Franchini,et al.  Estimating the index flood using indirect methods , 2001 .

[5]  Bernard Bobée,et al.  Daily reservoir inflow forecasting using artificial neural networks with stopped training approach , 2000 .

[6]  G. Wilkerson Improved Bankfull Discharge Prediction Using 2‐Year Recurrence‐Period Discharge 1 , 2008 .

[7]  J. Demargne,et al.  Evaluating flash-flood warnings at ungauged locations using post-event surveys: a case study with the AIGA warning system , 2014 .

[8]  J. Schaake,et al.  A distributed hydrologic model and threshold frequency-based method for flash flood forecasting at ungauged locations , 2007 .

[9]  A. W. Minns,et al.  The classification of hydrologically homogeneous regions , 1999 .

[10]  Holger R. Maier,et al.  Data-driven modelling approaches for socio-hydrology: opportunities and challenges within the Panta Rhei Science Plan , 2016 .

[11]  G. Blöschl,et al.  Runoff prediction in ungauged basins: Synthesis across processes, places and scales , 2013 .

[12]  Francesco Napolitano,et al.  Rainfall threshold definition using an entropy decision approach and radar data , 2011 .

[13]  G. Blöschl,et al.  Flood frequency regionalisation—spatial proximity vs. catchment attributes , 2005 .

[14]  F. Diebold,et al.  Further results on forecasting and model selection under asymmetric loss , 1996 .

[15]  Quan J. Wang,et al.  A review of advances in flash flood forecasting , 2011 .

[16]  Ataur Rahman,et al.  Application of artificial neural networks in regional flood frequency analysis: a case study for Australia , 2014, Stochastic Environmental Research and Risk Assessment.

[17]  C. Shu,et al.  Regional flood frequency analysis at ungauged sites using the adaptive neuro-fuzzy inference system , 2008 .

[18]  A. Ramachandra Rao,et al.  Regional flood frequency analysis by combining self-organizing feature map and fuzzy clustering , 2008 .

[19]  Meng-Jung Tsai,et al.  Assessing the ecological hydrology of natural flow conditions in Taiwan , 2008 .

[20]  R. Abrahart,et al.  Flood estimation at ungauged sites using artificial neural networks , 2006 .

[21]  Chang Shu,et al.  Artificial neural network ensembles and their application in pooled flood frequency analysis , 2004 .

[22]  R. Derose,et al.  Variability and uncertainty in reach bankfull hydraulic geometry , 2008 .

[23]  Sven F. Crone,et al.  Training artificial neural networks for time series prediction using asymmetric cost functions , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[24]  Murugesu Sivapalan,et al.  Comparative assessment of predictions in ungauged basins – Part 2: Flood and low flow studies , 2013 .

[25]  Bernard Widrow,et al.  The basic ideas in neural networks , 1994, CACM.

[26]  Raghavan Srinivasan,et al.  PREDICTION OF TWO‐YEAR PEAK STREAM‐DISCHARGES USING NEURAL NETWORKS 1 , 1997 .

[27]  Paul D. Bates,et al.  Regional flood frequency analysis at the global scale , 2015 .

[28]  Florian Pappenberger,et al.  New dimensions in early flood warning across the globe using grand‐ensemble weather predictions , 2008 .

[29]  Sven F. Crone Training Artificial Neural Networks using Asymmetric Cost Functions , 2002 .

[30]  V. Nguyen,et al.  A comparative study of regression based methods in regional flood frequency analysis , 1999 .

[31]  Andrew J. Patton,et al.  Properties of Optimal Forecasts under Asymmetric Loss and Nonlinearity , 2007 .

[32]  Holger R. Maier,et al.  DATA DIVISION FOR DEVELOPING NEURAL NETWORKS APPLIED TO GEOTECHNICAL ENGINEERING , 2004 .

[33]  Marco Borga,et al.  Flash flood warning in ungauged basins by use of the flash flood guidance and model‐based runoff thresholds , 2009 .

[34]  Brenden Jongman,et al.  Assessing flood risk at the global scale: model setup, results, and sensitivity , 2013 .

[35]  M. J. Hall,et al.  Artificial Neural Network Concepts in Hydrology , 2006 .

[36]  J. Stedinger,et al.  Regional Hydrologic Analysis: 1. Ordinary, Weighted, and Generalized Least Squares Compared , 1985 .

[37]  David A. Jones,et al.  Using multiple donor sites for enhanced flood estimation in ungauged catchments , 2014 .

[38]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[39]  Christian W. Dawson,et al.  Hydrological modelling using artificial neural networks , 2001 .

[40]  Groupe de recherche en hydrologie statistique Presentation and review of some methods for regional flood frequency analysis , 1996 .

[41]  R. Mantilla,et al.  A framework for flood risk assessment under nonstationary conditions or in the absence of historical data , 2011 .

[42]  K. P. Sudheer,et al.  Methods used for the development of neural networks for the prediction of water resource variables in river systems: Current status and future directions , 2010, Environ. Model. Softw..

[43]  J. Zupan,et al.  Modelling of the river flowrate: the influence of the training set selection , 2000 .

[44]  F. Diebold,et al.  Forecast Evaluation and Combination , 1996 .

[45]  Elena Toth,et al.  Catchment classification based on characterisation of streamflow and precipitation time series , 2012 .

[46]  Clive W. J. Granger,et al.  Outline of forecast theory using generalized cost functions , 1999 .

[47]  Jery R. Stedinger,et al.  Appraisal of regional and index flood quantile estimators , 1995 .

[48]  S. Kohnová,et al.  Application of Artificial Neural Networks for estimating index floods , 2012 .

[49]  Ralf Merz,et al.  Catchment classification by runoff behaviour with self-organizing maps (SOM) , 2011, Hydrology and Earth System Sciences.

[50]  Attilio Castellarin,et al.  Topological and canonical kriging for design flood prediction in ungauged catchments: an improvement over a traditional regional regression approach? , 2012 .

[51]  Conleth Cunnane,et al.  Review of Statistical Models for Flood Frequency Estimation , 1987 .

[52]  Holger R. Maier,et al.  Optimal division of data for neural network models in water resources applications , 2002 .

[53]  B. Merz,et al.  Significance of "high probability/low damage" versus "low probability/high damage" flood events , 2009 .

[54]  Attilio Castellarin,et al.  Data-driven catchment classification: application to the pub problem , 2011 .

[55]  A. M. Kalteh,et al.  Review of the self-organizing map (SOM) approach in water resources: Analysis, modelling and application , 2008, Environ. Model. Softw..

[56]  Clive W. J. Granger,et al.  A Decision_Theoretic Approach to Forecast Evaluation , 2000 .

[57]  P. Coulibaly,et al.  Two decades of anarchy? Emerging themes and outstanding challenges for neural network river forecasting , 2012 .

[58]  A. Strauß Flash Floods Forecasting And Warning , 2016 .

[59]  M. Hipsey,et al.  “Panta Rhei—Everything Flows”: Change in hydrology and society—The IAHS Scientific Decade 2013–2022 , 2013 .

[60]  Elena Toth,et al.  Asymmetric Error Functions for Reducing the Underestimation of Local Scour around Bridge Piers: Application to Neural Networks Models , 2015 .

[61]  Mario Jino,et al.  Machine Learning Methods and Asymmetric Cost Function to Estimate Execution Effort of Software Testing , 2010, 2010 Third International Conference on Software Testing, Verification and Validation.

[62]  J. S. Verkade,et al.  Estimating the benefits of single value and probability forecasting for flood warning , 2011 .

[63]  A. W. Minns,et al.  The application of data mining techniques for the regionalisation of hydrological variables , 2002 .

[64]  Daniele Bocchiola,et al.  Review of recent advances in index flood estimation , 2003 .

[65]  J. Stedinger,et al.  The use of GLS regression in regional hydrologic analyses , 2007 .

[66]  Roland Schulze,et al.  Flood frequency analysis at ungauged sites in the KwaZulu-Natal Province, South Africa , 2001 .

[67]  Mario L. V. Martina,et al.  A Bayesian decision approach to rainfall thresholds based flood warning , 2005 .

[68]  Allan Timmermann,et al.  Estimation and Testing of Forecast Rationality under Flexible Loss , 2005 .

[69]  D. L. Fread,et al.  National threshold runoff estimation utilizing GIS in support of operational flash flood warning systems , 1999 .