Quantification of the predictive uncertainty of artificial neural network based river flow forecast models

The meaningful quantification of uncertainty in hydrological model outputs is a challenging task since complete knowledge about the hydrologic system is still lacking. Owing to the nonlinearity and complexity associated with the hydrological processes, Artificial neural network (ANN) based models have gained lot of attention for its effectiveness in function approximation characteristics. However, only a few studies have been reported for assessment of uncertainty associated with ANN outputs. This study uses a simple method for quantifying predictive uncertainty of ANN model output through first order Taylor series expansion. The first order partial differential equations of non-linear function approximated by the ANN with respect to weights and biases of the ANN model are derived. A bootstrap technique is employed in estimating the values of the mean and the standard deviation of ANN parameters, and is used to quantify the predictive uncertainty. The method is demonstrated through the case study of Upper White watershed located in the United States. The quantitative assessment of uncertainty is carried out with two measures such as percentage of coverage and average width. In order to show the magnitude of uncertainty in different flow domains, the values are statistically categorized into low-, medium- and high-flow series. The results suggest that the uncertainty bounds of ANN outputs can be effectively quantified using the proposed method. It is observed that the level of uncertainty is directly proportional to the magnitude of the flow and hence varies along time. A comparison of the uncertainty assessment shows that the proposed method effectively quantifies the uncertainty than bootstrap method.

[1]  J. Nash,et al.  River flow forecasting through conceptual models part I — A discussion of principles☆ , 1970 .

[2]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[3]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[4]  David J. C. MacKay,et al.  A Practical Bayesian Framework for Backpropagation Networks , 1992, Neural Computation.

[5]  Chang-tseh Hsieh,et al.  Some Potential Applications of Artificial Neural Systems in Financial Management , 1993 .

[6]  A. Weigend,et al.  Estimating the mean and variance of the target probability distribution , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[7]  An Artificial Neural-Network Approach to ERP Classification , 1995, Brain and Cognition.

[8]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[9]  George Chryssolouris,et al.  Confidence interval prediction for neural network models , 1996, IEEE Trans. Neural Networks.

[10]  Christian W. Dawson,et al.  An artificial neural network approach to rainfall-runoff modelling , 1998 .

[11]  A. Soldati,et al.  Forecasting river flow rate during low‐flow periods using neural networks , 1999 .

[12]  B. S. Thandaveswara,et al.  A non-linear rainfall–runoff model using an artificial neural network , 1999 .

[13]  Christian W. Dawson,et al.  Inductive Learning Approaches to Rainfall-Runoff Modelling , 2000, Int. J. Neural Syst..

[14]  Ashish Sharma,et al.  A study of optimal model lag and spatial inputs to artificial neural network for rainfall forecasting , 2000 .

[15]  Alan F. Murray,et al.  Confidence estimation methods for neural networks : a practical comparison , 2001, ESANN.

[16]  John A. Dracup,et al.  Artificial Neural Networks and Long-Range Precipitation Prediction in California , 2000 .

[17]  K. Thirumalaiah,et al.  Hydrological Forecasting Using Neural Networks , 2000 .

[18]  K. P. Sudheer,et al.  A data‐driven algorithm for constructing artificial neural network rainfall‐runoff models , 2002 .

[19]  Klaus Schittkowski,et al.  EASY-FIT: a software system for data fitting in dynamical systems , 2002 .

[20]  Aidong Adam Ding,et al.  Backpropagation of pseudo-errors: neural networks that are adaptive to heterogeneous noise , 2003, IEEE Trans. Neural Networks.

[21]  Holger R. Maier,et al.  Input determination for neural network models in water resources applications. Part 2. Case study: forecasting salinity in a river , 2005 .

[22]  Martin F. Lambert,et al.  Bayesian training of artificial neural networks used for water resources modeling , 2005 .

[23]  Holger R. Maier,et al.  Input determination for neural network models in water resources applications. Part 1—background and methodology , 2005 .

[24]  K. P. Sudheer,et al.  Knowledge Extraction from Trained Neural Network River Flow Models , 2005 .

[25]  K. P. Sudheer,et al.  Short‐term flood forecasting with a neurofuzzy model , 2005 .

[26]  Durga L. Shrestha,et al.  Machine learning approaches for estimation of prediction interval for the model output , 2006, Neural Networks.

[27]  Paulin Coulibaly,et al.  Bayesian neural network for rainfall‐runoff modeling , 2006 .

[28]  Indrajeet Chaubey,et al.  A simplified approach to quantifying predictive and parametric uncertainty in artificial neural network hydrologic models , 2007 .

[29]  Simon Li,et al.  Uncertainties in real‐time flood forecasting with neural networks , 2007 .

[30]  Kourosh Behzadian,et al.  Stochastic sampling design using a multi-objective genetic algorithm and adaptive neural networks , 2009, Environ. Model. Softw..

[31]  Dimitri Solomatine,et al.  Experimental investigation of the predictive capabilities of data driven modeling techniques in hydrology - Part 2: Application , 2009 .

[32]  Asaad Y. Shamseldin,et al.  NEARLY TWO DECADES OF NEURAL NETWORK HYDROLOGIC MODELING , 2009 .

[33]  Rajesh R. Shrestha,et al.  Physically Based and Data-Driven Models and Propagation of Input Uncertainties in River Flood Prediction , 2009 .

[34]  Hafzullah Aksoy,et al.  Artificial neural network models for forecasting monthly precipitation in Jordan , 2009 .

[35]  Dimitri Solomatine,et al.  Experimental investigation of the predictive capabilities of data driven modeling techniques in hydrology - Part 1: Concepts and methodology , 2009 .

[36]  Faming Liang,et al.  Estimating uncertainty of streamflow simulation using Bayesian neural networks , 2009 .

[37]  K. N. Tiwari,et al.  Bootstrap based artificial neural network (BANN) analysis for hierarchical prediction of monthly runoff in Upper Damodar Valley Catchment , 2009 .

[38]  F. Anctil,et al.  An experiment on the evolution of an ensemble of neural networks for streamflow forecasting , 2009 .

[39]  Ronny Berndtsson,et al.  Advances in Data-Based Approaches for Hydrologic Modeling and Forecasting , 2010 .

[40]  Saeid Nahavandi,et al.  A prediction interval-based approach to determine optimal structures of neural network metamodels , 2010, Expert Syst. Appl..

[41]  Mahmud Güngör,et al.  Monthly total sediment forecasting using adaptive neuro fuzzy inference system , 2010 .

[42]  Stefano Alvisi,et al.  Fuzzy Neural Networks for water level and discharge forecasting , 2010 .

[43]  Chandranath Chatterjee,et al.  Uncertainty assessment and ensemble flood forecasting using bootstrap based artificial neural networks (BANNs) , 2010 .

[44]  K. P. Sudheer,et al.  Methods used for the development of neural networks for the prediction of water resource variables in river systems: Current status and future directions , 2010, Environ. Model. Softw..

[45]  Stefano Alvisi,et al.  Fuzzy neural networks for water level and discharge forecasting with uncertainty , 2010, Environ. Model. Softw..

[46]  Rifat Sonmez.  Range estimation of construction costs using neural networks with bootstrap prediction intervals , 2011, Expert Syst. Appl..