Encapsulation of parametric uncertainty statistics by various predictive machine learning models: MLUE method

Monte Carlo simulation-based uncertainty analysis techniques have been applied successfully in hydrology for quantification of the model output uncertainty. They are flexible, conceptually simple and straightforward, but provide only average measures of uncertainty based on past data. However, if one needs to estimate uncertainty of a model in a particular hydro-meteorological situation in real time application of complex models, Monte Carlo simulation becomes impractical because of the large number of model runs required. This paper presents a novel approach to encapsulating and predicting parameter uncertainty of hydrological models using machine learning techniques. Generalised likelihood uncertainty estimation method (a version of the Monte Carlo method) is first used to assess the parameter uncertainty of a hydrological model, and then the generated data are used to train three machine learning models. Inputs to these models are specially identified representative variables. The trained models are then employed to predict the model output uncertainty which is specific for the new input data. This method has been applied to two contrasting catchments. The experimental results demonstrate that the machine learning models are quite accurate. An important advantage of the proposed method is its efficiency allowing for assessing uncertainty of complex models in real time.

[1]  Lihua Xiong,et al.  An empirical method to improve the prediction limits of the GLUE methodology in rainfall–runoff modeling , 2008 .

[2]  Keith Beven,et al.  Equifinality, data assimilation, and uncertainty estimation in mechanistic modelling of complex environmental systems using the GLUE methodology , 2001 .

[3]  Holger R. Maier,et al.  Neural networks for the prediction and forecasting of water resource variables: a review of modelling issues and applications , 2000, Environ. Model. Softw..

[4]  R. S. Govindaraju,et al.  Artificial Neural Networks in Hydrology , 2010 .

[5]  K. Beven,et al.  Decision tree for choosing an uncertainty analysis methodology: a wiki experiment http://www.floodrisknet.org.uk/methods http://www.floodrisk.net , 2006 .

[6]  David W. Aha,et al.  Instance-Based Learning Algorithms , 1991, Machine Learning.

[7]  A. W. Minns,et al.  Artificial neural networks as rainfall-runoff models , 1996 .

[8]  Yeou-Koung Tung,et al.  Uncertainty and reliability analysis , 1995 .

[9]  Dimitri Solomatine,et al.  Experimental investigation of the predictive capabilities of data driven modeling techniques in hydrology - Part 2: Application , 2009 .

[10]  Dong Jun Seo,et al.  Fast and efficient optimization of hydrologic model parameters using a priori estimates and stepwise line search , 2008 .

[11]  L. S. Pereira,et al.  Crop evapotranspiration : guidelines for computing crop water requirements , 1998 .

[12]  K. P. Sudheer,et al.  Methods used for the development of neural networks for the prediction of water resource variables in river systems: Current status and future directions , 2010, Environ. Model. Softw..

[13]  A. Brath,et al.  A stochastic approach for assessing the uncertainty of rainfall‐runoff simulations , 2004 .

[14]  D. P. Solomatine,et al.  Two Strategies of Adaptive Cluster Covering with Descent and Their Comparison to Other Algorithms , 1999, J. Glob. Optim..

[15]  Hoshin Vijai Gupta,et al.  Model identification for hydrological forecasting under uncertainty , 2005 .

[16]  Durga Lal Shrestha,et al.  Instance‐based learning compared to other data‐driven methods in hydrological forecasting , 2008 .

[17]  S. Sorooshian,et al.  Effective and efficient global optimization for conceptual rainfall‐runoff models , 1992 .

[18]  George Kuczera,et al.  Monte Carlo assessment of parameter uncertainty in conceptual catchment models: the Metropolis algorithm , 1998 .

[19]  P. R. Johnston,et al.  Parameter optimization for watershed models , 1976 .

[20]  Micha Werner,et al.  Reduction of Monte-Carlo simulation runs for uncertainty estimation in hydrological modelling , 2003 .

[21]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[22]  V. A. Epanechnikov Non-Parametric Estimation of a Multivariate Probability Density , 1969 .

[23]  Durga L. Shrestha,et al.  Machine learning approaches for estimation of prediction interval for the model output , 2006, Neural Networks.

[24]  D. Solomatine,et al.  Model trees as an alternative to neural networks in rainfall—runoff modelling , 2003 .

[25]  Avi Ostfeld,et al.  Data-driven modelling: some past experiences and new approaches , 2008 .

[26]  Alberto Montanari,et al.  Large sample behaviors of the generalized likelihood uncertainty estimation (GLUE) in assessing the uncertainty of rainfall‐runoff simulations , 2005 .

[27]  Henrik Madsen,et al.  Generalized likelihood uncertainty estimation (GLUE) using adaptive Markov Chain Monte Carlo sampling , 2008 .

[28]  Henrik Madsen,et al.  Automatic calibration of a conceptual rainfall-runoff model using multiple objectives. , 2000 .

[29]  Ezio Todini,et al.  A model conditional processor to assess predictive uncertainty in flood forecasting , 2008 .

[30]  C. Diks,et al.  Improved treatment of uncertainty in hydrologic modeling: Combining the strengths of global optimization and data assimilation , 2005 .

[31]  P. Mantovan,et al.  Hydrological forecasting uncertainty assessment: Incoherence of the GLUE methodology , 2006 .

[32]  V. Guinot,et al.  Treatment of precipitation uncertainty in rainfall-runoff modelling: a fuzzy set approach , 2004 .

[33]  Christian W. Dawson,et al.  Hydrological modelling using artificial neural networks , 2001 .

[34]  Dimitri P. Solomatine,et al.  River flow forecasting using artificial neural networks , 2001 .

[35]  Dimitri Solomatine,et al.  Experimental investigation of the predictive capabilities of data driven modeling techniques in hydrology - Part 1: Concepts and methodology , 2009 .

[36]  Dimitri Solomatine,et al.  A novel approach to parameter uncertainty analysis of hydrological models using neural networks , 2009 .

[37]  S. Sorooshian,et al.  Automatic calibration of conceptual rainfall-runoff models: sensitivity to calibration data , 1996 .

[38]  J. Stedinger,et al.  Appraisal of the generalized likelihood uncertainty estimation (GLUE) method , 2008 .

[39]  Cajo J. F. ter Braak,et al.  Equifinality of formal (DREAM) and informal (GLUE) Bayesian approaches in hydrologic modeling? , 2009 .

[40]  M. D. McKay,et al.  A comparison of three methods for selecting values of input variables in the analysis of output from a computer code , 2000 .

[41]  M. Trosset,et al.  Bayesian recursive parameter estimation for hydrologic models , 2001 .

[42]  Dimitri P. Solomatine,et al.  Data‐driven approaches for estimating uncertainty in rainfall‐runoff modelling , 2008 .

[43]  Emilio Rosenblueth,et al.  Two-point estimates in probabilities , 1981 .

[44]  K. Beven,et al.  Bayesian Estimation of Uncertainty in Runoff Prediction and the Value of Data: An Application of the GLUE Approach , 1996 .

[45]  R. Abrahart,et al.  Comparing neural network and autoregressive moving average techniques for the provision of continuous river flow forecasts in two contrasting catchments , 2000 .

[46]  Jim W. Hall,et al.  Handling uncertainty in extreme or unrepeatable hydrological processes: the need for an alternative paradigm , 2002 .

[47]  J. Nash,et al.  River flow forecasting through conceptual models part I — A discussion of principles☆ , 1970 .

[48]  Keith Beven,et al.  The future of distributed models: model calibration and uncertainty prediction. , 1992 .

[49]  Heikki Haario,et al.  DRAM: Efficient adaptive MCMC , 2006, Stat. Comput..

[50]  M. Harr Probabilistic estimates for multivariate analyses , 1989 .

[51]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques with Java implementations , 2002, SGMD.

[52]  Dimitri Solomatine,et al.  A novel method to estimate model uncertainty using machine learning techniques , 2009 .

[53]  Dong-Jun Seo,et al.  Towards the characterization of streamflow simulation uncertainty through multimodel ensembles , 2004 .

[54]  D. P. Solomatine Neural Network Approximation of a Hydrodynamic Model in Optimizing Reservoir Operation , 2006 .

[55]  C. S. Melching An improved first-order reliability approach for assessing uncertainties in hydrologic modeling , 1992 .