Knowledge Extraction from Artificial Neural Networks for Rainfall-Runoff Model Combination Systems

AbstractArtificial neural networks (ANNs) are generally regarded to behave as black-box systems. Recent research explores various methods that can provide an insight into the internal connections and relationships existing within the network. Various methodologies that understand the input variable contribution are analyzed in detail, and rule extraction approaches for a trained artificial neural network are addressed. To understand the contribution of input variables to rainfall-runoff model combination systems, this paper for the first time investigates knowledge extraction from artificial neural network, which is used to combine the results obtained from different competing rainfall-runoff models, using three different approaches: (1) Garson’s algorithm; (2) neural interpretation diagram (NID); and (3) sensitivity analysis (SA). For the purpose of investigating knowledge extraction techniques, the trained multilayer perceptron neural network to combine the results from four different rainfall-runoff mo...

[1]  Martin F. Lambert,et al.  Calibration and validation of neural networks to ensure physically plausible hydrological modeling , 2005 .

[2]  Novruz Allahverdi,et al.  Rule extraction from trained adaptive neural networks using artificial immune systems , 2009, Expert Syst. Appl..

[3]  R. Abrahart,et al.  Detection of conceptual model rainfall—runoff processes inside an artificial neural network , 2003 .

[4]  A. Shamseldin,et al.  Methods for combining the outputs of different rainfall–runoff models , 1997 .

[5]  Amin Elshorbagy,et al.  Prediction of hourly actual evapotranspiration using neural networks, genetic programming, and statistical models , 2010 .

[6]  I. Dimopoulos,et al.  Application of neural networks to modelling nonlinear relationships in ecology , 1996 .

[7]  Ozgur Kisi,et al.  Streamflow Forecasting Using Different Artificial Neural Network Algorithms , 2007 .

[8]  Ashu Jain,et al.  Dissection of trained neural network hydrologic models for knowledge extraction , 2009 .

[9]  Uygar Özesmi,et al.  An artificial neural network approach to spatial habitat modelling with interspecific interaction , 1999 .

[10]  Daniel S. Chapman,et al.  Community versus single‐species distribution models for British plants , 2011 .

[11]  François Anctil,et al.  A soil moisture index as an auxiliary ANN input for stream flow forecasting , 2004 .

[12]  Young-Oh Kim,et al.  Rainfall‐runoff models using artificial neural networks for ensemble streamflow prediction , 2005 .

[13]  Julian D. Olden,et al.  Illuminating the “black box”: a randomization approach for understanding variable contributions in artificial neural networks , 2002 .

[14]  Momcilo Markus,et al.  PRECIPITATION-RUNOFF MODELING USING ARTIFICIAL NEURAL NETWORKS AND CONCEPTUAL MODELS , 2000 .

[15]  Jianming Xu,et al.  Application of neural network and MODIS 250m imagery for estimating suspended sediments concentration in Hangzhou Bay, China , 2009 .

[16]  Nasreen Islam Khan,et al.  Simulating and predicting river discharge time series using a wavelet‐neural network hybrid modelling approach , 2012 .

[17]  Joachim Diederich,et al.  Survey and critique of techniques for extracting rules from trained artificial neural networks , 1995, Knowl. Based Syst..

[18]  Asaad Y. Shamseldin,et al.  Comparison of different forms of the Multi-layer Feed-Forward Neural Network method used for river flow forecasting , 2002 .

[19]  M. Gevrey,et al.  Review and comparison of methods to study the contribution of variables in artificial neural network models , 2003 .

[20]  koushal kumar.  Knowledge Extraction From Trained Neural Networks , 2012 .

[21]  Gary R. Weckman,et al.  Knowledge Extraction from the Neural ‘Black Box’ in Ecological Monitoring , 2009 .

[22]  Asaad Y. Shamseldin,et al.  A comparative study of three neural network forecast combination methods for simulated river flows of different rainfall—runoff models , 2007 .

[23]  G. David Garson,et al.  Interpreting neural-network connection weights , 1991 .

[24]  Ozgur Kisi,et al.  Methods to improve the neural network performance in suspended sediment estimation , 2006 .

[25]  K. P. Sudheer,et al.  Knowledge Extraction from Trained Neural Network River Flow Models , 2005 .

[26]  Aman Mohammad Kalteh,et al.  Rainfall-Runoff Modelling Using Artificial Neural Networks (ANNs) , 2007 .

[27]  Stephen I. Gallant,et al.  Connectionist expert systems , 1988, CACM.

[28]  Russell G. Death,et al.  An accurate comparison of methods for quantifying variable importance in artificial neural networks using simulated data , 2004 .