Stream flow predictions using nature-inspired Firefly Algorithms and a Multiple Model strategy - Directions of innovation towards next generation practices

Display Omitted FireFly Algorithm (FFA) is synthesised with Multi-Layer Perceptrons MLP-FFA.MLP-FFA is compared with MLP using traditional Levenberg-Marquardt (LM): MLP-LM.Improved FFA predictions are significant, attributed to identifying global minimum.Another potential improvement arises by Multiple Models (MM) of MLP-FFA and MLP-LM.FFA and MM are identified as two directions for Innovations towards next generation. Stream flow prediction is studied by Artificial Intelligence (AI) in this paper using Artificial Neural Network (ANN) as a hybrid of Multi-Layer Perceptron (MLP) with the LevenbergMarquardt (LM) backpropagation learning algorithm (MLP-LM) and (ii) MLP integrated with the Fire-Fly Algorithm (MLP-FFA). Monthly stream flow records used in this prediction problem comprise two stations at Bear River, the U.S.A., for the period of 19612012. Six different model structures are investigated for both MLP-LM and MLP-FFA models and their results were analysed using a number of performance measures including Correlation Coefficients (CC) and the Taylor diagram. The results indicate a significant improvement is likely in predicting downstream flows by MLP-FFA over that by MLP-LM, attributed to identifying the global minimum. In addition, an emerging multiple model (ensemble) strategy is employed to treat the outputs of the two MLP-LM and MLP-FFA models as inputs to an ANN model. The results show yet another further possible improvement. These two avenues for improvements identify possible directions towards next generation research activities.

[1]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[2]  Xin-She Yang,et al.  Firefly algorithm, stochastic test functions and design optimisation , 2010, Int. J. Bio Inspired Comput..

[3]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[4]  Spyros Makridakis,et al.  ARMA Models and the Box–Jenkins Methodology , 1997 .

[5]  A A Nadiri,et al.  Supervised Intelligent Committee Machine Method for Hydraulic Conductivity Estimation , 2014, Water Resources Management.

[6]  Mohammad Ali Ghorbani,et al.  Modeling river discharge time series using support vector machine and artificial neural networks , 2016, Environmental Earth Sciences.

[7]  K. Sene,et al.  Review of transfer function modelling for fluvial flood forecasting , 2004 .

[8]  Cândida Ferreira,et al.  Gene Expression Programming: A New Adaptive Algorithm for Solving Problems , 2001, Complex Syst..

[9]  R. Clemen Combining forecasts: A review and annotated bibliography , 1989 .

[10]  Mohammad Ali Ghorbani,et al.  Application of firefly algorithm-based support vector machines for prediction of field capacity and permanent wilting point , 2017 .

[11]  Mahesh Kothari,et al.  Application of ANN and fuzzy logic algorithms for streamflow modelling of Savitri catchment , 2015, Journal of Earth System Science.

[12]  Kurt Hornik,et al.  Approximation capabilities of multilayer feedforward networks , 1991, Neural Networks.

[13]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[14]  Rahman Khatibi,et al.  Mapping vulnerability of multiple aquifers using multiple models and fuzzy logic to objectively derive model structures. , 2017, The Science of the total environment.

[15]  Rahman Khatibi,et al.  Assessment of groundwater vulnerability using supervised committee to combine fuzzy logic models , 2017, Environmental Science and Pollution Research.

[16]  M. Reza Rezaee,et al.  Petrophysical data prediction from seismic attributes using committee fuzzy inference system , 2009, Comput. Geosci..

[17]  Babak Mohammadi,et al.  Pan evaporation prediction using a hybrid multilayer perceptron-firefly algorithm (MLP-FFA) model: case study in North Iran , 2018, Theoretical and Applied Climatology.

[18]  Stevan Prohaska,et al.  Hydrological flow rate estimation using artificial neural networks: Model development and potential applications , 2016, Appl. Math. Comput..

[19]  Chang-Hsu Chen,et al.  A committee machine with empirical formulas for permeability prediction , 2006, Comput. Geosci..

[20]  K. Taylor Summarizing multiple aspects of model performance in a single diagram , 2001 .

[21]  Dragan Savic,et al.  A Genetic Programming Approach to Rainfall-Runoff Modelling , 1999 .

[22]  Mohammad Ali Ghorbani,et al.  Uncertainty assessment of the multilayer perceptron (MLP) neural network model with implementation of the novel hybrid MLP-FFA method for prediction of biochemical oxygen demand and dissolved oxygen: a case study of Langat River , 2017, Environmental Earth Sciences.

[23]  Mohammad Ali Ghorbani,et al.  Comparison of three artificial intelligence techniques for discharge routing , 2011 .

[24]  Çagdas Hakan Aladag,et al.  A new model selection strategy in artificial neural networks , 2008, Appl. Math. Comput..

[25]  S Sapna,et al.  Backpropagation Learning Algorithm Based on Levenberg Marquardt Algorithm , 2012 .

[26]  Geoffrey A. Moore Crossing the chasm : marketing and selling high-tech products to mainstream customers , 1999 .

[27]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[28]  Xin-She Yang,et al.  Firefly Algorithms for Multimodal Optimization , 2009, SAGA.

[29]  Rahman Khatibi,et al.  Developing a predictive tropospheric ozone model for Tabriz , 2013 .

[30]  Marwa M. Hassan,et al.  Supervised Intelligence Committee Machine to Evaluate Field Performance of Photocatalytic Asphalt Pavement for Ambient Air Purification , 2015 .

[31]  Slawomir Zak,et al.  Firefly Algorithm for Continuous Constrained Optimization Tasks , 2009, ICCCI.

[32]  Mohammad Ali Ghorbani,et al.  Dynamics of hourly sea level at Hillarys Boat Harbour, Western Australia: a chaos theory perspective , 2011 .

[33]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[34]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[35]  Ronny Berndtsson,et al.  Advances in Data-Based Approaches for Hydrologic Modeling and Forecasting , 2010 .

[36]  Frank T.-C. Tsai,et al.  Supervised committee machine with artificial intelligence for prediction of fluoride concentration , 2013 .

[37]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[38]  Rahman Khatibi,et al.  Groundwater vulnerability indices conditioned by Supervised Intelligence Committee Machine (SICM). , 2017, The Science of the total environment.

[39]  Ian Flood,et al.  Towards the next generation of artificial neural networks for civil engineering , 2008, Adv. Eng. Informatics.

[40]  Frank Rosenblatt,et al.  PRINCIPLES OF NEURODYNAMICS. PERCEPTRONS AND THE THEORY OF BRAIN MECHANISMS , 1963 .