A comprehensive comparison of recent developed meta-heuristic algorithms for streamflow time series forecasting problem

Abstract Hydrological models play a crucial role in water planning and decision making. Machine Learning-based models showed several drawbacks for frequent high and a wide range of streamflow records. These models also experience problems during the training process such as over-fitting or trapping in searching for global optima To overcome these limitations, the current study attempts to hybridize the recently developed physics-inspired metaheuristic algorithms (MHAs) such as Equilibrium Optimization (EO), Henry Gases Solubility Optimization (HGSO), and Nuclear Reaction Optimization(NRO) with Multi-layer Perceptron (MLP). These models’ accuracy will be inspected to solve the streamflow forecasting problem where the streamflow dataset was collected through 130 years from a station located on the High Aswan Dam (HAD). The performance of proposed models then will be compared with two traditional neural network models(MLP and RNN), and nine well-known hybrid MLP-based models belong to the different branches of the metaheuristic field (evolutionary group, swarm group, and physics group). The internal parameters of the proposed models will be initialized and optimized. Different performance metrics will be used to examine the performance of the proposed models. The stability of the proposed models and the convergence speed will be evaluated. Finally, ranking these models based on different performance evaluations will be carried out. The results show that the models in the group of Physics-MLP are more reliable in capturing the streamflow patterns, followed by the Swarm-MLP group and then by the Evolutionary-MLP group. Finally, among the all employed methods, the NRO has the best accuracy with the lowest RMSE(2.35), MAE(1.356), MAPE(16.747), and the highest WI(0.957), R(0.924), and confidence in forecasting the streamflow of Aswan High Dam. It can be concluded that augmenting the NRO algorithm with MLP can be a reliable tool in forecasting the monthly streamflow with a high level of precision, speed convergence, and high constancy level.

[1]  Daniel P. Loucks,et al.  Water management: Current and future challenges and research directions , 2015 .

[2]  Ahmed El-Shafie,et al.  Improving artificial intelligence models accuracy for monthly streamflow forecasting using grey Wolf optimization (GWO) algorithm , 2020 .

[3]  Mir Saman Pishvaee,et al.  Electron radar search algorithm: a novel developed meta-heuristic algorithm , 2020, Soft Comput..

[4]  Seyed Mohammad Mirjalili,et al.  The Ant Lion Optimizer , 2015, Adv. Eng. Softw..

[5]  A. El-Shafie,et al.  Wavelet-ANN versus ANN-Based Model for Hydrometeorological Drought Forecasting , 2018, Water.

[6]  Seyed Mohammad Mirjalili,et al.  Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm , 2015, Knowl. Based Syst..

[7]  Gaurav Dhiman,et al.  Spotted hyena optimizer: A novel bio-inspired based metaheuristic technique for engineering applications , 2017, Adv. Eng. Softw..

[8]  Yuehua Wu,et al.  A Comparative Assessment of Six Machine Learning Models for Prediction of Bending Force in Hot Strip Rolling Process , 2020, Metals.

[9]  Nguyen Thi Thuy Linh,et al.  Hybrid model to improve the river streamflow forecasting utilizing multi-layer perceptron-based intelligent water drop optimization algorithm , 2020, Soft Computing.

[10]  Fateh Chebana,et al.  Streamflow forecasting using functional regression. , 2016, 1610.06154.

[11]  Ali Kaveh,et al.  Water Evaporation Optimization , 2016 .

[12]  Ahmed El-Shafie,et al.  Suspended sediment load prediction using artificial neural network and ant lion optimization algorithm , 2020, Environmental science and pollution research international.

[13]  OVEIS ABEDINIA,et al.  A new metaheuristic algorithm based on shark smell optimization , 2016, Complex..

[14]  Seyed Mohammad Mirjalili,et al.  Multi-Verse Optimizer: a nature-inspired algorithm for global optimization , 2015, Neural Computing and Applications.

[15]  Ali Najah Ahmed,et al.  Assessing the Predictability of an Improved ANFIS Model for Monthly Streamflow Using Lagged Climate Indices as Predictors , 2019, Water.

[16]  Mohamed Abdel-Basset,et al.  A novel equilibrium optimization algorithm for multi-thresholding image segmentation problems , 2020, Neural Computing and Applications.

[17]  Arun Kumar Sangaiah,et al.  Metaheuristic Algorithms: A Comprehensive Review , 2018 .

[18]  Luca Di Persio,et al.  Artificial Neural Networks architectures for stock price prediction: comparisons and applications , 2016 .

[19]  L. Aldieri,et al.  Environmental innovations and productivity: Empirical evidence from Russian regions , 2019, Resources Policy.

[20]  Seçkin Karasu,et al.  Recognition of COVID-19 disease from X-ray images by hybrid model consisting of 2D curvelet transform, chaotic salp swarm algorithm and deep learning technique , 2020, Chaos, Solitons & Fractals.

[21]  Ali Kaveh,et al.  Tug of War Optimization , 2021, Advances in Metaheuristic Algorithms for Optimal Design of Structures.

[22]  Yu Liu,et al.  A new bio-inspired optimisation algorithm: Bird Swarm Algorithm , 2016, J. Exp. Theor. Artif. Intell..

[23]  Oliver Kramer,et al.  Genetic Algorithm Essentials , 2017, Studies in Computational Intelligence.

[24]  Husheng Wu,et al.  Wolf Pack Algorithm for Unconstrained Global Optimization , 2014 .

[25]  Xiaofei Wang,et al.  Nuclear Reaction Optimization: A Novel and Powerful Physics-Based Algorithm for Global Optimization , 2019, IEEE Access.

[26]  Hossam Faris,et al.  Salp Swarm Algorithm: A bio-inspired optimizer for engineering design problems , 2017, Adv. Eng. Softw..

[27]  Li Li,et al.  Using LSTM and GRU neural network methods for traffic flow prediction , 2016, 2016 31st Youth Academic Annual Conference of Chinese Association of Automation (YAC).

[28]  Binh Minh Nguyen,et al.  nQSV-Net: a novel queuing search variant for global space search and workload modeling , 2021, Journal of Ambient Intelligence and Humanized Computing.

[29]  Alireza Rezazadeh,et al.  A new heuristic optimization algorithm for modeling of proton exchange membrane fuel cell: bird mating optimizer , 2013 .

[30]  Fatma A. Hashim,et al.  A modified Henry gas solubility optimization for solving motif discovery problem , 2019, Neural Computing and Applications.

[31]  Xin-She Yang,et al.  Community detection in networks using bio-inspired optimization: Latest developments, new results and perspectives with a selection of recent meta-heuristics , 2020, Appl. Soft Comput..

[32]  Amir H. Gandomi,et al.  Marine Predators Algorithm: A nature-inspired metaheuristic , 2020, Expert Syst. Appl..

[33]  Vijander Singh,et al.  A novel nature-inspired algorithm for optimization: Squirrel search algorithm , 2019, Swarm Evol. Comput..

[34]  Tu Nguyen,et al.  Efficient Time-Series Forecasting Using Neural Network and Opposition-Based Coral Reefs Optimization , 2019, Int. J. Comput. Intell. Syst..

[35]  A. Kaveh,et al.  A new optimization method: Dolphin echolocation , 2013, Adv. Eng. Softw..

[36]  Yuk Feng Huang,et al.  Application of a rainfall-runoff model for regional-scale flood inundation mapping for the Langat River Basin , 2016 .

[37]  Nurettin Cetinkaya,et al.  A new meta-heuristic optimizer: Pathfinder algorithm , 2019, Appl. Soft Comput..

[38]  Aytaç Altan,et al.  Adaptive Control of a 3D Printer using Whale Optimization Algorithm for Bio-Printing of Artificial Tissues and Organs , 2020, 2020 Innovations in Intelligent Systems and Applications Conference (ASYU).

[39]  Binh Minh Nguyen,et al.  A Resource Usage Prediction System Using Functional-Link and Genetic Algorithm Neural Network for Multivariate Cloud Metrics , 2018, 2018 IEEE 11th Conference on Service-Oriented Computing and Applications (SOCA).

[40]  Federico Chesani,et al.  Statistical stability indices for LIME: obtaining reliable explanations for Machine Learning models , 2020, ArXiv.

[41]  Bo Shen,et al.  A novel swarm intelligence optimization approach: sparrow search algorithm , 2020 .

[42]  Ahmed El-Shafie,et al.  Precipitation Forecasting Using Multilayer Neural Network and Support Vector Machine Optimization Based on Flow Regime Algorithm Taking into Account Uncertainties of Soft Computing Models , 2019, Sustainability.

[43]  Ahmed El-Shafie,et al.  Pipeline Scour Rates Prediction-Based Model Utilizing a Multilayer Perceptron-Colliding Body Algorithm , 2020 .

[44]  S. Shadravan,et al.  The Sailfish Optimizer: A novel nature-inspired metaheuristic algorithm for solving constrained engineering optimization problems , 2019, Eng. Appl. Artif. Intell..

[45]  Wenyong Wang,et al.  A SVR-ANN combined model based on ensemble EMD for rainfall prediction , 2018, Appl. Soft Comput..

[46]  Ozgur Kisi,et al.  Advanced machine learning model for better prediction accuracy of soil temperature at different depths , 2020, PloS one.

[47]  Alireza Askarzadeh,et al.  A novel metaheuristic method for solving constrained engineering optimization problems: Crow search algorithm , 2016 .

[48]  A. Kaveh,et al.  A new meta-heuristic method: Ray Optimization , 2012 .

[49]  V. Singh,et al.  Information theory-based multi-objective design of rainfall network for streamflow simulation , 2020 .

[50]  A. Kaveh,et al.  A novel meta-heuristic optimization algorithm: Thermal exchange optimization , 2017, Adv. Eng. Softw..

[51]  Andrew Lewis,et al.  Let a biogeography-based optimizer train your Multi-Layer Perceptron , 2014, Inf. Sci..

[52]  Vijay Kumar,et al.  Seagull optimization algorithm: Theory and its applications for large-scale industrial engineering problems , 2019, Knowl. Based Syst..

[53]  Wasim Ahmad,et al.  A new forecasting model with wrapper-based feature selection approach using multi-objective optimization technique for chaotic crude oil time series , 2020 .

[54]  Arpan Kumar Kar,et al.  Swarm Intelligence: A Review of Algorithms , 2017 .

[55]  Harish Sharma,et al.  Spider Monkey Optimization algorithm for numerical optimization , 2014, Memetic Computing.

[56]  Aytaç Altan,et al.  Performance of Metaheuristic Optimization Algorithms based on Swarm Intelligence in Attitude and Altitude Control of Unmanned Aerial Vehicle for Path Following , 2020, 2020 4th International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT).

[57]  Binh Minh Nguyen,et al.  A New Workload Prediction Model Using Extreme Learning Machine and Enhanced Tug of War optimization , 2020, ANT/EDI40.

[58]  Hossam Faris,et al.  Optimizing connection weights in neural networks using the whale optimization algorithm , 2016, Soft Computing.

[59]  Wen-Tsao Pan,et al.  A new Fruit Fly Optimization Algorithm: Taking the financial distress model as an example , 2012, Knowl. Based Syst..

[60]  Hossam Faris,et al.  Harris hawks optimization: Algorithm and applications , 2019, Future Gener. Comput. Syst..

[61]  Andrew Lewis,et al.  Grasshopper Optimisation Algorithm: Theory and application , 2017, Adv. Eng. Softw..

[62]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[63]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[64]  Casey Brown,et al.  Sustainable water management under future uncertainty with eco-engineering decision scaling , 2016 .

[65]  Ahmed El-Shafie,et al.  Amplified wavelet-ANFIS-based model for GPS/INS integration to enhance vehicular navigation system , 2013, Neural Computing and Applications.

[66]  S. Mirjalili,et al.  BEO: Binary Equilibrium Optimizer Combined with Simulated Annealing for Feature Selection , 2020 .

[67]  Kiyoumars Roushangar,et al.  Prediction of form roughness coefficient in alluvial channels using efficient hybrid approaches , 2020, Soft Computing.

[68]  Seyedali Mirjalili,et al.  Henry gas solubility optimization: A novel physics-based algorithm , 2019, Future Gener. Comput. Syst..

[69]  Aboelmagd Noureldin,et al.  Adaptive Fast Orthogonal Search (FOS) algorithm for forecasting streamflow , 2020 .

[70]  Ali Kaveh,et al.  Colliding bodies optimization: A novel meta-heuristic method , 2014 .

[71]  Quoc Bao Pham,et al.  Enhancing the Prediction Accuracy of Data-Driven Models for Monthly Streamflow in Urmia Lake Basin Based upon the Autoregressive Conditionally Heteroskedastic Time-Series Model , 2020, Applied Sciences.

[72]  Kashif Hussain,et al.  Optimal Sink Node Placement in Large Scale Wireless Sensor Networks Based on Harris’ Hawk Optimization Algorithm , 2020, IEEE Access.

[73]  K. P. Soman,et al.  Stock price prediction using LSTM, RNN and CNN-sliding window model , 2017, 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[74]  Ali Kaveh,et al.  A new meta-heuristic algorithm: vibrating particles system , 2017 .

[75]  Haijun Yu,et al.  Hybrid machine learning hydrological model for flood forecast purpose , 2020 .

[76]  Kyongjin Sok,et al.  A hybrid model based on convolutional neural networks and long short-term memory for ozone concentration prediction , 2018, Air Quality, Atmosphere & Health.

[77]  Nenghai Yu,et al.  Trust Region Evolution Strategies , 2019, AAAI.

[78]  Igor N. Aizenberg,et al.  Multilayer Neural Network with Multi-Valued Neurons in time series forecasting of oil production , 2014, Neurocomputing.

[79]  Wen-jing Niu,et al.  Short-term streamflow time series prediction model by machine learning tool based on data preprocessing technique and swarm intelligence algorithm , 2020 .

[80]  Liying Wang,et al.  Manta ray foraging optimization: An effective bio-inspired optimizer for engineering applications , 2020, Eng. Appl. Artif. Intell..

[81]  Ahmed El-Shafie,et al.  Enhancing streamflow forecasting using the augmenting ensemble procedure coupled machine learning models: case study of Aswan High Dam , 2019, Hydrological Sciences Journal.

[82]  Hussain Shareef,et al.  Lightning search algorithm , 2015, Appl. Soft Comput..

[83]  Kalyanmoy Deb,et al.  Financial time series prediction using hybrids of chaos theory, multi-layer perceptron and multi-objective evolutionary algorithms , 2017, Swarm Evol. Comput..

[84]  Seyedali Mirjalili,et al.  Equilibrium optimizer: A novel optimization algorithm , 2020, Knowl. Based Syst..

[85]  A. Bhardwaj,et al.  Optimization of state-of-the-art fuzzy-metaheuristic ANFIS-based machine learning models for flood susceptibility prediction mapping in the Middle Ganga Plain, India. , 2020, The Science of the total environment.

[86]  Ozgur Kisi,et al.  An improved model based on the support vector machine and cuckoo algorithm for simulating reference evapotranspiration , 2019, PloS one.

[87]  D. Werner,et al.  Wind Driven Optimization (WDO): A novel nature-inspired optimization algorithm and its application to electromagnetics , 2010, 2010 IEEE Antennas and Propagation Society International Symposium.

[88]  Fariborz Jolai,et al.  Lion Optimization Algorithm (LOA): A nature-inspired metaheuristic algorithm , 2016, J. Comput. Des. Eng..

[89]  M. Khishe,et al.  Chimp optimization algorithm , 2020, Expert Syst. Appl..

[90]  V. V. Eskov,et al.  The Heuristic Work of the Brain and Artificial Neural Networks , 2019, Biophysics.

[91]  Nabil Neggaz,et al.  An efficient henry gas solubility optimization for feature selection , 2020, Expert Syst. Appl..

[92]  Andrew Lewis,et al.  The Whale Optimization Algorithm , 2016, Adv. Eng. Softw..

[93]  Sinan Q. Salih,et al.  Input attributes optimization using the feasibility of genetic nature inspired algorithm: Application of river flow forecasting , 2020, Scientific Reports.

[94]  Wanie M. Ridwan,et al.  Rainfall forecasting model using machine learning methods: Case study Terengganu, Malaysia , 2020 .

[95]  Maryam Zeinolabedini Rezaabad,et al.  ANFIS Modeling with ICA, BBO, TLBO, and IWO Optimization Algorithms and Sensitivity Analysis for Predicting Daily Reference Evapotranspiration , 2020 .

[96]  A. Kaveh,et al.  A novel heuristic optimization method: charged system search , 2010 .

[97]  Ahmed El-Shafie,et al.  Integrated versus isolated scenario for prediction dissolved oxygen at progression of water quality monitoring stations , 2011 .

[98]  Chuntian Cheng,et al.  Forecasting reservoir monthly runoff via ensemble empirical mode decomposition and extreme learning machine optimized by an improved gravitational search algorithm , 2019, Appl. Soft Comput..

[99]  Salah Kamel,et al.  Extracting Model Parameters of Proton Exchange Membrane Fuel Cell Using Equilibrium Optimizer Algorithm , 2020, 2020 International Youth Conference on Radio Electronics, Electrical and Power Engineering (REEPE).

[100]  Magdalene Marinaki,et al.  Bumble Bees Mating Optimization Algorithm for the Vehicle Routing Problem , 2014 .

[101]  Leandro dos Santos Coelho,et al.  Coyote Optimization Algorithm: A New Metaheuristic for Global Optimization Problems , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[102]  Hui Qin,et al.  Monthly streamflow forecasting based on hidden Markov model and Gaussian Mixture Regression , 2018, Journal of Hydrology.

[103]  Mohamed Abdel-Basset,et al.  Flower pollination algorithm: a comprehensive review , 2018, Artificial Intelligence Review.

[104]  Vivienne Sze,et al.  Efficient Processing of Deep Neural Networks: A Tutorial and Survey , 2017, Proceedings of the IEEE.

[105]  Dayang N. A. Jawawi,et al.  Electromagnetic field optimization: A physics-inspired metaheuristic optimization algorithm , 2016, Swarm Evol. Comput..

[106]  Thomas Stützle,et al.  Ant Colony Optimization: Overview and Recent Advances , 2018, Handbook of Metaheuristics.

[107]  Ali Kaveh,et al.  Lion Pride Optimization Algorithm: A meta-heuristic method for global optimization problems , 2018, Scientia Iranica.

[108]  Abdolreza Hatamlou,et al.  Black hole: A new heuristic optimization approach for data clustering , 2013, Inf. Sci..

[109]  Binh Minh Nguyen,et al.  Building Resource Auto-scaler with Functional-Link Neural Network and Adaptive Bacterial Foraging Optimization , 2019, TAMC.

[110]  Sepp Hochreiter,et al.  Self-Normalizing Neural Networks , 2017, NIPS.

[111]  Nguyen Thi Thuy Linh,et al.  Adaptive neuro-fuzzy inference system coupled with shuffled frog leaping algorithm for predicting river streamflow time series , 2020 .

[112]  Zaher Mundher Yaseen,et al.  Novel approach for streamflow forecasting using a hybrid ANFIS-FFA model , 2017 .

[113]  Stelios D. Bekiros,et al.  Digital currency forecasting with chaotic meta-heuristic bio-inspired signal processing techniques , 2019, Chaos, Solitons & Fractals.

[114]  Miguel Nicolau Understanding grammatical evolution: initialisation , 2017, Genetic Programming and Evolvable Machines.

[115]  Zhenxing Zhang,et al.  Atom search optimization and its application to solve a hydrogeologic parameter estimation problem , 2019, Knowl. Based Syst..

[116]  Yu Liu,et al.  A New Bio-inspired Algorithm: Chicken Swarm Optimization , 2014, ICSI.

[117]  Xin-She Yang,et al.  Bio-inspired computation: Where we stand and what's next , 2019, Swarm Evol. Comput..

[118]  Luigi Senatore,et al.  The future of pharmaceuticals industry within the triad: The role of knowledge spillovers in innovation process , 2020 .

[119]  Jun Wang,et al.  A novel exopolysaccharide-producing and long-chain n-alkane degrading bacterium Bacillus licheniformis strain DM-1 with potential application for in-situ enhanced oil recovery , 2020, Scientific Reports.

[120]  Shahaboddin Shamshirband,et al.  River flow prediction using hybrid PSOGSA algorithm based on feed-forward neural network , 2018, Soft Comput..

[121]  Binh Minh Nguyen,et al.  EO-CNN: An Enhanced CNN Model Trained by Equilibrium Optimization for Traffic Transportation Prediction , 2020, KES.

[122]  Binh Minh Nguyen,et al.  Hybridization of Galactic Swarm and Evolution Whale Optimization for Global Search Problem , 2020, IEEE Access.

[123]  Sujin Bureerat,et al.  The equilibrium optimization algorithm and the response surface-based metamodel for optimal structural design of vehicle components , 2020, Materials Testing.

[124]  Ehsan Jahani,et al.  Tackling global optimization problems with a novel algorithm - Mouth Brooding Fish algorithm , 2018, Appl. Soft Comput..

[125]  S. Deb,et al.  Elephant Herding Optimization , 2015, 2015 3rd International Symposium on Computational and Business Intelligence (ISCBI).

[126]  Xin-She Yang,et al.  Firefly Algorithm, Lévy Flights and Global Optimization , 2010, SGAI Conf..

[127]  Xin-She Yang,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010, NICSO.

[128]  Amir Hossein Alavi,et al.  Krill herd: A new bio-inspired optimization algorithm , 2012 .