Data-Driven Approach for Rainfall-Runoff Modelling Using Equilibrium Optimizer Coupled Extreme Learning Machine and Deep Neural Network

Rainfall-runoff (R-R) modelling is used to study the runoff generation of a catchment. The quantity or rate of change measure of the hydrological variable, called runoff, is important for environmental scientists to accomplish water-related planning and design. This paper proposes (i) an integrated model namely EO-ELM (an integration of equilibrium optimizer (EO) and extreme learning machine (ELM)) and (ii) a deep neural network (DNN) for one day-ahead R-R modelling. The proposed R-R models are validated at two different benchmark stations of the catchments, namely river Teifi at Glanteifi and river Fal at Tregony in the UK. Firstly, a partial autocorrelation function (PACF) is used for optimal number of lag inputs to deploy the proposed models. Six other well-known machine learning models, called ELM, kernel ELM (KELM), and particle swarm optimization-based ELM (PSO-ELM), support vector regression (SVR), artificial neural network (ANN) and gradient boosting machine (GBM) are utilized to validate the two proposed models in terms of prediction efficiency. Furthermore, to increase the performance of the proposed models, paper utilizes a discrete wavelet-based data pre-processing technique is applied in rainfall and runoff data. The performance of wavelet-based EO-ELM and DNN are compared with wavelet-based ELM (WELM), KELM (WKELM), PSO-ELM (WPSO-ELM), SVR (WSVR), ANN (WANN) and GBM (WGBM). An uncertainty analysis and two-tailed t-test are carried out to ensure the trustworthiness and efficacy of the proposed models. The experimental results for two different time series datasets show that the EO-ELM performs better in an optimal number of lags than the others. In the case of wavelet-based daily R-R modelling, proposed models performed better and showed robustness compared to other models used. Therefore, this paper shows the efficient applicability of EO-ELM and DNN in R-R modelling that may be used in the hydrological modelling field.

[1]  Zhiping Lin,et al.  Self-Adaptive Evolutionary Extreme Learning Machine , 2012, Neural Processing Letters.

[2]  C. Gold.  Surface interpolation, spatial adjacency and GIS , 2020 .

[3]  Özgür Kisi,et al.  Precipitation forecasting by using wavelet-support vector machine conjunction model , 2012, Eng. Appl. Artif. Intell..

[4]  Afzal Hussain Shahid,et al.  A Comparative Assessment of Metaheuristic Optimized Extreme Learning Machine and Deep Neural Network in Multi-Step-Ahead Long-term Rainfall Prediction for All-Indian Regions , 2021, Water Resources Management.

[5]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Vahid Nourani,et al.  An Emotional ANN (EANN) approach to modeling rainfall-runoff process , 2017 .

[7]  Kourosh Mohammadi,et al.  Parameter estimation of an ARMA model for river flow forecasting using goal programming , 2006 .

[8]  E. Todini,et al.  Towards a comprehensive physically-based rainfall-runoff model , 2002 .

[9]  Lukás Burget,et al.  Strategies for training large scale neural network language models , 2011, 2011 IEEE Workshop on Automatic Speech Recognition & Understanding.

[10]  Leo Stroosnijder,et al.  Lumped surface and sub‐surface runoff for erosion modeling within a small hilly watershed in northern Vietnam , 2013 .

[11]  Jian Zhou,et al.  Proposing several hybrid PSO-extreme learning machine techniques to predict TBM performance , 2021, Engineering with Computers.

[12]  Ji Chen,et al.  Multi-scale streamflow variability responses to precipitation over the headwater catchments in southern China , 2017 .

[13]  Puteh Saad,et al.  River flow time series using least squares support vector machines , 2011 .

[14]  A. Kai Qin,et al.  Evolutionary extreme learning machine , 2005, Pattern Recognit..

[15]  Shaun Harrigan,et al.  Designation and trend analysis of the updated UK Benchmark Network of river flow stations: the UKBN2 dataset , 2018 .

[16]  Wensheng Wang,et al.  Wavelet Network Model and Its Application to the Prediction of Hydrology , 2003 .

[17]  B. Sivakumar,et al.  A comparative study of models for short-term streamflow forecasting with emphasis on wavelet-based approach , 2019, Stochastic Environmental Research and Risk Assessment.

[18]  Jessica Granderson,et al.  Gradient boosting machine for modeling the energy consumption of commercial buildings , 2018 .

[19]  Abdüsselam Altunkaynak,et al.  Prediction of daily rainfall by a hybrid wavelet-season-neuro technique , 2015 .

[20]  Kwok-wing Chau,et al.  Neural network river forecasting with multi-objective fully informed particle swarm optimization , 2015 .

[21]  Teng Zhou,et al.  PSO-ELM: A Hybrid Learning Model for Short-Term Traffic Flow Forecasting , 2020, IEEE Access.

[22]  Maheshwari Prasad Singh,et al.  A Metaheuristic-based Emotional ANN (EmNN) Approach for Rainfall-runoff Modeling , 2019, 2019 International Conference on Communication and Electronics Systems (ICCES).

[23]  Rathinasamy Maheswaran,et al.  Comparative study of different wavelets for hydrologic forecasting , 2012, Comput. Geosci..

[24]  Bo Ming,et al.  Improving Optimization Efficiency for Reservoir Operation Using a Search Space Reduction Method , 2017, Water Resources Management.

[25]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[26]  T. Ouarda,et al.  Modeling rainfall–runoff relationship using multivariate GARCH model , 2013 .

[27]  Ozgur Kisi,et al.  New formulation for forecasting streamflow: evolutionary polynomial regression vs. extreme learning machine , 2018 .

[28]  Xiong Luo,et al.  Combining Deep Neural Networks and Classical Time Series Regression Models for Forecasting Patient Flows in Hong Kong , 2019, IEEE Access.

[29]  R. Deo,et al.  Stream-flow forecasting using extreme learning machines: a case study in a semi-arid region in Iraq , 2016 .

[30]  Guang-Bin Huang,et al.  An Insight into Extreme Learning Machines: Random Neurons, Random Features and Kernels , 2014, Cognitive Computation.

[31]  Bellie Sivakumar,et al.  Forecasting river water temperature time series using a wavelet–neural network hybrid modelling approach , 2019, Journal of Hydrology.

[32]  M. Singh,et al.  A novel approach for rainfall-runoff modelling using a biogeography-based optimization technique , 2019, International Journal of River Basin Management.

[33]  Xue Hu,et al.  Detection of preterm birth in electrohysterogram signals based on wavelet transform and stacked sparse autoencoder , 2019, PloS one.

[34]  Pijush Samui,et al.  Modelling the energy performance of residential buildings using advanced computational frameworks based on RVM, GMDH, ANFIS-BBO and ANFIS-IPSO , 2021 .

[35]  Mahdi Hasanipanah,et al.  A novel approach for forecasting of ground vibrations resulting from blasting: modified particle swarm optimization coupled extreme learning machine , 2020, Engineering with Computers.

[36]  Seyedali Mirjalili,et al.  Equilibrium optimizer: A novel optimization algorithm , 2020, Knowl. Based Syst..

[37]  Pijush Samui,et al.  Predicting stable alluvial channel profiles using emotional artificial neural networks , 2019, Appl. Soft Comput..

[38]  Jan Adamowski,et al.  Hybrid artificial intelligence-time series models for monthly streamflow modeling , 2019, Appl. Soft Comput..

[39]  Alberto Regattieri,et al.  Single-hidden layer neural networks for forecasting intermittent demand , 2017 .

[40]  N. Awang,et al.  Wavelet-based time series model to improve the forecast accuracy of PM10 concentrations in Peninsular Malaysia , 2019, Environmental Monitoring and Assessment.

[41]  Chuntian Cheng,et al.  A comparison of performance of several artificial intelligence , 2009 .

[42]  S. Cole,et al.  CEH-GEAR: 1 km resolution daily and monthly areal rainfall estimates for the UK for hydrological and other applications , 2015 .

[43]  Josyane Ronchail,et al.  Recent advances in wavelet analyses: Part 2—Amazon, Parana, Orinoco and Congo discharges time scale variability , 2005 .

[44]  Bin Wang,et al.  CEREF: A hybrid data-driven model for forecasting annual streamflow from a socio-hydrological system , 2016 .

[45]  Amy Loutfi,et al.  A review of unsupervised feature learning and deep learning for time-series modeling , 2014, Pattern Recognit. Lett..

[46]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[47]  Kwok-wing Chau,et al.  Particle Swarm Optimization Training Algorithm for ANNs in Stage Prediction of Shing Mun River , 2006 .

[48]  K. P. Sudheer,et al.  A neuro-fuzzy computing technique for modeling hydrological time series , 2004 .

[49]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[50]  J. Adamowski,et al.  Coupling the maximum overlap discrete wavelet transform and long short-term memory networks for irrigation flow forecasting , 2019, Agricultural Water Management.

[51]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[52]  Liang Jing,et al.  ASOC: A Novel Agent-Based Simulation-Optimization Coupling Approach-Algorithm and Application in Offshore Oil Spill Responses , 2016 .

[53]  J. McDonnell,et al.  A decade of Predictions in Ungauged Basins (PUB)—a review , 2013 .

[54]  Deepak Kumar,et al.  A Novel Intelligent ELM-BBO Technique for Predicting Distance of Mine Blasting-Induced Flyrock , 2020, Natural Resources Research.

[55]  M. Singh,et al.  An empirical-based rainfall-runoff modelling using optimization technique , 2020, International Journal of River Basin Management.

[56]  R. Deo,et al.  Forecasting effective drought index using a wavelet extreme learning machine (W-ELM) model , 2017, Stochastic Environmental Research and Risk Assessment.

[57]  Vahid Nourani,et al.  Wavelet-based multi station disaggregation of rainfall time series in mountainous regions , 2019 .

[58]  Ahmed El-Shafie,et al.  Wavelet Transform Based Method for River Stream Flow Time Series Frequency Analysis and Assessment in Tropical Environment , 2019, Water Resources Management.

[59]  Pijush Samui,et al.  Particle Swarm Optimization Algorithm-Extreme Learning Machine (PSO-ELM) Model for Predicting Resilient Modulus of Stabilized Aggregate Bases , 2019, Applied Sciences.

[60]  Ana G. Elias,et al.  Discrete wavelet analysis to assess long-term trends in geomagnetic activity , 2006 .

[61]  Salim Heddam,et al.  Extreme learning machine-based prediction of daily water temperature for rivers , 2019, Environmental Earth Sciences.

[62]  C. L. Wu,et al.  Rainfall–runoff modeling using artificial neural network coupled with singular spectrum analysis , 2011 .

[63]  Derek C. Rose,et al.  Deep Machine Learning - A New Frontier in Artificial Intelligence Research [Research Frontier] , 2010, IEEE Computational Intelligence Magazine.

[64]  Guang-Bin Huang,et al.  Trends in extreme learning machines: A review , 2015, Neural Networks.

[65]  Jason Weston,et al.  Natural Language Processing (Almost) from Scratch , 2011, J. Mach. Learn. Res..

[66]  Rahim Barzegar,et al.  Design and implementation of a hybrid model based on two-layer decomposition method coupled with extreme learning machines to support real-time environmental monitoring of water quality parameters. , 2019, The Science of the total environment.

[67]  Meysam Motahari,et al.  Development of a PSO-ANN Model for Rainfall-Runoff Response in Basins, Case Study: Karaj Basin , 2017 .

[68]  Dan Jiang,et al.  Catenary Fault Identification Based on PSO-ELM , 2019, Journal of Physics: Conference Series.

[69]  Eleanor Blyth,et al.  Trends in atmospheric evaporative demand in Great Britain using high-resolution meteorological data , 2017 .

[70]  Taymoor A. Awchi,et al.  River Discharges Forecasting In Northern Iraq Using Different ANN Techniques , 2014, Water Resources Management.

[71]  Dianhui Wang,et al.  Extreme learning machines: a survey , 2011, Int. J. Mach. Learn. Cybern..

[72]  Huicheng Zhou,et al.  A Flood Forecasting Model that Considers the Impact of Hydraulic Projects by the Simulations of the Aggregate reservoir’s Retaining and Discharging , 2017, Water Resources Management.

[73]  Imed Riadh Farah,et al.  Wavelet Transform Application for/in Non-Stationary Time-Series Analysis: A Review , 2019, Applied Sciences.

[74]  Glenn E. Moglen,et al.  Evolutionary Algorithm Optimization of a Multireservoir System with Long Lag Times , 2014 .