Enhancing robustness of monthly streamflow forecasting model using gated recurrent unit based on improved grey wolf optimizer

Abstract Accurate and reliable mid- to long-term streamflow prediction is essential for water resources management. However, streamflow series exhibits strong non-stationary and non-linear; thus the traditional single model may fail to capture the characteristic of hydrological series and hard to maintain the robustness of the model. To overcome this problem, the application of empirical wavelet transform combined with improved complete ensemble empirical mode decomposition with adaptive noise (ICEEWT) is firstly to eliminate the redundant noise and decompose original series into several components as inputs. Secondly, gated recurrent unit (GRU) is employed to deep learn the relationship between historical streamflow series and those of the future. Finally, balancing underfitting and overfitting the improved grey wolf optimizer (IGWO) is adopted with the hybrid model to identify the approximate parameter combination. The case study is conducted by monthly streamflow data at Shangjingyou station and Fenhe reservoir station in the upper reaches of Fenhe River. In comparison with parallel experiments using extreme learning machine (ELM) and least squares support vector machine (LSSVM), the validation results demonstrate that the GRU model can exhibit satisfactory performance in monthly streamflow forecasting. Moreover, the standard GRU model is further improved by IGWO, which consistently remains the performance of in-sample and out-sample. The proposed model ICEEWT-IGWO-GRU is superior to the single GRU model average reducing MAE and RMSE by 50% and 52% for two stations, which indicates its superiority with a more robust prediction.

[1]  O. Kisi,et al.  Enhancing Long-Term Streamflow Forecasting and Predicting using Periodicity Data Component: Application of Artificial Intelligence , 2016, Water Resources Management.

[2]  Xuehua Zhao,et al.  Auto Regressive and Ensemble Empirical Mode Decomposition Hybrid Model for Annual Runoff Forecasting , 2015, Water Resources Management.

[3]  Guohe Huang,et al.  Probabilistic Prediction for Monthly Streamflow through Coupling Stepwise Cluster Analysis and Quantile Regression Methods , 2016, Water Resources Management.

[4]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[5]  Xiangfei Kong,et al.  Heating load prediction based on attention long short term memory: A case study of Xingtai , 2020 .

[6]  Johan A. K. Suykens,et al.  Weighted least squares support vector machines: robustness and sparse approximation , 2002, Neurocomputing.

[7]  Min Wu,et al.  Two-phase extreme learning machines integrated with the complete ensemble empirical mode decomposition with adaptive noise algorithm for multi-scale runoff prediction problems , 2019, Journal of Hydrology.

[8]  Balaji Rajagopalan,et al.  Wavelet‐based time series bootstrap model for multidecadal streamflow simulation using climate indicators , 2016 .

[9]  Na Sun,et al.  An adaptive dynamic short-term wind speed forecasting model using secondary decomposition and an improved regularized extreme learning machine , 2018, Energy.

[10]  Lili Wang,et al.  Improving the prediction accuracy of monthly streamflow using a data-driven model based on a double-processing strategy , 2019, Journal of Hydrology.

[11]  Xin He,et al.  LLR: Learning learning rates by LSTM for training neural networks , 2020, Neurocomputing.

[12]  Enli Wang,et al.  Monthly and seasonal streamflow forecasts using rainfall‐runoff modeling and historical weather data , 2011 .

[13]  Barnabás Póczos,et al.  Gradient Descent Provably Optimizes Over-parameterized Neural Networks , 2018, ICLR.

[14]  Thi-Thu-Hong Phan,et al.  Combining statistical machine learning models with ARIMA for water level forecasting: The case of the Red river , 2020, Advances in Water Resources.

[15]  Chun-tian Cheng,et al.  Multistep-ahead daily inflow forecasting using the ERA-Interim reanalysis data set based on gradient-boosting regression trees , 2020 .

[16]  Elie Azar,et al.  Occupant-centric miscellaneous electric loads prediction in buildings using state-of-the-art deep learning methods , 2020 .

[17]  Yongnian Jiang,et al.  Prediction of dissolved oxygen in a fishery pond based on gated recurrent unit (GRU) , 2020 .

[18]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[19]  Dimitri Solomatine,et al.  Experimental investigation of the predictive capabilities of data driven modeling techniques in hydrology - Part 1: Concepts and methodology , 2009 .

[20]  Dieu Tien Bui,et al.  Meta optimization of an adaptive neuro-fuzzy inference system with grey wolf optimizer and biogeography-based optimization algorithms for spatial prediction of landslide susceptibility , 2019, CATENA.

[21]  Mohammadamin Azimi,et al.  US natural gas consumption prediction using an improved kernel-based nonlinear extension of the Arps decline model , 2020 .

[22]  Yufang Wang,et al.  A novel hybrid decomposition-and-ensemble model based on CEEMD and GWO for short-term PM2.5 concentration forecasting , 2016 .

[23]  Jérôme Gilles,et al.  Empirical Wavelet Transform , 2013, IEEE Transactions on Signal Processing.

[24]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[25]  Chuntian Cheng,et al.  Forecasting reservoir monthly runoff via ensemble empirical mode decomposition and extreme learning machine optimized by an improved gravitational search algorithm , 2019, Appl. Soft Comput..

[26]  Andrea Castelletti,et al.  Value of long‐term streamflow forecasts to reservoir operations for water supply in snow‐dominated river catchments , 2016 .

[27]  Qian Liu,et al.  Gated recurrent unit based recurrent neural network for remaining useful life prediction of nonlinear deterioration process , 2019, Reliab. Eng. Syst. Saf..

[28]  Pan Liu,et al.  Statistics for sample splitting for the calibration and validation of hydrological models , 2018, Stochastic Environmental Research and Risk Assessment.

[29]  Jun Li,et al.  Grey wolf optimization evolving kernel extreme learning machine: Application to bankruptcy prediction , 2017, Eng. Appl. Artif. Intell..

[30]  V. Singh,et al.  Mid- and long-term runoff predictions by an improved phase-space reconstruction model. , 2016, Environmental research.

[31]  Li He,et al.  Optimal water resource management for sustainable development of the chemical industrial park under multi-uncertainty and multi-pollutant control , 2018, Environmental Science and Pollution Research.

[32]  Yang-Ping Yao,et al.  Machine learning for pore-water pressure time-series prediction: Application of recurrent neural networks , 2021 .

[33]  Qiang Huang,et al.  Examining the applicability of different sampling techniques in the development of decomposition-based streamflow forecasting models , 2019, Journal of Hydrology.

[34]  Duo Zhang,et al.  Use Long Short-Term Memory to Enhance Internet of Things for Combined Sewer Overflow Monitoring , 2018 .

[35]  Armando Brath,et al.  Multistep ahead streamflow forecasting: Role of calibration data in conceptual and neural network modeling , 2007 .

[36]  Driss Ouazar,et al.  Evolving neural network using real coded genetic algorithm for daily rainfall-runoff forecasting , 2009, Expert Syst. Appl..

[37]  Jianzhou Wang,et al.  Short-term wind speed prediction using empirical wavelet transform and Gaussian process regression , 2015 .

[38]  Haiping Wu,et al.  Smart wind speed forecasting using EWT decomposition, GWO evolutionary optimization, RELM learning and IEWT reconstruction , 2018 .

[39]  K. Chau,et al.  Predicting monthly streamflow using data‐driven models coupled with data‐preprocessing techniques , 2009 .

[40]  Arup Kumar Sarma,et al.  Artificial neural network model for synthetic streamflow generation , 2007 .

[41]  Xiaochao Wang,et al.  A Four-Stage Hybrid Model for Hydrological Time Series Forecasting , 2014, PloS one.

[42]  Wen-jing Niu,et al.  Monthly runoff time series prediction by variational mode decomposition and support vector machine based on quantum-behaved particle swarm optimization , 2020 .

[43]  Mumtaz Ali,et al.  Significant wave height forecasting via an extreme learning machine model integrated with improved complete ensemble empirical mode decomposition , 2019, Renewable and Sustainable Energy Reviews.

[44]  W. Jiao,et al.  Hydrological and pollution processes in mining area of Fenhe River Basin in China. , 2018, Environmental pollution.

[45]  Xiwei Mi,et al.  Wind speed prediction based on singular spectrum analysis and neural network structural learning , 2020 .

[46]  Zhong-kai Feng,et al.  Multi-stage progressive optimality algorithm and its application in energy storage operation chart optimization of cascade reservoirs , 2018 .

[47]  Zaher Mundher Yaseen,et al.  An enhanced extreme learning machine model for river flow forecasting: State-of-the-art, practical applications in water resource engineering area and future research direction , 2019, Journal of Hydrology.

[48]  Wen-jing Niu,et al.  Ecological operation of cascade hydropower reservoirs by elite-guide gravitational search algorithm with Lévy flight local search and mutation , 2020 .

[49]  Dong Wang,et al.  Streamflow forecasting using extreme gradient boosting model coupled with Gaussian mixture model , 2020 .

[50]  Ashish Sharma,et al.  Probabilistic Estimation of Multivariate Streamflow Using Independent Component Analysis and Climate Information , 2009 .

[51]  Ahmed El-Shafie,et al.  Improving artificial intelligence models accuracy for monthly streamflow forecasting using grey Wolf optimization (GWO) algorithm , 2020 .

[52]  Bijaya K. Panigrahi,et al.  Streamflow forecasting by SVM with quantum behaved particle swarm optimization , 2013, Neurocomputing.

[53]  Qiang Huang,et al.  Trend and long-range correlation characteristics analysis of runoff in upper Fenhe River basin , 2017, Water Resources.

[54]  Hui Li,et al.  Deep Learning with a Long Short-Term Memory Networks Approach for Rainfall-Runoff Simulation , 2018, Water.

[55]  Xuehua Zhao,et al.  An EMD-Based Chaotic Least Squares Support Vector Machine Hybrid Model for Annual Runoff Forecasting , 2017 .

[56]  O. Kisi,et al.  Least square support vector machine and multivariate adaptive regression splines for streamflow prediction in mountainous basin using hydro-meteorological data as inputs , 2020 .

[57]  María Eugenia Torres,et al.  Improved complete ensemble EMD: A suitable tool for biomedical signal processing , 2014, Biomed. Signal Process. Control..

[58]  Robert J. Abrahart,et al.  Hydroinformatics: computational intelligence and technological developments in water science applications—Editorial , 2007 .

[59]  Punyaphol Horata,et al.  Robust extreme learning machine , 2013, Neurocomputing.

[60]  R. Deo,et al.  Stream-flow forecasting using extreme learning machines: a case study in a semi-arid region in Iraq , 2016 .