Evolutionary artificial intelligence model via cooperation search algorithm and extreme learning machine for multiple scales nonstationary hydrological time series prediction

Abstract Reliable and stable hydrological prediction plays a vitally crucial role in the scientific operation of water resources system. As a famous artificial intelligence method for hydrological forecasting, extreme learning machine (ELM) has the virtues of fast training efficiency and strong generalization performance but is easily trapped into local optima because the preset computation parameters often remain unchanged in the learning process. In order to overcome this shortcoming, a practical evolutionary artificial intelligence model is developed for multiple scales nonstationary hydrological time series prediction. In the proposed method, an emerging evolutionary method called cooperation search algorithm (CSA) is used to search for the optimal input-hidden weights and hidden biases of the ELM model for the first time. The proposed method is used to forecast the runoff time series of three real-world hydrological stations in China. The experimental results show that the CSA approach can effectively determine satisfying network parameters of the ELM model, while our method can produce better results than the traditional ELM method in terms of all the performance evaluation indexes. Taking 1-step-ahead runoff forecasting at station B as an example, our method betters the ELM method with 15.76% and 42.35% improvements in both root mean squared error and mean absolute percentage error at the testing phase. Thus, a novel multiscale nonstationary hydrological prediction tool is developed to support the decision-making of water resource system.

[1]  Martin Fodslette Møller,et al.  A scaled conjugate gradient algorithm for fast supervised learning , 1993, Neural Networks.

[2]  Tao Sun,et al.  Eco-compensation standards for sustaining high flow events below hydropower plants , 2018 .

[3]  Pan Liu,et al.  Statistics for sample splitting for the calibration and validation of hydrological models , 2018, Stochastic Environmental Research and Risk Assessment.

[4]  Shouming Zhong,et al.  Improved approach to the problem of the global Mittag-Leffler synchronization for fractional-order multidimension-valued BAM neural networks based on new inequalities , 2020, Neural Networks.

[5]  Mahmud Dwi Sulistiyo,et al.  Evolution strategies for weight optimization of Artificial Neural Network in time series prediction , 2013, 2013 International Conference on Robotics, Biomimetics, Intelligent Computational Systems.

[6]  Shuo Zhang,et al.  Short-term runoff prediction with GRU and LSTM networks without requiring time step optimization during sample generation , 2020 .

[7]  Shiping Wen,et al.  CKFO: Convolution Kernel First Operated Algorithm With Applications in Memristor-Based Convolutional Neural Network , 2021, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[8]  Shijun Sun,et al.  Estimating daily reference evapotranspiration based on limited meteorological data using deep learning and classical machine learning methods , 2020 .

[9]  Jay R. Lund,et al.  Adaptive water infrastructure planning for nonstationary hydrology , 2018, Advances in Water Resources.

[10]  K. S. Yap,et al.  Extreme Learning Machines: A new approach for prediction of reference evapotranspiration , 2015 .

[11]  Huiming Wang,et al.  Internal incentives and operations strategies for the water-saving supply chain with cap-and-trade regulation , 2019, Frontiers of Engineering Management.

[12]  Ozgur Kisi,et al.  Daily streamflow prediction using optimally pruned extreme learning machine , 2019, Journal of Hydrology.

[13]  L. Darrell Whitley,et al.  Genetic algorithms and neural networks: optimizing connections and connectivity , 1990, Parallel Comput..

[14]  Wenlong Fu,et al.  A hybrid approach for measuring the vibrational trend of hydroelectric unit with enhanced multi-scale chaotic series analysis and optimized least squares support vector machine , 2019, Trans. Inst. Meas. Control.

[15]  Yu Tian,et al.  Future changes in Yuan River ecohydrology: Individual and cumulative impacts of climates change and cascade hydropower development on runoff and aquatic habitat quality. , 2018, The Science of the total environment.

[16]  Joni-Kristian Kämäräinen,et al.  Differential Evolution Training Algorithm for Feed-Forward Neural Networks , 2003, Neural Processing Letters.

[17]  Yunzhong Jiang,et al.  Development and Application of a Distributed Hydrological Model: EasyDHM , 2014 .

[18]  Qiaofeng Tan,et al.  Daily runoff time-series prediction based on the adaptive neural fuzzy inference system , 2015, 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[19]  Lei Chen,et al.  Enhanced random search based incremental extreme learning machine , 2008, Neurocomputing.

[20]  Wen-jing Niu,et al.  Multiple Hydropower Reservoirs Operation by Hyperbolic Grey Wolf Optimizer Based on Elitism Selection and Adaptive Mutation , 2021, Water Resources Management.

[21]  Kuolin Hsu,et al.  Superior training of artificial neural networks using weight-space partitioning , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[22]  Hoay Beng Gooi,et al.  Multi-Objective Optimal Dispatch of Microgrid Under Uncertainties via Interval Optimization , 2019, IEEE Transactions on Smart Grid.

[23]  Xin Yao,et al.  Evolving artificial neural networks , 1999, Proc. IEEE.

[24]  S. Galelli,et al.  An information theoretic approach to select alternate subsets of predictors for data-driven hydrological models , 2016 .

[25]  Yanbin Yuan,et al.  Wind power prediction using hybrid autoregressive fractionally integrated moving average and least square support vector machine , 2017 .

[26]  Wenxi Lu,et al.  Groundwater contamination source identification based on a hybrid particle swarm optimization-extreme learning machine , 2020 .

[27]  M. Bialko,et al.  Training of artificial neural networks using differential evolution algorithm , 2008, 2008 Conference on Human System Interactions.

[28]  Wen-jing Niu,et al.  Hybrid artificial neural network and cooperation search algorithm for nonlinear river flow time series forecasting in humid and semi-humid regions , 2021, Knowl. Based Syst..

[29]  Lili Wang,et al.  Improving the prediction accuracy of monthly streamflow using a data-driven model based on a double-processing strategy , 2019, Journal of Hydrology.

[30]  Zeshui Xu,et al.  An overview on the applications of the hesitant fuzzy sets in group decision-making: Theory, support and methods , 2019, Frontiers of Engineering Management.

[31]  Paulin Coulibaly,et al.  Assimilation of near-real time data products into models of an urban basin , 2018 .

[32]  Ahmad Sharafati,et al.  Complementary data-intelligence model for river flow simulation , 2018, Journal of Hydrology.

[33]  Qian Zhu,et al.  Integration of a Parsimonious Hydrological Model with Recurrent Neural Networks for Improved Streamflow Forecasting , 2018, Water.

[34]  Shiping Wen,et al.  Periodic Event-Triggered Synchronization of Multiple Memristive Neural Networks With Switching Topologies and Parameter Mismatch , 2020, IEEE Transactions on Cybernetics.

[35]  Wang,et al.  Mapping the Distribution of Water Resource Security in the Beijing-Tianjin-Hebei Region at the County Level under a Changing Context , 2019 .

[36]  Andrew W. Wood,et al.  How Suitable is Quantile Mapping For Postprocessing GCM Precipitation Forecasts , 2017 .

[37]  Shiping Wen,et al.  Event-based sliding-mode synchronization of delayed memristive neural networks via continuous/periodic sampling algorithm , 2020, Appl. Math. Comput..

[38]  Basant Yadav,et al.  Estimation of in-situ bioremediation system cost using a hybrid Extreme Learning Machine (ELM)-particle swarm optimization approach , 2016 .

[39]  Shiping Wen,et al.  Event-triggered distributed control for synchronization of multiple memristive neural networks under cyber-physical attacks , 2020, Inf. Sci..

[40]  Bo Xu,et al.  Exploring the Relationships among Reliability, Resilience, and Vulnerability of Water Supply Using Many-Objective Analysis , 2017 .

[41]  Yiqiang Chen,et al.  Weighted extreme learning machine for imbalance learning , 2013, Neurocomputing.

[42]  Chao Ching Wang,et al.  Stochastic optimal operation of reservoirs based on copula functions , 2018 .

[43]  Min Wu,et al.  Two-phase extreme learning machines integrated with the complete ensemble empirical mode decomposition with adaptive noise algorithm for multi-scale runoff prediction problems , 2019, Journal of Hydrology.

[44]  Na Sun,et al.  An adaptive dynamic short-term wind speed forecasting model using secondary decomposition and an improved regularized extreme learning machine , 2018, Energy.

[45]  J. Lund,et al.  California’s Sacramento–San Joaquin Delta Conflict: From Cooperation to Chicken , 2012 .

[46]  Hoay Beng Gooi,et al.  Deep Learning Based Densely Connected Network for Load Forecasting , 2021, IEEE Transactions on Power Systems.

[47]  Aranildo R. Lima,et al.  Forecasting daily streamflow using online sequential extreme learning machines , 2016 .

[48]  Fu Chao Liu,et al.  Hybrid forecasting model for non-stationary daily runoff series: A case study in the Han River Basin, China , 2019, Journal of Hydrology.

[49]  Yongqiang Zhang,et al.  Coupling a Regional Climate Model and a Distributed Hydrological Model to Assess Future Water Resources in Jinhua River Basin, East China , 2015 .

[50]  Chao Ma,et al.  Short-term optimal operation of Three-gorge and Gezhouba cascade hydropower stations in non-flood season with operation rules from data mining , 2013 .

[51]  Wen-jing Niu,et al.  Evaluating the performances of several artificial intelligence methods in forecasting daily streamflow time series for sustainable water resources management , 2021 .

[52]  Jingjing Xie,et al.  Daily reservoir inflow forecasting using multiscale deep feature learning with hybrid models , 2016 .

[53]  Zhigang Zeng,et al.  General memristor with applications in multilayer neural networks , 2018, Neural Networks.

[54]  Soroosh Sorooshian,et al.  Improving the multi-objective evolutionary optimization algorithm for hydropower reservoir operations in the California Oroville-Thermalito complex , 2015, Environ. Model. Softw..

[55]  Zejun Li,et al.  Deriving mixed reservoir operating rules for flood control based on weighted non-dominated sorting genetic algorithm II , 2018, Journal of Hydrology.

[56]  Dingbao Wang,et al.  Climate change impacts on crop production in Iran's Zayandeh-Rud River Basin. , 2013, The Science of the total environment.

[57]  Zhong-kai Feng,et al.  Parallel computing and swarm intelligence based artificial intelligence model for multi-step-ahead hydrological time series prediction , 2021 .

[58]  Shiping Wen,et al.  Impulsive disturbance on stability analysis of delayed quaternion-valued neural networks , 2021, Appl. Math. Comput..

[59]  Soroosh Sorooshian,et al.  Simulating California reservoir operation using the classification and regression‐tree algorithm combined with a shuffled cross‐validation scheme , 2015 .

[60]  Soroosh Sorooshian,et al.  Developing reservoir monthly inflow forecasts using artificial intelligence and climate phenomenon information , 2017 .

[61]  Feifei Zheng,et al.  Improved Understanding on the Searching Behavior of NSGA-II Operators Using Run-Time Measure Metrics with Application to Water Distribution System Design Problems , 2017, Water Resources Management.

[62]  Quan J. Wang,et al.  A Bayesian modelling method for post-processing daily sub-seasonal to seasonal rainfall forecasts from global climate models and evaluation for 12 Australian catchments , 2018 .

[63]  Zhijia Li,et al.  GA-PIC: An improved Green-Ampt rainfall-runoff model with a physically based infiltration distribution curve for semi-arid basins , 2020 .

[64]  Mariusz Ptak,et al.  Forecasting of water level in multiple temperate lakes using machine learning models , 2020 .

[65]  Zaher Mundher Yaseen,et al.  An enhanced extreme learning machine model for river flow forecasting: State-of-the-art, practical applications in water resource engineering area and future research direction , 2019, Journal of Hydrology.

[66]  Qian Zhu,et al.  Multi-criterion model ensemble of CMIP5 surface air temperature over China , 2018, Theoretical and Applied Climatology.

[67]  J. Shiri,et al.  Assessing temporal data partitioning scenarios for estimating reference evapotranspiration with machine learning techniques in arid regions , 2020 .

[68]  Wen-jing Niu,et al.  Ecological operation of cascade hydropower reservoirs by elite-guide gravitational search algorithm with Lévy flight local search and mutation , 2020 .

[69]  Shiping Wen,et al.  Global exponential synchronization of delayed memristive neural networks with reaction-diffusion terms , 2019, Neural Networks.

[70]  Dan Zhao,et al.  Study on Icing Prediction of Power Transmission Lines Based on Ensemble Empirical Mode Decomposition and Feature Selection Optimized Extreme Learning Machine , 2019 .

[71]  Zhiqiang Jiang,et al.  Optimization of fuzzy membership function of runoff forecasting error based on the optimal closeness , 2019, Journal of Hydrology.

[72]  Q. Tan,et al.  An adaptive middle and long-term runoff forecast model using EEMD-ANN hybrid approach , 2018, Journal of Hydrology.

[73]  Suzanna Long,et al.  A model for the evaluation of environmental impact indicators for a sustainable maritime transportation systems , 2019, Frontiers of Engineering Management.

[74]  Q. Tan,et al.  Long-term optimal operation of cascade hydropower stations based on the utility function of the carryover potential energy , 2020 .

[75]  Chaohua Dai,et al.  Seeker optimization algorithm for tuning the structure and parameters of neural networks , 2011, Neurocomputing.

[76]  Diyi Chen,et al.  Synchronization between integer-order chaotic systems and a class of fractional-order chaotic systems via sliding mode control. , 2012, Chaos.

[77]  Wen-jing Niu,et al.  Cooperation search algorithm: A novel metaheuristic evolutionary intelligence algorithm for numerical optimization and engineering optimization problems , 2021, Appl. Soft Comput..

[78]  Pan Liu,et al.  Optimal design of seasonal flood limited water levels and its application for the Three Gorges Reservoir , 2015 .

[79]  Lifeng Wu,et al.  Daily reference evapotranspiration prediction based on hybridized extreme learning machine model with bio-inspired optimization algorithms: Application in contrasting climates of China , 2019, Journal of Hydrology.

[80]  Bin Xu,et al.  Analysis of a Stochastic Programming Model for Optimal Hydropower System Operation under a Deregulated Electricity Market by Considering Forecasting Uncertainty , 2018, Water.

[81]  Soroosh Sorooshian,et al.  An enhanced artificial neural network with a shuffled complex evolutionary global optimization with principal component analysis , 2017, Inf. Sci..

[82]  Ximing Cai,et al.  Revealing the water-energy-food nexus in the Upper Yellow River Basin through multi-objective optimization for reservoir system. , 2019, The Science of the total environment.

[83]  Yan Zhao,et al.  Error correction-based forecasting of reservoir water levels: Improving accuracy over multiple lead times , 2018, Environ. Model. Softw..

[84]  Xiaoyu Wang,et al.  Hydropower plant operation rules optimization response to climate change , 2018, Energy.

[85]  Nadeem Javaid,et al.  Short-Term Electric Load and Price Forecasting Using Enhanced Extreme Learning Machine Optimization in Smart Grids , 2019, Energies.

[86]  Ningbo Cui,et al.  Development of data-driven models for prediction of daily global horizontal irradiance in Northwest China , 2019, Journal of Cleaner Production.