Flow interval prediction based on deep residual network and lower and upper boundary estimation method

Abstract Interval prediction is an efficient approach for quantifying the uncertainties of future flow. In this paper, a novel method, based on the combination of a deep residual neural network (ResNet) and lower and upper bound estimation (LUBE), is proposed to forcast future flow and construct prediction intervals. LUBE is proposed by optimizing a LUBE-based objective function and adjusting the type and quantity of residual blocks to design a combined residual network. The final proposed interval prediction model is stResNet-LUBE p r o p o s e d . The performance of the stResNet-LUBE p r o p o s e d model is verified using the spatiotemporal dataset of Tunxi, which is a small and medium watershed. The performance of proposed model is mainly evaluated by the root mean square error (RMSE), coefficient of determination (R 2 ), and coverage width-based criterion (CWC). The experimental results show that the average values of RMSE, R 2 , and CWC of the proposed model are better than those of the spatiotemporal deep learning model stCNN-LUBE p r o p o s e d , the deep learning model LSTM-LUBE p r o p o s e d , and the machine learning model MLP-LUBE p r o p o s e d by 1.881%, 10.574%, and 14.113%; 2.198%, 15.754%, and 18.546%; and 10.572%, 35.907%, and 46.819%, respectively (predict 6-step).

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Biswajeet Pradhan,et al.  Modeling flood susceptibility using data-driven approaches of naïve Bayes tree, alternating decision tree, and random forest methods. , 2019, The Science of the total environment.

[3]  Gregory D. Hager,et al.  Segmental Spatiotemporal CNNs for Fine-Grained Action Segmentation , 2016, ECCV.

[4]  Zhigang Zeng,et al.  Constructing prediction intervals for landslide displacement using bootstrapping random vector functional link networks selective ensemble with neural networks switched , 2018, Neurocomputing.

[5]  Seyed-Mohammad Hosseini-Moghari,et al.  Development of a Hybrid Data Driven Model for Hydrological Estimation , 2018, Water Resources Management.

[6]  Duo Zhang,et al.  Use Long Short-Term Memory to Enhance Internet of Things for Combined Sewer Overflow Monitoring , 2018 .

[7]  Kun Qian,et al.  Physics Informed Data Driven model for Flood Prediction: Application of Deep Learning in prediction of urban flood development , 2019, ArXiv.

[8]  Ashu Jain,et al.  A comparative analysis of training methods for artificial neural network rainfall-runoff models , 2006, Appl. Soft Comput..

[9]  Zaher Mundher Yaseen,et al.  Artificial intelligence based models for stream-flow forecasting: 2000-2015 , 2015 .

[10]  Maziar Palhang,et al.  Generalization performance of support vector machines and neural networks in runoff modeling , 2009, Expert Syst. Appl..

[12]  Jun Feng,et al.  Small Watershed Stream-Flow Forecasting Based on LSTM , 2019, IMCOM.

[13]  Mohammad Babaei,et al.  Hybrid SVM-CIPSO methods for optimal operation of reservoir considering unknown future condition , 2020, Appl. Soft Comput..

[14]  Uwe Haberlandt,et al.  Geostatistical interpolation of hourly precipitation from rain gauges and radar for a large-scale extreme rainfall event , 2007 .

[15]  Saeid Nahavandi,et al.  Prediction Intervals to Account for Uncertainties in Travel Time Prediction , 2011, IEEE Transactions on Intelligent Transportation Systems.

[16]  S. Pan,et al.  A real-time forecast model using artificial neural network for after-runner storm surges on the Tottori coast, Japan , 2016 .

[17]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[18]  K. P. Sudheer,et al.  Short‐term flood forecasting with a neurofuzzy model , 2005 .

[19]  H. Bourlard,et al.  Auto-association by multilayer perceptrons and singular value decomposition , 1988, Biological Cybernetics.

[20]  Jian Sun,et al.  Convolutional neural networks at constrained time cost , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  M. Ye,et al.  Developing a Long Short-Term Memory (LSTM) based model for predicting water table depth in agricultural areas , 2018, Journal of Hydrology.

[22]  Saeid Nahavandi,et al.  Construction of Optimal Prediction Intervals for Load Forecasting Problems , 2010, IEEE Transactions on Power Systems.

[23]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Asaad Y. Shamseldin,et al.  A comparison between wavelet based static and dynamic neural network approaches for runoff prediction , 2016 .

[25]  Qiang Zhang,et al.  Univariate streamflow forecasting using commonly used data-driven models: literature review and case study , 2018 .

[26]  Jianzhong Zhou,et al.  Flood Forecasting Based on an Improved Extreme Learning Machine Model Combined with the Backtracking Search Optimization Algorithm , 2018, Water.

[27]  Lu Chen,et al.  Efficient estimation of flood forecast prediction intervals via single‐ and multi‐objective versions of the LUBE method , 2016 .

[28]  M. Valipour,et al.  Parameters Estimate of Autoregressive Moving Average and Autoregressive Integrated Moving Average Models and Compare Their Ability for Inflow Forecasting , 2012 .

[29]  Abbas Khosravi,et al.  Short-Term Load and Wind Power Forecasting Using Neural Network-Based Prediction Intervals , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[30]  Bijaya K. Panigrahi,et al.  An integrated wavelet-support vector machine for groundwater level prediction in Visakhapatnam, India , 2014, Neurocomputing.

[31]  Abbas Khosravi,et al.  Particle swarm optimization for construction of neural network-based prediction intervals , 2014, Neurocomputing.

[32]  Zaher Mundher Yaseen,et al.  On the complexities of sediment load modeling using integrative machine learning: Application of the great river of Loíza in Puerto Rico , 2020, Journal of Hydrology.

[33]  Amir F. Atiya,et al.  Lower Upper Bound Estimation Method for Construction of Neural Network-Based Prediction Intervals , 2011, IEEE Transactions on Neural Networks.

[34]  Danqi Li,et al.  Comparison of export and outward foreign direct investment models of Chinese enterprises based on quantitative algorithm , 2018, Neural Computing and Applications.

[35]  Li-Chiu Chang,et al.  Exploring the spatio-temporal interrelation between groundwater and surface water by using the self-organizing maps , 2018 .