Context-Aware Attention LSTM Network for Flood Prediction

To minimize the negative impacts brought by floods, researchers from pattern recognition community utilize artificial intelligence based methods to solve the problem of flood prediction. Inspired by the significant power of Long Short-Term Memory (LSTM) networks in modeling the dynamics and dependencies of sequential data, we intend to utilize LSTM networks to predict sequential flow rate values based on a set of collected flood factors. Since not all factors are informative for flood prediction and the irrelevant factors often bring a lot of noise, we need to pay more attention to the informative ones. However, original LSTM doesn't have strong attention capability. Hence we propose an context-aware attention LSTM (CA-LSTM) network for flood prediction, which is capable to selectively focus on informative factors. During training, the local context-aware attention model is constructed by learning probability distributions between flow rate and hidden output of each LSTM cell. During testing, the learned local attention model assign weights to adjust relations between input factors and predictions at all steps of LSTM network. We conduct experiments on a flood dataset with several comparative methods to demonstrate high accuracy of the proposed method and the effectiveness of the proposed context-aware attention model.

[1]  Giorgio Guariso,et al.  Coupling fuzzy modeling and neural networks for river flood prediction , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[2]  Li Fei-Fei,et al.  Every Moment Counts: Dense Detailed Labeling of Actions in Complex Videos , 2015, International Journal of Computer Vision.

[3]  Günter Blöschl,et al.  Quantifying effects of catchments storage thresholds on step changes in the flood frequency curve , 2013 .

[4]  Li Fei-Fei,et al.  End-to-End Learning of Action Detection from Frame Glimpses in Videos , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Ruslan Salakhutdinov,et al.  Action Recognition using Visual Attention , 2015, NIPS 2015.

[6]  Paulin Coulibaly,et al.  Bayesian Flood Forecasting Methods: A Review , 2017 .

[7]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[9]  Ke Zhang,et al.  Improving the flood prediction capability of the Xinanjiang model in ungauged nested catchments by coupling it with the geomorphologic instantaneous unit hydrograph , 2014 .

[10]  Tong Lu,et al.  A Novel 3D Human Action Recognition Framework for Video Content Analysis , 2018, MMM.

[11]  Federico Garavaglia,et al.  The SCHADEX method: A semi-continuous rainfall–runoff simulation for extreme flood estimation , 2013 .

[12]  Christian Wolf,et al.  Pose-conditioned Spatio-Temporal Attention for Human Action Recognition , 2017, ArXiv.

[13]  Albrecht H. Weerts,et al.  Probabilistic Quantitative Precipitation Forecast for Flood Prediction: An Application , 2008 .

[14]  Palaiahnakote Shivakumara,et al.  A Robust Symmetry-Based Method for Scene/Video Text Detection through Neural Network , 2017, 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR).

[15]  Wei Ding,et al.  SPATIO-TEMPORAL CONVOLUTIONAL NEURAL NETWORK , 2016 .

[16]  Chuntian Cheng,et al.  Daily Reservoir Runoff Forecasting Method Using Artificial Neural Network Based on Quantum-behaved Particle Swarm Optimization , 2015 .

[17]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[18]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Feng Xu,et al.  A Flood Forecasting Model Based on Deep Learning Algorithm via Integrating Stacked Autoencoders with BP Neural Network , 2017, 2017 IEEE Third International Conference on Multimedia Big Data (BigMM).

[20]  I-Fan Chang,et al.  Support vector regression for real-time flood stage forecasting , 2006 .

[21]  Zhao Ren-jun,et al.  The Xinanjiang model applied in China , 1992 .

[22]  Alex Graves,et al.  Recurrent Models of Visual Attention , 2014, NIPS.

[23]  Yoshua Bengio,et al.  Attention-Based Models for Speech Recognition , 2015, NIPS.

[24]  Jingjing Xie,et al.  Daily reservoir inflow forecasting using multiscale deep feature learning with hybrid models , 2016 .

[25]  Gang Wang,et al.  Global Context-Aware Attention LSTM Networks for 3D Action Recognition , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).