High temporal resolution rainfall–runoff modeling using long-short-term-memory (LSTM) networks

Accurate and efficient models for rainfall runoff (RR) simulations are crucial for flood risk management. Most rainfall models in use today are process-driven; i.e. they solve either simplified empirical formulas or some variation of the St. Venant (shallow water) equations. With the development of machine-learning techniques, we may now be able to emulate rainfall models using, for example, neural networks. In this study, a data-driven RR model using a sequence-to-sequence Long-short-Term-Memory (LSTM) network was constructed. The model was tested for a watershed in Houston, TX, known for severe flood events. The LSTM network’s capability in learning long-term dependencies between the input and output of the network allowed modeling RR with high resolution in time (15 minutes). Using 10-years precipitation from 153 rainfall gages and river channel discharge data (more than 5.3 million data points), and by designing several numerical tests the developed model performance in predicting river discharge was tested. The model results were also compared with the output of a process-driven model Gridded Surface Subsurface Hydrologic Analysis (GSSHA). Moreover, physical consistency of the LSTM model was explored. The model results showed that the LSTM model was able to efficiently predict discharge and achieve good model performance. When compared to GSSHA, the data-driven model was more efficient and robust in terms of prediction and calibration. Interestingly, the performance of the LSTM model improved (test Nash-Sutcliffe model efficiency from 0.666 to 0.942) when a selected subset of rainfall gages based on the model performance, were used as input instead of all rainfall gages.

[1]  François Anctil,et al.  Improvement of rainfall-runoff forecasts through mean areal rainfall optimization , 2006 .

[2]  Wang Lili,et al.  Rainfall-runoff simulation and flood forecasting for Huaihe Basin , 2008 .

[3]  S. Sorooshian,et al.  Effective and efficient global optimization for conceptual rainfall‐runoff models , 1992 .

[4]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[5]  Yanbin Yuan,et al.  Monthly runoff forecasting based on LSTM–ALO model , 2018, Stochastic Environmental Research and Risk Assessment.

[6]  Kuolin Hsu,et al.  Artificial Neural Network Modeling of the Rainfall‐Runoff Process , 1995 .

[7]  Ashfaqur Rahman,et al.  Recurrent Neural Networks for One Day Ahead Prediction of Stream Flow , 2016, TSAA '16.

[8]  Gérard Dreyfus,et al.  Modelling the breakthrough of activated carbon filters by pesticides in surface waters with static and recurrent neural networks , 2008 .

[9]  Walter F. Silva-Araya,et al.  Dynamic modeling of surface runoff and storm surge during hurricane and tropical storm events , 2018 .

[10]  Fred L. Ogden,et al.  GSSHA: Model To Simulate Diverse Stream Flow Producing Processes , 2004 .

[11]  Cheng Yao,et al.  Improving event-based rainfall-runoff simulation using an ensemble artificial neural network based hybrid data-driven model , 2015, Stochastic Environmental Research and Risk Assessment.

[12]  Göran Lindström,et al.  Development and test of the distributed HBV-96 hydrological model , 1997 .

[13]  Jamie Dyer,et al.  A Hydraulic MultiModel Ensemble Framework for Visualizing Flood Inundation Uncertainty , 2018, JAWRA Journal of the American Water Resources Association.

[14]  Pierre Roussel-Ragot,et al.  Neural Networks and Nonlinear Adaptive Filtering: Unifying Concepts and New Algorithms , 1993, Neural Computation.

[15]  K. Beven,et al.  Cascading model uncertainty from medium range weather forecasts (10 days) through a rainfall-runoff model to flood inundation predictions within the European Flood Forecasting System (EFFS) , 2005 .

[16]  Sepp Hochreiter,et al.  The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions , 1998, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[17]  Reed M. Maxwell,et al.  Using a Distributed Hydrologic Model to Improve the Green Infrastructure Parameterization Used in a Lumped Model , 2018, Water.

[18]  Billy E. Johnson,et al.  Advances in Physically Based Hydrologic Modeling with CASC2D , 2001 .

[19]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[20]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[21]  Christian W. Dawson,et al.  An artificial neural network approach to rainfall-runoff modelling , 1998 .

[22]  Morteza Kiani,et al.  Characterizing the hydraulic interactions of hurricane storm surge and rainfall–runoff for the Houston–Galveston region , 2015 .

[23]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[24]  Deva K. Borah,et al.  Watershed Models for Development and Implementation of Total Maximum Daily Loads , 2019, Journal of Hydrologic Engineering.

[25]  Xi Chen,et al.  The streamflow estimation using the Xinanjiang rainfall runoff model and dual state-parameter estimation method , 2013 .

[26]  Karsten Schulz,et al.  Rainfall–runoff modelling using Long Short-Term Memory (LSTM) networks , 2018, Hydrology and Earth System Sciences.

[27]  Fred L. Ogden,et al.  Gridded Surface Subsurface Hydrologic Analysis (GSSHA) User’s Manual; Version 1.43 for Watershed Modeling System 6.1 , 2006 .

[28]  Hatim O. Sharif,et al.  Assessment of the Performance of Satellite-Based Precipitation Products for Flood Events across Diverse Spatial Scales Using GSSHA Modeling System , 2018, Geosciences.

[29]  Anne Johannet,et al.  Feed-forward vs recurrent neural network models for non-stationarity modelling using data assimilation and adaptivity , 2015 .

[30]  Zachary Chase Lipton A Critical Review of Recurrent Neural Networks for Sequence Learning , 2015, ArXiv.

[31]  A. W. Minns,et al.  The extrapolation of artificial neural networks for the modelling of rainfall-runoff relationships , 2005 .

[32]  K. P. Sudheer,et al.  A data‐driven algorithm for constructing artificial neural network rainfall‐runoff models , 2002 .

[33]  C. Young,et al.  Prediction and modelling of rainfall–runoff during typhoon events using a physically-based and artificial neural network hybrid model , 2015 .

[34]  Ashu Jain,et al.  A comparative analysis of training methods for artificial neural network rainfall-runoff models , 2006, Appl. Soft Comput..

[35]  Anne Johannet,et al.  Neural networks for karst groundwater management: case of the Lez spring (Southern France) , 2015, Environmental Earth Sciences.

[36]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Philip B. Bedient,et al.  NEXRAD RADAR FOR FLOOD PREDICTION IN HOUSTON , 2000 .

[38]  Been Kim,et al.  Towards A Rigorous Science of Interpretable Machine Learning , 2017, 1702.08608.

[39]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[40]  Palaiahnakote Shivakumara,et al.  Context-Aware Attention LSTM Network for Flood Prediction , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[41]  Mark D. Abkowitz,et al.  Watershed Modeling Using GIS Technology: A Critical Review , 2011 .

[42]  P. C. Nayak,et al.  Fuzzy computing based rainfall–runoff model for real time flood forecasting , 2005 .