Long short-term memory (LSTM) recurrent neural network for low-flow hydrological time series forecasting

This article explores the suitability of a long short-term memory recurrent neural network (LSTM-RNN) and artificial intelligence (AI) method for low-flow time series forecasting. The long short-term memory works on the sequential framework which considers all of the predecessor data. This forecasting method used daily discharged data collected from the Basantapur gauging station located on the Mahanadi River basin, India. Different metrics [root-mean-square error (RMSE), Nash–Sutcliffe efficiency (ENS), correlation coefficient (R) and mean absolute error] were selected to assess the performance of the model. Additionally, recurrent neural network (RNN) model is also used to compare the adaptability of LSTM-RNN over RNN and naïve method. The results conclude that the LSTM-RNN model (R = 0.943, ENS = 0.878, RMSE = 0.487) outperformed RNN model (R = 0.935, ENS = 0.843, RMSE = 0.516) and naïve method (R = 0.866, ENS = 0.704, RMSE = 0.793). The finding of this research concludes that LSTM-RNN can be used as new reliable AI technique for low-flow forecasting.

[1]  Amir F. Atiya,et al.  A comparison between neural-network forecasting techniques-case study: river flow forecasting , 1999, IEEE Trans. Neural Networks.

[2]  Shie-Yui Liong,et al.  Rainfall and runoff forecasting with SSA-SVM approach , 2001 .

[3]  Andreas Efstratiadis,et al.  Assessment of Environmental Flows from Complexity to Parsimony—Lessons from Lesotho , 2018, Water.

[4]  R Govindaraju,et al.  ARTIFICIAL NEURAL NETWORKS IN HYDROLOGY: II, HYDROLOGIC APPLICATIONS , 2000 .

[5]  Ashu Jain,et al.  Hybrid neural network models for hydrologic time series forecasting , 2007, Appl. Soft Comput..

[6]  N. Null Artificial Neural Networks in Hydrology. I: Preliminary Concepts , 2000 .

[7]  Stefan Broda,et al.  Forecasting groundwater levels using nonlinear autoregressive networks with exogenous input (NARX) , 2018, Journal of Hydrology.

[8]  M. Erol Keskin,et al.  Adaptive neural-based fuzzy inference system (ANFIS) approach for modelling hydrological time series , 2006 .

[9]  B. Sahoo,et al.  Application of Support Vector Regression for Modeling Low Flow Time Series , 2019, KSCE Journal of Civil Engineering.

[10]  E. Toth,et al.  Comparison of short-term rainfall prediction models for real-time flood forecasting , 2000 .

[11]  Duo Zhang,et al.  Use Long Short-Term Memory to Enhance Internet of Things for Combined Sewer Overflow Monitoring , 2018 .

[12]  Ronggao Liu,et al.  Nitrogen Availability Dampens the Positive Impacts of CO2 Fertilization on Terrestrial Ecosystem Carbon and Water Cycles , 2017 .

[13]  D. Koutsoyiannis,et al.  2.02 – Precipitation , 2011 .

[14]  Demetris Koutsoyiannis,et al.  Climacogram versus autocovariance and power spectrum in stochastic modelling for Markovian and Hurst–Kolmogorov processes , 2015, Stochastic Environmental Research and Risk Assessment.

[15]  A. Rao,et al.  Testing Hydrologic Time Series for Stationarity , 2002 .

[16]  Mahmud Güngör,et al.  River flow estimation using adaptive neuro fuzzy inference system , 2007, Math. Comput. Simul..

[17]  D. G. Watts,et al.  Application of Linear Random Models to Four Annual Streamflow Series , 1970 .

[18]  Ozgur Kisi,et al.  A wavelet-support vector machine conjunction model for monthly streamflow forecasting , 2011 .

[19]  Chuntian Cheng,et al.  Long-Term Prediction of Discharges in Manwan Reservoir Using Artificial Neural Network Models , 2005, ISNN.

[20]  Li-Chiu Chang,et al.  Real‐time recurrent learning neural network for stream‐flow forecasting , 2002 .

[21]  Vadim V. Strijov,et al.  Position-Based Content Attention for Time Series Forecasting with Sequence-to-Sequence RNNs , 2017, ICONIP.

[22]  Ozgur Kisi,et al.  Streamflow Forecasting Using Different Artificial Neural Network Algorithms , 2007 .

[23]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[24]  Zaher Mundher Yaseen,et al.  Application of the Hybrid Artificial Neural Network Coupled with Rolling Mechanism and Grey Model Algorithms for Streamflow Forecasting Over Multiple Time Horizons , 2018, Water Resources Management.

[25]  Hubert H. G. Savenije,et al.  Model complexity control for hydrologic prediction , 2008 .

[26]  Xiao Yang,et al.  Prolongation of SMAP to Spatiotemporally Seamless Coverage of Continental U.S. Using a Deep Learning Neural Network , 2017, 1707.06611.

[27]  T. McMahon,et al.  Stochastic generation of annual, monthly and daily climate data: A review , 2001 .

[28]  V. Smakhtin Low flow hydrology: a review , 2001 .

[29]  George Athanasopoulos,et al.  Forecasting: principles and practice , 2013 .

[30]  Chuntian Cheng,et al.  A comparison of performance of several artificial intelligence methods for forecasting monthly discharge time series , 2009 .

[31]  Aman Jantan,et al.  State-of-the-art in artificial neural network applications: A survey , 2018, Heliyon.

[32]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[33]  C. Sivapragasam,et al.  Genetic programming model for forecast of short and noisy data , 2007 .

[34]  Demetris Koutsoyiannis,et al.  Medium-range flow prediction for the Nile: a comparison of stochastic and deterministic methods / Prévision du débit du Nil à moyen terme: une comparaison de méthodes stochastiques et déterministes , 2008 .

[35]  Georgia Papacharalampous,et al.  Variable Selection in Time Series Forecasting Using Random Forests , 2017, Algorithms.

[36]  Mohammad Teshnehlab,et al.  Using adaptive neuro-fuzzy inference system for hydrological time series prediction , 2008, Appl. Soft Comput..

[37]  M. Ye,et al.  Developing a Long Short-Term Memory (LSTM) based model for predicting water table depth in agricultural areas , 2018, Journal of Hydrology.

[38]  Vijay P. Singh,et al.  Critical appraisal of methods for the assessment of environmental flows and their application in two river systems of India , 2008 .

[39]  Georgia Papacharalampous,et al.  Large-scale assessment of Prophet for multi-step ahead forecasting of monthly streamflow , 2018, Advances in Geosciences.

[40]  Olusola Adeniyi Abidogun Data mining, fraud detection and mobile telecommunications: call pattern analysis with unsupervised neural networks , 2005 .

[41]  K. Lam,et al.  River flow time series prediction with a range-dependent neural network , 2001 .

[42]  F. Gers,et al.  Long short-term memory in recurrent neural networks , 2001 .

[43]  Kuk-Hyun Ahn,et al.  Use of a nonstationary copula to predict future bivariate low flow frequency in the Connecticut river basin , 2016 .

[44]  Lukás Burget,et al.  Extensions of recurrent neural network language model , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[45]  Jean-Philippe Vidal,et al.  Low Flows in France and their relationship to large scale climate indices , 2013 .

[46]  Arjen Ysbert Hoekstra,et al.  Identification of appropriate lags and temporal resolutions for low flow indicators in the River Rhine to forecast low flows with different lead times , 2013 .

[47]  Hubert Cardot,et al.  A new boosting algorithm for improved time-series forecasting with recurrent neural networks , 2008, Inf. Fusion.

[48]  Mahmud Güngör,et al.  Hydrological time‐series modelling using an adaptive neuro‐fuzzy inference system , 2008 .

[49]  Demetris Koutsoyiannis,et al.  One-step ahead forecasting of geophysical processes within a purely statistical framework , 2018, Geoscience Letters.

[50]  J. Dracup,et al.  On the definition of droughts , 1980 .

[51]  Wenxi Lu,et al.  Monthly Rainfall Forecasting Using Echo State Networks Coupled with Data Preprocessing Methods , 2017, Water Resources Management.

[52]  Demetris Koutsoyiannis,et al.  Comparison of stochastic and machine learning methods for multi-step ahead forecasting of hydrological processes , 2019, Stochastic Environmental Research and Risk Assessment.

[53]  Marcella Cannarozzo,et al.  Multi-year drought frequency analysis at multiple sites by operational hydrology - A comparison of methods , 2006 .

[54]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[55]  K. Beven Rainfall-Runoff Modelling: The Primer , 2012 .

[56]  Dong Wang,et al.  The relation between periods’ identification and noises in hydrologic series data , 2009 .

[57]  Jürgen Schmidhuber,et al.  Learning to forget: continual prediction with LSTM , 1999 .

[58]  Demetris Koutsoyiannis,et al.  Predictability of monthly temperature and precipitation using automatic time series forecasting methods , 2018, Acta Geophysica.

[59]  K. Hipel,et al.  Time series modelling of water resources and environmental systems , 1994 .

[60]  null null,et al.  Artificial Neural Networks in Hydrology. II: Hydrologic Applications , 2000 .

[61]  Vladimir U. Smakhtin,et al.  A review of methods of hydrological estimation at ungauged sites in India , 2008 .

[62]  Zaher Mundher Yaseen,et al.  Artificial intelligence based models for stream-flow forecasting: 2000-2015 , 2015 .

[63]  Yan-Fang Sang,et al.  A review on the applications of wavelet transform in hydrology time series analysis , 2013 .

[64]  P. C. Nayak,et al.  A neuro-fuzzy computing technique for modeling hydrological time series , 2004 .

[65]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[66]  J. Elliott,et al.  Machine learning algorithms for modeling groundwater level changes in agricultural regions of the U.S. , 2017 .

[67]  Lukás Burget,et al.  Recurrent neural network based language model , 2010, INTERSPEECH.

[68]  David R. Cox,et al.  Time Series Analysis , 2012 .

[69]  R. Martel,et al.  Time series and stochastic analyses to study the hydrodynamic characteristics of karstic aquifers , 2009 .

[70]  R. Deo,et al.  Stream-flow forecasting using extreme learning machines: a case study in a semi-arid region in Iraq , 2016 .

[71]  Demetris Koutsoyiannis,et al.  Univariate Time Series Forecasting of Temperature and Precipitation with a Focus on Machine Learning Algorithms: a Multiple-Case Study from Greece , 2018, Water Resources Management.

[72]  Chuntian Cheng,et al.  Using support vector machines for long-term discharge prediction , 2006 .

[73]  Demetris Koutsoyiannis,et al.  Predictability in dice motion: how does it differ from hydro-meteorological processes? , 2016 .

[74]  Demetris Koutsoyiannis,et al.  A Bayesian statistical model for deriving the predictive distribution of hydroclimatic variables , 2014, Climate Dynamics.

[75]  G. Blöschl,et al.  Low flow estimates from short stream flow records—a comparison of methods , 2005 .

[76]  Nengcheng Chen,et al.  An evaluation of statistical, NMME and hybrid models for drought prediction in China , 2018, Journal of Hydrology.

[77]  Christoph Bergmeir,et al.  Forecasting Across Time Series Databases using Long Short-Term Memory Networks on Groups of Similar Series , 2017, ArXiv.

[78]  Radko Mesiar,et al.  Comparison of forecasting performance of nonlinear models of hydrological time series , 2006 .