A Hybrid Deep Stacked LSTM and GRU for Water Price Prediction

Water pricing and freshwater scarcity is an emerging global issue, a topic of debate among researchers, households and water utility managers. This is due to the fact that, the process can provide early warning signs as well as assisting water utility managers to make proper decisions on control and management of the scarce water resources through implementing water pricing policies, ensuring proper water allocation, water-use restriction as well as water production. In this paper, we presented a two-step methodology coupled stacked LSTM+GRU models while analyzing their relative performance to our reference models i.e. stacked LSTM and GRU for long term water price Prediction. It is thought that, the coupled Stacked LSTM and GRU models to exploit building of higher level of representation of the input sequence data while creating a higher level of abstraction on the final results. The GRU on the other hand assists in solving the vanishing gradient problems. The experimental results obtained from this research work indicates our coupled (Stacked LSTM+GRU) with supervised learning to significantly outperform our reference models for water price Prediction.

[1]  Lovekesh Vig,et al.  Long Short Term Memory Networks for Anomaly Detection in Time Series , 2015, ESANN.

[2]  Leslie S. Smith,et al.  A novel neural network ensemble architecture for time series forecasting , 2011, Neurocomputing.

[3]  Eduard H. Hovy,et al.  End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF , 2016, ACL.

[4]  Algirdas Maknickas,et al.  APPLICATION OF NEURAL NETWORK FOR FORECASTING OF EXCHANGE RATES AND FOREX TRADING , 2012 .

[5]  Daniel Dajun Zeng,et al.  Mining e-cigarette adverse events in social media using Bi-LSTM recurrent neural network with word embedding representation , 2018, J. Am. Medical Informatics Assoc..

[6]  Jun Feng,et al.  Using LSTM GRU and Hybrid Models for Streamflow Forecasting , 2019, MLICOM.

[7]  Eric Nichols,et al.  Named Entity Recognition with Bidirectional LSTM-CNNs , 2015, TACL.

[8]  Y. Wang,et al.  Keyword extraction from online product reviews based on bi-directional LSTM recurrent neural network , 2017, 2017 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM).

[9]  Vahid Chahkandi,et al.  Improvement of image description using bidirectional LSTM , 2018, International Journal of Multimedia Information Retrieval.

[10]  Jun Feng,et al.  Artificial Intelligence Approaches for Urban Water Demand Forecasting: A Review , 2019, MLICOM.

[11]  Wei Xu,et al.  Bidirectional LSTM-CRF Models for Sequence Tagging , 2015, ArXiv.

[12]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[13]  T.G.I. Fernando,et al.  A recurrent neural network approach in predicting daily stock prices an application to the Sri Lankan stock market , 2017, 2017 IEEE International Conference on Industrial and Information Systems (ICIIS).

[14]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[15]  Zheng Huang,et al.  Bi-directional LSTM Recurrent Neural Network for Chinese Word Segmentation , 2016, ICONIP.

[16]  Zhizheng Wu,et al.  Investigating gated recurrent neural networks for speech synthesis , 2016, ArXiv.

[17]  Noah A. Smith,et al.  Transition-Based Dependency Parsing with Stack Long Short-Term Memory , 2015, ACL.

[18]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[19]  Oladimeji Farri,et al.  Neural Paraphrase Generation with Stacked Residual LSTM Networks , 2016, COLING.

[20]  Simon King,et al.  Investigating gated recurrent neural networks for speech synthesis , 2016 .

[21]  Shuming Liu,et al.  Short-Term Water Demand Forecast Based on Deep Learning Method , 2018, Journal of Water Resources Planning and Management.