Electricity price prediction based on hybrid model of adam optimized LSTM neural network and wavelet transform

To a large extent, electricity price prediction is a daunting task because it depends on factors, such as weather, fuel, load and bidding strategies etc. Those features generate a lot of fluctuations to electricity price. As a type of RNN, LSTM has a good performance on processing time series data as well as some nonlinear and complex problems. To explore more accurate electricity price forecasting approach, in this paper, a new hybrid model based on wavelet transform and Adam optimized LSTM neural network, denoted as WT-Adam-LSTM, is proposed. After the wavelet transform, nonlinear sequence of electricity price can be decomposed and processed data will have a more stable variance, and the combination of Adam, one of efficient stochastic gradient-based optimizers, and LSTM can capture appropriate behaviors precisely for electricity price. This study presented four cases to verify the performance of the hybrid model, and the dataset from New South Wales of Australia and French were adopted to illustrate the excellence of the hybrid model. The results show that the proposed model can significantly improve the prediction accuracy.

[1]  Z. Tan,et al.  Day-ahead electricity price forecasting using wavelet transform combined with ARIMA and GARCH models , 2010 .

[2]  Ling Tang,et al.  Electricity price forecasting with a BED (Bivariate EMD Denoising) methodology , 2015 .

[3]  A.J. Conejo,et al.  Day-ahead electricity price forecasting using the wavelet transform and ARIMA models , 2005, IEEE Transactions on Power Systems.

[4]  Kai Chen,et al.  A LSTM-based method for stock returns prediction: A case study of China stock market , 2015, 2015 IEEE International Conference on Big Data (Big Data).

[5]  Xing Yan,et al.  Mid-term electricity market clearing price forecasting: A multiple SVM approach , 2014 .

[6]  S. Surender Reddy,et al.  Bat algorithm-based back propagation approach for short-term load forecasting considering weather factors , 2018 .

[7]  Jarmo Partanen,et al.  Forecasting electricity price and demand using a hybrid approach based on wavelet transform, ARIMA and neural networks , 2014 .

[8]  Mototsugu Fukushige,et al.  Modeling and forecasting hourly electricity demand by SARIMAX with interactions , 2018, Energy.

[9]  Rui Liu,et al.  Effective long short-term memory with differential evolution algorithm for electricity price prediction , 2018, Energy.

[10]  Olivier Grunder,et al.  Multi-step ahead electricity price forecasting using a hybrid model based on two-layer decomposition technique and BP neural network optimized by firefly algorithm , 2017 .

[11]  Jakub Nowotarski,et al.  On the importance of the long-term seasonal component in day-ahead electricity price forecasting , 2016, Energy Economics.

[12]  Heikki Huttunen,et al.  Recurrent neural networks for polyphonic sound event detection in real life recordings , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[13]  Yanfei Li,et al.  Wind speed forecasting method based on deep learning strategy using empirical wavelet transform, long short term memory neural network and Elman neural network , 2018 .

[14]  B. Eswara Reddy,et al.  A moving-average filter based hybrid ARIMA-ANN model for forecasting time series data , 2014, Appl. Soft Comput..

[15]  Yao Dong,et al.  Short-term electricity price forecast based on the improved hybrid model , 2011 .

[16]  Ha Young Kim,et al.  Forecasting the volatility of stock price index: A hybrid model integrating LSTM with multiple GARCH-type models , 2018, Expert Syst. Appl..

[17]  Navdeep Jaitly,et al.  Hybrid speech recognition with Deep Bidirectional LSTM , 2013, 2013 IEEE Workshop on Automatic Speech Recognition and Understanding.

[18]  Zhengjun Liu,et al.  Two noise-robust axial scanning multi-image phase retrieval algorithms based on Pauta criterion and smoothness constraint. , 2017, Optics express.

[19]  Adriano C. M. Pereira,et al.  Stock market's price movement prediction with LSTM neural networks , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[20]  Hermann Ney,et al.  LSTM Neural Networks for Language Modeling , 2012, INTERSPEECH.

[21]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[22]  Rathinasamy Maheswaran,et al.  Comparative study of different wavelets for hydrologic forecasting , 2012, Comput. Geosci..

[23]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[24]  Paras Mandal,et al.  A novel hybrid approach using wavelet, firefly algorithm, and fuzzy ARTMAP for day-ahead electricity price forecasting , 2013, IEEE Transactions on Power Systems.

[25]  Z. Tan,et al.  Day-ahead electricity price forecasting using WT, CLSSVM and EGARCH model , 2013 .

[26]  Andrew McCallum,et al.  Ask the GRU: Multi-task Learning for Deep Text Recommendations , 2016, RecSys.

[27]  Yifan Peng,et al.  Chemical-protein relation extraction with ensembles of SVM, CNN, and RNN models , 2018, ArXiv.

[28]  H. Shayeghi,et al.  Day-ahead electricity prices forecasting by a modified CGSA technique and hybrid WT in LSSVM based scheme , 2013 .

[29]  Ioannis P. Panapakidis,et al.  Day-ahead electricity price forecasting via the application of artificial neural network based models , 2016 .

[30]  R. Weron.  Electricity price forecasting: A review of the state-of-the-art with a look into the future , 2014 .

[31]  Zhang Yang,et al.  Electricity price forecasting by a hybrid model, combining wavelet transform, ARMA and kernel-based extreme learning machine methods , 2017 .

[32]  Stephan Schlüter,et al.  Using wavelets for time series forecasting: Does it pay off? , 2010 .

[33]  Fei Gao,et al.  Density prediction and dimensionality reduction of mid-term electricity demand in China: A new semiparametric-based additive model , 2014 .

[34]  Nitin Singh,et al.  Short term electricity price forecast based on environmentally adapted generalized neuron , 2017 .

[35]  Bart De Schutter,et al.  Forecasting day-ahead electricity prices in Europe: the importance of considering market integration , 2017, ArXiv.

[36]  Kit Po Wong,et al.  Electricity Price Forecasting With Extreme Learning Machine and Bootstrapping , 2012, IEEE Transactions on Power Systems.

[37]  Zhen-Hua Ling,et al.  Enhanced LSTM for Natural Language Inference , 2016, ACL.

[38]  Tetsuya Takiguchi,et al.  Emotional Voice Conversion Using Neural Networks with Different Temporal Scales of F0 based on Wavelet Transform , 2016, SSW.

[39]  Macarena Boix,et al.  Wavelet Transform application to the compression of images , 2010, Math. Comput. Model..

[40]  B. K. Panigrahi,et al.  A hybrid wavelet-ELM based short term price forecasting for electricity markets , 2014 .