Electricity Price Forecasting Using Recurrent Neural Networks

Accurate electricity price forecasting has become a substantial requirement since the liberalization of the electricity markets. Due to the challenging nature of electricity prices, which includes high volatility, sharp price spikes and seasonality, various types of electricity price forecasting models still compete and cannot outperform each other consistently. Neural Networks have been successfully used in machine learning problems and Recurrent Neural Networks (RNNs) have been proposed to address time-dependent learning problems. In particular, Long Short Term Memory (LSTM) and Gated Recurrent Units (GRU) are tailor-made for time series price estimation. In this paper, we propose to use multi-layer Gated Recurrent Units as a new technique for electricity price forecasting. We have trained a variety of algorithms with three-year rolling window and compared the results with the RNNs. In our experiments, three-layered GRUs outperformed all other neural network structures and state-of-the-art statistical techniques in a statistically significant manner in the Turkish day-ahead market.

[1]  Joanna Janczura,et al.  Identifying Spikes and Seasonal Components in Electricity Spot Price Data: A Guide to Robust Modeling , 2012 .

[2]  Philip D. Wasserman,et al.  Neural networks. II. What are they and why is everybody so interested in them now? , 1988, IEEE Expert.

[3]  Osman Bulent Tor,et al.  Probabilistic day-ahead system marginal price forecasting with ANN for the Turkish electricity market , 2017 .

[4]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[5]  Gulgun Kayakutlu,et al.  A combined seasonal ARIMA and ANN model for improved results in electricity spot price forecasting: Case study in Turkey , 2016, 2016 Portland International Conference on Management of Engineering and Technology (PICMET).

[6]  Chuntian Cheng,et al.  Day-ahead electricity price forecasting using artificial intelligence , 2008, 2008 IEEE Canada Electric Power Conference.

[7]  Dogan Keles,et al.  Comparison of extended mean-reversion and time series models for electricity spot price simulation considering negative prices , 2012 .

[8]  T. Dillon,et al.  Electricity price short-term forecasting using artificial neural networks , 1999 .

[9]  Florian Ziel,et al.  Electricity price forecasting using sale and purchase curves: The X-Model , 2015, 1509.00372.

[10]  Azize Hayfavi,et al.  Stochastic multifactor modeling of spot electricity prices , 2014, J. Comput. Appl. Math..

[11]  M. Obersteiner,et al.  Forecasting electricity spot-prices using linear univariate time-series models , 2004 .

[12]  Marcel Prokopczuk,et al.  Electricity Derivatives Pricing with Forward-Looking Information , 2015 .

[13]  Ioannis P. Panapakidis,et al.  Day-ahead electricity price forecasting via the application of artificial neural network based models , 2016 .

[14]  Ping-Huan Kuo,et al.  A High Precision Artificial Neural Networks Model for Short-Term Energy Load Forecasting , 2018 .

[15]  James D. Hamilton A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle , 1989 .

[16]  Michael Eichler,et al.  Fitting semiparametric Markov regime-switching models to electricity spot prices , 2012 .

[17]  Stefan Feuerriegel,et al.  Putting Big Data analytics to work: Feature selection for forecasting electricity prices using the LASSO and random forests , 2014, J. Decis. Syst..

[18]  Florian Ziel,et al.  Variance Stabilizing Transformations for Electricity Spot Price Forecasting , 2018, IEEE Transactions on Power Systems.

[19]  J. Contreras,et al.  Forecasting Next-Day Electricity Prices by Time Series Models , 2002, IEEE Power Engineering Review.

[20]  Jakub Nowotarski,et al.  Automated Variable Selection and Shrinkage for Day-Ahead Electricity Price Forecasting , 2016 .

[21]  T. Kristiansen Forecasting Nord Pool day-ahead prices with an autoregressive model , 2012 .

[22]  Najeh Chaâbane,et al.  A hybrid ARFIMA and neural network model for electricity price prediction , 2014 .

[23]  Zhenyu Zhao,et al.  A Novel Hybrid BND-FOA-LSSVM Model for Electricity Price Forecasting , 2017, Inf..

[24]  Bart De Schutter,et al.  Forecasting day-ahead electricity prices in Europe: the importance of considering market integration , 2017, ArXiv.

[25]  Nikolaos G. Bourbakis,et al.  Very-short term forecasting of electricity price signals using a Pareto composition of kernel machines in smart power systems , 2015, 2015 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[26]  D. Dijk,et al.  Forecasting Day-Ahead Electricity Prices: Utilizing Hourly Prices , 2013 .

[27]  Vikas Singh,et al.  Sampling-free Uncertainty Estimation in Gated Recurrent Units with Exponential Families , 2018, ArXiv.

[28]  Bernhard Sick,et al.  Deep Learning for solar power forecasting — An approach using AutoEncoder and LSTM Neural Networks , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[29]  N. Amjady Day-ahead price forecasting of electricity markets by a new fuzzy neural network , 2006, IEEE Transactions on Power Systems.

[30]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[31]  Joanna Janczura,et al.  An empirical comparison of alternate regime-switching models or electricity spot prices , 2010 .

[32]  F. Diebold,et al.  Comparing Predictive Accuracy , 1994, Business Cycles.

[33]  Yoshua Bengio,et al.  On the Properties of Neural Machine Translation: Encoder–Decoder Approaches , 2014, SSST@EMNLP.

[34]  Mehmet Ali Kölmek,et al.  Forecasting the day-ahead price in electricity balancing and settlement market of Turkey by using artificial neural networks , 2015 .

[35]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[36]  D.W. Bunn,et al.  Forecasting loads and prices in competitive power markets , 2000, Proceedings of the IEEE.

[37]  Guoqiang Peter Zhang,et al.  Time series forecasting using a hybrid ARIMA and neural network model , 2003, Neurocomputing.

[38]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[39]  Rafał Weron,et al.  Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks , 2018, 1805.06649.

[40]  B. K. Panigrahi,et al.  A hybrid wavelet-ELM based short term price forecasting for electricity markets , 2014 .

[41]  Ying-Yi Hong,et al.  Day-Ahead Electricity Price Forecasting Using a Hybrid Principal Component Analysis Network , 2012 .

[42]  A. Aydogan,et al.  Bidding structure, market efficiency and persistence in a multi-time tariff setting , 2016 .

[43]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[44]  T. Ware,et al.  Polynomial Processes for Power Prices , 2017, Applied Mathematical Finance.

[45]  Estefania Planas,et al.  A Note on the Normalization of Spanish Electricity Spot Prices , 2016, IEEE Transactions on Power Systems.

[46]  J. Contreras,et al.  ARIMA Models to Predict Next-Day Electricity Prices , 2002, IEEE Power Engineering Review.

[47]  Sam Howison,et al.  Stochastic Behaviour of the Electricity Bid Stack: From Fundamental Drivers to Power Prices , 2009 .

[48]  R. Weron Electricity price forecasting: A review of the state-of-the-art with a look into the future , 2014 .

[49]  V. Mendes,et al.  Short-term electricity prices forecasting in a competitive market: A neural network approach , 2007 .

[50]  Patrick Hosein,et al.  Load forecasting using deep neural networks , 2017, 2017 IEEE Power & Energy Society Innovative Smart Grid Technologies Conference (ISGT).

[51]  Francesco Lisi,et al.  Combining day-ahead forecasts for British electricity prices , 2013 .

[52]  Nikolaos G. Bourbakis,et al.  Genetic Optimal Regression of Relevance Vector Machines for Electricity Pricing Signal Forecasting in Smart Grids , 2015, IEEE Transactions on Smart Grid.

[53]  Miriam Hodge Stochastic behavior of the electricity bid stack: from fundamental drivers to power prices , 2012 .

[54]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[55]  W. Woon,et al.  Ensemble Prediction Model with Expert Selection for Electricity Price Forecasting , 2016 .

[56]  T. Senjyu,et al.  Neural networks approach to forecast several hour ahead electricity prices and loads in deregulated market , 2006 .

[57]  René Carmona,et al.  Electricity price modeling and asset valuation: a multi-fuel structural approach , 2012, 1205.2299.

[58]  Long Chen,et al.  Short-Term Load Forecasting Using EMD-LSTM Neural Networks with a Xgboost Algorithm for Feature Importance Evaluation , 2017 .

[59]  Cenktan Ozyildirim,et al.  Forecasting and Modelling of Electricity Prices by Radial Basis Functions: Turkish Electricity Market Experiment , 2014 .

[60]  R. Carmona,et al.  A Survey of Commodity Markets and Structural Models for Electricity Prices , 2014 .

[61]  Ashwani Kumar,et al.  Electricity price forecasting in deregulated markets: A review and evaluation , 2009 .

[62]  Zhang Chao,et al.  Short-term prediction of wind power based on deep Long Short-Term Memory , 2016, 2016 IEEE PES Asia-Pacific Power and Energy Engineering Conference (APPEEC).

[63]  Wenpeng Yin,et al.  Comparative Study of CNN and RNN for Natural Language Processing , 2017, ArXiv.

[64]  James W. Taylor,et al.  Triple seasonal methods for short-term electricity demand forecasting , 2010, Eur. J. Oper. Res..

[65]  Mohammad Shahidehpour,et al.  Market operations in electric power systems , 2002 .

[66]  K. Bhattacharya,et al.  Economic Impact of Electricity Market Price Forecasting Errors: A Demand-Side Analysis , 2010, IEEE Transactions on Power Systems.

[67]  Á. Cartea,et al.  Pricing in Electricity Markets: A Mean Reverting Jump Diffusion Model with Seasonality , 2005 .

[68]  Florentina Paraschiv,et al.  Extended forecast methods for day-ahead electricity spot prices applying artificial neural networks , 2016 .

[69]  R. Weron,et al.  Forecasting spot electricity prices: A comparison of parametric and semiparametric time series models , 2008 .

[70]  N. Pindoriya,et al.  An Adaptive Wavelet Neural Network-Based Energy Price Forecasting in Electricity Markets , 2008, IEEE Transactions on Power Systems.

[71]  Z. Dong,et al.  A Statistical Approach for Interval Forecasting of the Electricity Price , 2008, IEEE Transactions on Power Systems.

[72]  H. Geman,et al.  Understanding the Fine Structure of Electricity Prices , 2004 .

[73]  A.J. Conejo,et al.  Day-ahead electricity price forecasting using the wavelet transform and ARIMA models , 2005, IEEE Transactions on Power Systems.

[74]  S. Lessmann,et al.  Deregulated Day-Ahead Electricity Markets in Southeast Europe: Price Forecasting and Comparative Structural Analysis , 2018 .

[75]  Tomoharu Iwata,et al.  Improving Output Uncertainty Estimation and Generalization in Deep Learning via Neural Network Gaussian Processes , 2017, 1707.05922.

[76]  Daniel Rueckert,et al.  Automatic left ventricular outflow tract classification for accurate cardiac MR planning , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[77]  Bart De Schutter,et al.  Forecasting spot electricity prices Deep learning approaches and empirical comparison of traditional algorithms , 2018 .

[78]  J. Catalão,et al.  A Stochastic Multi-Layer Agent-Based Model to Study Electricity Market Participants Behavior , 2015, IEEE Transactions on Power Systems.

[79]  Georg Dorffner,et al.  Neural Networks for Time Series Processing , 1996 .

[80]  Ruey S. Tsay,et al.  Analysis of Financial Time Series , 2005 .

[81]  Florian Ziel,et al.  Forecasting Electricity Spot Prices Using Lasso: On Capturing the Autoregressive Intraday Structure , 2015, IEEE Transactions on Power Systems.

[82]  Marcel Prokopczuk,et al.  The Case of Negative Day-Ahead Electricity Prices , 2011 .

[83]  Oktay Tas,et al.  Performance of Electricity Price Forecasting Models: Evidence from Turkey , 2018 .

[84]  M. Ege Yazgan,et al.  Is forecasting inflation easier under inflation targeting? , 2015 .

[85]  Yulei Rao,et al.  A deep learning framework for financial time series using stacked autoencoders and long-short term memory , 2017, PloS one.

[86]  D. Bunn Modelling prices in competitive electricity markets , 2004 .