Forecasting spot electricity prices Deep learning approaches and empirical comparison of traditional algorithms

In this paper, a novel modeling framework for forecasting electricity prices is proposed. While many predictive models have been already proposed to perform this task, the area of deep learning algorithms remains yet unexplored. To fill this scientific gap, we propose four different deep learning models for predicting electricity prices and we show how they lead to improvements in predictive accuracy. In addition, we also consider that, despite the large number of proposed methods for predicting electricity prices, an extensive benchmark is still missing. To tackle that, we compare and analyze the accuracy of 27 common approaches for electricity price forecasting. Based on the benchmark results, we show how the proposed deep learning models outperform the state-of-the-art methods and obtain results that are statistically significant. Finally, using the same results, we also show that: (i) machine learning methods yield, in general, a better accuracy than statistical models; (ii) moving average terms do not improve the predictive accuracy; (iii) hybrid models do not outperform their simpler counterparts.

[1]  Yoshua Bengio,et al.  Algorithms for Hyper-Parameter Optimization , 2011, NIPS.

[2]  Dipti Srinivasan,et al.  A hybrid intelligent model based on recurrent neural networks and excitable dynamics for price prediction in deregulated electricity market , 2013, Eng. Appl. Artif. Intell..

[3]  N. Amjady,et al.  Energy price forecasting - problems and proposals for such predictions , 2006 .

[4]  Bart De Schutter,et al.  Forecasting day-ahead electricity prices in Europe: the importance of considering market integration , 2017, ArXiv.

[5]  Fotios Petropoulos,et al.  forecast: Forecasting functions for time series and linear models , 2018 .

[6]  Florian Ziel,et al.  Forecasting day ahead electricity spot prices: The impact of the EXAA to other European electricity markets , 2015, 1501.00818.

[7]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[8]  R. Weron.  Electricity price forecasting: A review of the state-of-the-art with a look into the future , 2014 .

[9]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[10]  Farshid Keynia.  A new feature selection algorithm and composite neural network for electricity price forecasting , 2012, Eng. Appl. Artif. Intell..

[11]  Bri-Mathias Hodge,et al.  The impact of wind power on electricity prices , 2016 .

[12]  J. Contreras,et al.  Forecasting Next-Day Electricity Prices by Time Series Models , 2002, IEEE Power Engineering Review.

[13]  Jie Zhang,et al.  A data-driven multi-model methodology with deep feature selection for short-term wind forecasting , 2017 .

[14]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[15]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[16]  Zhang Yang,et al.  Electricity price forecasting by a hybrid model, combining wavelet transform, ARMA and kernel-based extreme learning machine methods , 2017 .

[17]  Jakub Nowotarski,et al.  An empirical comparison of alternate schemes for combining electricity spot price forecasts , 2013 .

[18]  J. W. Taylor,et al.  Short-term electricity demand forecasting using double seasonal exponential smoothing , 2003, J. Oper. Res. Soc..

[19]  Jing Ma,et al.  Research and application of a hybrid wavelet neural network model with the improved cuckoo search algorithm for electrical power system forecasting , 2017 .

[20]  Farshid Keynia,et al.  Day ahead price forecasting of electricity markets by a mixed data model and hybrid forecast method , 2008 .

[21]  A. Kazemi,et al.  Day-ahead price forecasting in restructured power systems using artificial neural networks , 2008 .

[22]  Narayanan Kumarappan,et al.  Day-Ahead Deregulated Electricity Market Price Forecasting Using Recurrent Neural Network , 2013, IEEE Systems Journal.

[23]  Mohammad Shahidehpour,et al.  Market operations in electric power systems , 2002 .

[24]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[25]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[26]  Tom Downs,et al.  Evaluation of support vector machine based forecasting tool in electricity price forecasting for Australian national electricity market participants , 2002 .

[27]  Joel Andersson,et al.  A General-Purpose Software Framework for Dynamic Optimization (Een algemene softwareomgeving voor dynamische optimalisatie) , 2013 .

[28]  Ashwani Kumar,et al.  Electricity Price Forecasting in Ontario Electricity Market Using Wavelet Transform in Artificial Neural Network Based Model , 2008 .

[29]  R. Green,et al.  Market behaviour with large amounts of intermittent generation , 2010 .

[30]  F. Diebold,et al.  Comparing Predictive Accuracy , 1994, Business Cycles.

[31]  R. Weron,et al.  Point and Interval Forecasting of Spot Electricity Prices: Linear vs. Non-Linear Time Series Models , 2006 .

[32]  Olivier Grunder,et al.  Multi-step ahead electricity price forecasting using a hybrid model based on two-layer decomposition technique and BP neural network optimized by firefly algorithm , 2017 .

[33]  M. Obersteiner,et al.  Forecasting electricity spot-prices using linear univariate time-series models , 2004 .

[34]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[35]  Farshid Keynia,et al.  Day-ahead electricity price forecasting by modified relief algorithm and hybrid neural network , 2010 .

[36]  Yoshua Bengio,et al.  On the Properties of Neural Machine Translation: Encoder–Decoder Approaches , 2014, SSST@EMNLP.

[37]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[38]  Yitao Liu,et al.  Deep belief network based deterministic and probabilistic wind speed forecasting approach , 2016 .

[39]  J. van Leeuwen,et al.  Neural Networks: Tricks of the Trade , 2002, Lecture Notes in Computer Science.

[40]  Jianzhou Wang,et al.  Short-term electricity prices forecasting based on support vector regression and Auto-regressive integrated moving average modeling , 2010 .

[41]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[42]  Christopher R. Knittel,et al.  An empirical examination of restructured electricity prices , 2005 .

[43]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[44]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[45]  Y. Yao,et al.  On Early Stopping in Gradient Descent Learning , 2007 .

[46]  Desheng Dash Wu,et al.  A soft computing system for day-ahead electricity price forecasting , 2010, Appl. Soft Comput..

[47]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[48]  Ross Baldick.  Wind and Energy Markets: A Case Study of Texas , 2012, IEEE Systems Journal.

[49]  Yitao Liu,et al.  Deep learning based ensemble approach for probabilistic wind power forecasting , 2017 .

[50]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[51]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[52]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[53]  Florentina Paraschiv,et al.  Extended forecast methods for day-ahead electricity spot prices applying artificial neural networks , 2016 .

[54]  Whei-Min Lin,et al.  An enhanced radial basis function network for short-term electricity price forecasting , 2010 .

[55]  Z. Tan,et al.  Day-ahead electricity price forecasting using wavelet transform combined with ARIMA and GARCH models , 2010 .

[56]  R. Weron,et al.  Forecasting spot electricity prices: A comparison of parametric and semiparametric time series models , 2008 .

[57]  Frederico G. Guimarães,et al.  A GPU deep learning metaheuristic based model for time series forecasting , 2017 .

[58]  A.J. Conejo,et al.  Day-ahead electricity price forecasting using the wavelet transform and ARIMA models , 2005, IEEE Transactions on Power Systems.

[59]  Alex Graves,et al.  Generating Sequences With Recurrent Neural Networks , 2013, ArXiv.

[60]  Ricardo Cao,et al.  Forecasting next-day electricity demand and price using nonparametric functional methods , 2012 .

[61]  Ángeles Saavedra,et al.  Nonparametric maximum likelihood estimators for ar and ma time series , 2003 .

[62]  Fu Xiao,et al.  A short-term building cooling load prediction method using deep learning algorithms , 2017 .

[63]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[64]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[65]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[66]  Asher Tishler,et al.  Can price volatility enhance market power? The case of renewable technologies in competitive electricity markets , 2015 .

[67]  T. Dillon,et al.  Electricity price short-term forecasting using artificial neural networks , 1999 .

[68]  Kevin Leyton-Brown,et al.  Sequential Model-Based Optimization for General Algorithm Configuration , 2011, LION.

[69]  Joao P. S. Catalao,et al.  Short-term electricity prices forecasting in a competitive market by a hybrid PSO–ANFIS approach , 2012 .

[70]  Rob J Hyndman,et al.  Forecasting Time Series With Complex Seasonal Patterns Using Exponential Smoothing , 2011 .

[71]  Marco van Akkeren,et al.  A GARCH forecasting model to predict day-ahead electricity prices , 2005, IEEE Transactions on Power Systems.

[72]  Mohammad Kazem Sheikh-El-Eslami,et al.  Price forecasting of day-ahead electricity markets using a hybrid forecast method , 2011 .

[73]  John Salvatier,et al.  Theano: A Python framework for fast computation of mathematical expressions , 2016, ArXiv.

[74]  Shu Fan,et al.  Next-day electricity-price forecasting using a hybrid network , 2007 .

[75]  Tara N. Sainath,et al.  FUNDAMENTAL TECHNOLOGIES IN MODERN SPEECH RECOGNITION Digital Object Identifier 10.1109/MSP.2012.2205597 , 2012 .

[76]  Ashwani Kumar,et al.  Electricity price forecasting in deregulated markets: A review and evaluation , 2009 .

[77]  Rosa Espínola,et al.  The effect of wind generation and weekday on Spanish electricity spot price forecasting , 2011 .

[78]  N. Amjady,et al.  Day-Ahead Price Forecasting of Electricity Markets by Mutual Information Technique and Cascaded Neuro-Evolutionary Algorithm , 2009, IEEE Transactions on Power Systems.

[79]  Dominique Guegan,et al.  Forecasting electricity spot market prices with a k-factor GIGARCH process , 2007 .

[80]  Spyros Makridakis,et al.  Accuracy measures: theoretical and practical concerns☆ , 1993 .

[81]  Sander Bohte,et al.  Conditional Time Series Forecasting with Convolutional Neural Networks , 2017, 1703.04691.

[82]  Sijie Chen,et al.  Deep learning hybrid method for islanding detection in distributed generation , 2018 .

[83]  D. Cox,et al.  An Analysis of Transformations , 1964 .

[84]  R. Weron,et al.  FORECASTING SPOT ELECTRICITY PRICES WITH TIME SERIES MODELS , 2005 .

[85]  J. Contreras,et al.  Forecasting electricity prices for a day-ahead pool-based electric energy market , 2005 .

[86]  Ioannis P. Panapakidis,et al.  Day-ahead electricity price forecasting via the application of artificial neural network based models , 2016 .

[87]  V. Mendes,et al.  Short-term electricity prices forecasting in a competitive market: A neural network approach , 2007 .

[88]  Sebastian Ruder,et al.  An overview of gradient descent optimization algorithms , 2016, Vestnik komp'iuternykh i informatsionnykh tekhnologii.

[89]  Jakub Nowotarski,et al.  Automated Variable Selection and Shrinkage for Day-Ahead Electricity Price Forecasting , 2016 .

[90]  Alberto Gómez,et al.  Forecasting next-day price of electricity in the Spanish energy market using artificial neural networks , 2008, Eng. Appl. Artif. Intell..

[91]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.