Bayesian deep learning based method for probabilistic forecast of day-ahead electricity prices

Abstract The availability of accurate day-ahead energy prices forecasts is crucial to achieve a successful participation to liberalized electricity markets. Moreover, forecasting systems providing prediction intervals and densities (i.e. probabilistic forecasting) are fundamental to enable enhanced bidding and planning strategies considering uncertainty explicitly. Nonetheless, the vast majority of available approaches focus on point forecast. Therefore, we propose a novel methodology for probabilistic energy price forecast based on Bayesian deep learning techniques. A specific training method has been deployed to guarantee scalability to complex network architectures. Moreover, we developed a model originally supporting heteroscedasticity, thus avoiding the common homoscedastic assumption with related preprocessing effort. Experiments have been performed on two day-ahead markets characterized by different behaviors. Then, we demonstrated the capability of the proposed method to achieve robust performances in out-of-sample conditions while providing forecast uncertainty indications.

[1]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition , 2012 .

[2]  Luigi Grossi,et al.  Working Paper Series Department of Economics University of Verona Forecasting Italian Electricity Zonal Prices with Exogenous Variables , 2011 .

[3]  Narayanan Kumarappan,et al.  Day-Ahead Deregulated Electricity Market Price Forecasting Using Recurrent Neural Network , 2013, IEEE Systems Journal.

[4]  Derek W. Bunn,et al.  Forecasting electricity prices: The impact of fundamentals and time-varying coefficients , 2008 .

[5]  Isabel Praça,et al.  Adaptive Learning in Multiagent Systems: A Forecasting Methodology Based on Error Analysis , 2012, PAAMS.

[6]  V.S. Koritarov Real-world market representation with agents , 2004, IEEE Power and Energy Magazine.

[7]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[8]  Peter Tiño,et al.  Learning long-term dependencies in NARX recurrent neural networks , 1996, IEEE Trans. Neural Networks.

[9]  Liping Fang,et al.  Forecasting day-ahead price spikes for the Ontario electricity market , 2016 .

[10]  V. Mendes,et al.  Short-term electricity prices forecasting in a competitive market: A neural network approach , 2007 .

[11]  A. Gil,et al.  Forecasting of electricity prices with neural networks , 2006 .

[12]  T. Kristiansen Forecasting Nord Pool day-ahead prices with an autoregressive model , 2012 .

[13]  M. Ventosa,et al.  Electricity market modeling trends , 2005 .

[14]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[15]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[16]  Tomonobu Senjyu,et al.  Electricity price forecasting using neural networks and similar days , 2017 .

[17]  Farshid Keynia,et al.  Electricity price forecasting with a new feature selection algorithm , 2008 .

[18]  Nicolas Le Roux,et al.  Deep Belief Networks Are Compact Universal Approximators , 2010, Neural Computation.

[19]  J. Contreras,et al.  Forecasting Power Prices Using a Hybrid Fundamental-Econometric Model , 2012, IEEE Transactions on Power Systems.

[20]  Aníbal R. Figueiras-Vidal,et al.  Marginalized Neural Network Mixtures for Large-Scale Regression , 2010, IEEE Transactions on Neural Networks.

[21]  Geoffrey E. Hinton,et al.  Bayesian Learning for Neural Networks , 1995 .

[22]  C. Rodriguez,et al.  Energy price forecasting in the Ontario competitive power system market , 2004, IEEE Transactions on Power Systems.

[23]  D. Bunn,et al.  Analysis of the Nonlinear Response of Electricity Prices to Fundamental and Strategic Factors , 2010, IEEE Transactions on Power Systems.

[24]  Jakub Nowotarski,et al.  An empirical comparison of alternate schemes for combining electricity spot price forecasts , 2013 .

[25]  Vahid Vahidinasab,et al.  Bayesian neural network model to predict day-ahead electricity prices , 2008 .

[26]  Allen J. Wood,et al.  Power Generation, Operation, and Control , 1984 .

[27]  Farid Atry,et al.  Multi-step ahead forecasts for electricity prices using NARX: A new approach, a critical analysis of one-step ahead forecasts , 2009 .

[28]  Dominik Liebl,et al.  Modeling and forecasting electricity spot prices: A functional data perspective , 2013, 1310.1628.

[29]  R. Weron,et al.  FORECASTING SPOT ELECTRICITY PRICES WITH TIME SERIES MODELS , 2005 .

[30]  R. Carmona,et al.  A Survey of Commodity Markets and Structural Models for Electricity Prices , 2014 .

[31]  Rob J. Hyndman,et al.  Forecasting Uncertainty in Electricity Smart Meter Data by Boosting Additive Quantile Regression , 2016, IEEE Transactions on Smart Grid.

[32]  Ashwani Kumar,et al.  Electricity price forecasting in deregulated markets: A review and evaluation , 2009 .

[33]  Rosa Espínola,et al.  The effect of wind generation and weekday on Spanish electricity spot price forecasting , 2011 .

[34]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[35]  C. Cañizares,et al.  Application of Public-Domain Market Information to Forecast Ontario's Wholesale Electricity Prices , 2006, IEEE Transactions on Power Systems.

[36]  Carlos Maté,et al.  Electric power demand forecasting using interval time series: A comparison between VAR and iMLP , 2010 .

[37]  Kit Po Wong,et al.  Electricity Price Forecasting With Extreme Learning Machine and Bootstrapping , 2012, IEEE Transactions on Power Systems.

[38]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[39]  Joanna Janczura,et al.  An empirical comparison of alternate regime-switching models or electricity spot prices , 2010 .

[40]  J. Contreras,et al.  Forecasting next-day electricity prices by time series models , 2002 .

[41]  Bart De Schutter,et al.  Forecasting spot electricity prices Deep learning approaches and empirical comparison of traditional algorithms , 2018 .

[42]  Zuyi Li,et al.  Adaptive short-term electricity price forecasting using artificial neural networks in the restructured power markets , 2004 .

[43]  Julien Cornebise,et al.  Weight Uncertainty in Neural Networks , 2015, ArXiv.

[44]  Bart De Schutter,et al.  Forecasting day-ahead electricity prices in Europe: the importance of considering market integration , 2017, ArXiv.

[45]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[46]  David S. Stoffer,et al.  Time series analysis and its applications , 2000 .

[47]  M. Nielsen,et al.  A Regime Switching Long Memory Model for Electricity Prices , 2006 .

[48]  J. Contreras,et al.  Forecasting electricity prices for a day-ahead pool-based electric energy market , 2005 .

[49]  D. Ramin,et al.  Demand-side management via optimal production scheduling in power-intensive industries: The case of metal casting process , 2018, Applied Energy.

[50]  Ilkay Oksuz,et al.  Electricity Price Forecasting Using Recurrent Neural Networks , 2018 .

[51]  Dipti Srinivasan,et al.  A hybrid intelligent model based on recurrent neural networks and excitable dynamics for price prediction in deregulated electricity market , 2013, Eng. Appl. Artif. Intell..

[52]  Aldo Cipriano,et al.  Short-term forecasting of electricity prices in the Colombian electricity market , 2009 .

[53]  Farshid Keynia,et al.  Day-ahead price forecasting of electricity markets by a new feature selection algorithm and cascaded neural network technique , 2009 .

[54]  Derek W. Bunn,et al.  Fundamental and Behavioural Drivers of Electricity Price Volatility , 2010 .

[55]  Grzegorz Dudek,et al.  Multilayer perceptron for GEFCom2014 probabilistic electricity price forecasting , 2016 .

[56]  M. Obersteiner,et al.  Forecasting electricity spot-prices using linear univariate time-series models , 2004 .

[57]  Sílvio Mariano,et al.  A bat optimized neural network and wavelet transform approach for short-term price forecasting , 2018 .

[58]  R. Weron,et al.  Point and Interval Forecasting of Spot Electricity Prices: Linear vs. Non-Linear Time Series Models , 2006 .

[59]  Ricardo J. Bessa,et al.  Probabilistic Price Forecasting for Day-Ahead and Intraday Markets: Beyond the Statistical Model , 2017 .

[60]  Olivier Grunder,et al.  Multi-step ahead electricity price forecasting using a hybrid model based on two-layer decomposition technique and BP neural network optimized by firefly algorithm , 2017 .

[61]  R. Weron Electricity price forecasting: A review of the state-of-the-art with a look into the future , 2014 .

[62]  Francesco Lisi,et al.  Combining day-ahead forecasts for British electricity prices , 2013 .

[63]  Siem Jan Koopman,et al.  Periodic Seasonal Reg-ARFIMA–GARCH Models for Daily Electricity Spot Prices , 2007 .

[64]  T. Senjyu,et al.  Neural networks approach to forecast several hour ahead electricity prices and loads in deregulated market , 2006 .

[65]  Florentina Paraschiv,et al.  Extended forecast methods for day-ahead electricity spot prices applying artificial neural networks , 2016 .

[66]  Florian Ziel,et al.  Efficient modeling and forecasting of electricity spot prices , 2014, 1402.7027.

[67]  R. Weron,et al.  Forecasting spot electricity prices: A comparison of parametric and semiparametric time series models , 2008 .

[68]  N. Pindoriya,et al.  An Adaptive Wavelet Neural Network-Based Energy Price Forecasting in Electricity Markets , 2008, IEEE Transactions on Power Systems.

[69]  Davide Albanese,et al.  A practical tool for maximal information coefficient analysis , 2017, bioRxiv.

[70]  A.J. Conejo,et al.  Day-ahead electricity price forecasting using the wavelet transform and ARIMA models , 2005, IEEE Transactions on Power Systems.

[71]  R. Cont,et al.  Financial Modelling with Jump Processes , 2003 .

[72]  Ashwani Kumar,et al.  Short term price forecasting in deregulated electricity markets: A review of statistical models and key issues , 2009 .

[73]  R. Weron,et al.  Recent advances in electricity price forecasting: A review of probabilistic forecasting , 2016 .

[74]  Ignacio E. Grossmann,et al.  Optimal scheduling of industrial combined heat and power plants under time-sensitive electricity prices , 2013 .

[75]  H. Madsen,et al.  Forecasting Electricity Spot Prices Accounting for Wind Power Predictions , 2013, IEEE Transactions on Sustainable Energy.

[76]  Ignacio E. Grossmann,et al.  Optimization of steel production scheduling with complex time-sensitive electricity cost , 2015, Comput. Chem. Eng..

[77]  Ioannis P. Panapakidis,et al.  Day-ahead electricity price forecasting via the application of artificial neural network based models , 2016 .

[78]  Henrik Madsen,et al.  Integrating Renewables in Electricity Markets: Operational Problems , 2013 .

[79]  Rui Liu,et al.  Effective long short-term memory with differential evolution algorithm for electricity price prediction , 2018, Energy.

[80]  Dit-Yan Yeung,et al.  Towards Bayesian Deep Learning: A Framework and Some Existing Methods , 2016, IEEE Transactions on Knowledge and Data Engineering.

[81]  Gabriela Hug,et al.  Cost-Effective Scheduling of Steel Plants With Flexible EAFs , 2017, IEEE Transactions on Smart Grid.