On the impact of outlier filtering on the electricity price forecasting accuracy

Abstract Increasing the accuracy of short-term electricity price forecasting allows day-ahead power market participants to obtain a positive economic effect by bidding close to the equilibrium price. However the electricity price time-series is generally infested with extreme values due to high price volatility. This paper discusses the impact of outlier filtering on forecasting accuracy based on a recently introduced seasonal component autoregressive model. We consider such methods of outlier detection (with a priori defined cut-off parameter) as threshold, standard deviation, percentage, recursive, and moving filter on prices. It is shown that such data pre-processing often leads to the forecasting accuracy gain while the error decrease (relative to the approach without filtering) in a number of cases may reach 1.8–1.9% of the average weekly price (in absolute values). For an a priori defined cut-off parameter, the simple threshold and standard deviation filter on prices outperform other considered methods, and yield to the accuracy gain in 63% and 67% of cases, correspondingly. At the same time, in case of the out-of-sample filter parameter grid-optimization all of the methods demonstrate comparable prediction power (equal to the marginal performance). But, practically speaking, such optimization is time-consuming and cannot be carried out on unavailable future data. As an competitive alternative, we propose a combined filter on prices based on a committee machine which uses the results of individual non-optimized algorithms and is not time-consuming, but gives accuracy comparable to the best one obtained for each of the studied electricity markets and leads to forecast gain in 63% of the considered cases.

[1]  Florentina Paraschiv,et al.  Extended forecast methods for day-ahead electricity spot prices applying artificial neural networks , 2016 .

[2]  R. Carmona,et al.  A Survey of Commodity Markets and Structural Models for Electricity Prices , 2014 .

[3]  Z. Tan,et al.  Day-ahead electricity price forecasting using wavelet transform combined with ARIMA and GARCH models , 2010 .

[4]  Joanna Janczura,et al.  Identifying Spikes and Seasonal Components in Electricity Spot Price Data: A Guide to Robust Modeling , 2012 .

[5]  Jakub Nowotarski,et al.  LTSC_EXAMPLE: MATLAB example script and data for "Robust estimation and forecasting of the long-term seasonal component of electricity spot prices" , 2013 .

[6]  Elena Fedorova,et al.  The long-term trends on the electricity markets: Comparison of empirical mode and wavelet decompositions , 2016 .

[7]  Francesco Lisi,et al.  Combining day-ahead forecasts for British electricity prices , 2013 .

[8]  J. Casazza,et al.  Understanding electric power systems : an overview of the technology and the marketplace , 2003 .

[9]  Joseph P. Romano,et al.  The stationary bootstrap , 1994 .

[10]  A. Eydeland Energy and Power Risk Management , 2002 .

[11]  Jing Ma,et al.  Research and application of a hybrid wavelet neural network model with the improved cuckoo search algorithm for electrical power system forecasting , 2017 .

[12]  Francesco Lisi,et al.  Component estimation for electricity prices: Procedures and comparisons , 2014 .

[13]  R. Weron Electricity price forecasting: A review of the state-of-the-art with a look into the future , 2014 .

[14]  J. Partanen,et al.  Price Forecasting in the Day-Ahead Energy Market by an Iterative Method with Separate Normal Price and Price Spike Frameworks , 2013 .

[15]  Ashwani Kumar,et al.  Electricity price forecasting in deregulated markets: A review and evaluation , 2009 .

[16]  Á. Cartea,et al.  Pricing in Electricity Markets: A Mean Reverting Jump Diffusion Model with Seasonality , 2005 .

[17]  Fany Nan,et al.  Forecasting next-day electricity prices: from different models to combination , 2009 .

[18]  Clarence M. Ablow,et al.  A committee solution of the pattern recognition problem (Corresp.) , 1965, IEEE Trans. Inf. Theory.

[19]  J. M. Bates,et al.  The Combination of Forecasts , 1969 .

[20]  R. Weron,et al.  Point and Interval Forecasting of Spot Electricity Prices: Linear vs. Non-Linear Time Series Models , 2006 .

[21]  Rodrigo Sekkel,et al.  Model Confidence Sets and forecast combination , 2017 .

[22]  A.J. Conejo,et al.  Day-ahead electricity price forecasting using the wavelet transform and ARIMA models , 2005, IEEE Transactions on Power Systems.

[23]  H. Guirguis,et al.  Further Advances in Forecasting Day-Ahead Electricity Prices Using Time Series Models , 2004 .

[24]  Marcel Prokopczuk,et al.  The Case of Negative Day-Ahead Electricity Prices , 2011 .

[25]  Jenq-Neng Hwang,et al.  Committee Machines , 2017, Encyclopedia of Machine Learning and Data Mining.

[26]  L. Clewlow,et al.  Energy Derivatives: Pricing and Risk Management , 2000 .

[27]  M. Obersteiner,et al.  Forecasting electricity spot-prices using linear univariate time-series models , 2004 .

[28]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[29]  S. Rachev,et al.  Spot and Derivative Pricing in the EEX Power Market , 2007 .

[30]  Rafał Weron,et al.  Market price of risk implied by Asian-style electricity options , 2005 .

[31]  Zhao Yang Dong,et al.  Electricity market price spike forecasting and decision making , 2007 .

[32]  H. White,et al.  A Reality Check for Data Snooping , 2000 .

[33]  Cyriel de Jong The Nature of Power Spikes: a regime-switch approach , 2005 .

[34]  Jakub Nowotarski,et al.  An empirical comparison of alternate schemes for combining electricity spot price forecasts , 2013 .

[35]  Derek W. Bunn,et al.  Forecasting electricity prices: The impact of fundamentals and time-varying coefficients , 2008 .

[36]  Joanna Janczura,et al.  An empirical comparison of alternate regime-switching models or electricity spot prices , 2010 .

[37]  Peter Reinhard Hansen,et al.  The Model Confidence Set , 2010 .

[38]  Ling Tang,et al.  Electricity price forecasting with a BED (Bivariate EMD Denoising) methodology , 2015 .

[39]  R. Weron,et al.  Forecasting spot electricity prices: A comparison of parametric and semiparametric time series models , 2008 .

[40]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[41]  R. Weron Modeling and Forecasting Electricity Loads and Prices: A Statistical Approach , 2006 .

[42]  F. Diebold,et al.  Comparing Predictive Accuracy , 1994, Business Cycles.

[43]  Farshid Keynia,et al.  Electricity market price spike analysis by a hybrid data model and feature selection technique , 2010 .

[44]  Marcelo C. Medeiros,et al.  Real-time inflation forecasting with high-dimensional models: The case of Brazil , 2017 .

[45]  Jakub Nowotarski,et al.  On the importance of the long-term seasonal component in day-ahead electricity price forecasting , 2016, Energy Economics.

[46]  A. Timmermann Chapter 4 Forecast Combinations , 2006 .

[47]  Svetlana Borovkova,et al.  Modelling electricity prices by the potential jump-diffusion , 2006 .

[48]  Zhang Yang,et al.  Electricity price forecasting by a hybrid model, combining wavelet transform, ARMA and kernel-based extreme learning machine methods , 2017 .

[49]  Forecasting prices in the liberalized electricity market using the hybrid models , 2010, 2010 IEEE International Energy Conference.

[50]  Rafał Weron,et al.  On the importance of the long-term seasonal component in day-ahead electricity price forecasting with NARX neural networks , 2019, International Journal of Forecasting.

[51]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..