Modeling and forecasting the electricity clearing price: A novel BELM based pattern classification framework and a comparative analytic study on multi-layer BELM and LSTM

With the deregulation of power market and the increasing penetration of renewable energy, the core role of demand side management (DSM) has become even more prominent. In this sense, there is an urgent need for all market participants to identify the pivotal aspects of electricity market price fluctuation effectively and anticipate its future trend. For certain applications such as DSM, considering the high volatility and nonlinear of real-time electricity price, we can approximate the interval prediction to achieve the multi-classification that relies on critical pattern recognition of entire category of the price sequence. Therefore, this paper presents a study on the utilization of a novel electricity price classification framework which consists of Bayesian extreme learning machine (BELM) model, minimum redundancy maximum relevance (MRMR) algorithm, and multivariate sequence segmentation (MSS). Considering many advantages of deep learning structure in capturing the hierarchical and sophisticated characteristics of multidimensional sequence, the multi-layer BELM (ML-BELM) model is also extended and utilized to the modeling. To demonstrate the potential of the pattern classification framework, the proposed approaches are evaluated using hourly clearing price cases from Canada Ontario and New York electricity market. In particular, we investigate the performance of different classifiers regarding the 3 multi-classification and higher dimensional classification modes with respect to various scenarios in terms of precision, recall, AUC (Area Under roc Curve) score, and F1-measure indicators. The findings suggest that the proposed pattern classification framework can obtain satisfactory forecasting results provided that suitable scheme is utilized to the pattern segmentation and feature ranking process.

[1]  Ilkay Oksuz,et al.  Electricity Price Forecasting Using Recurrent Neural Networks , 2018 .

[2]  Rafał Weron,et al.  Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks , 2018, 1805.06649.

[3]  Chi-Man Vong,et al.  Sparse Bayesian Extreme Learning Machine for Multi-classification , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Jianping Li,et al.  A deep learning ensemble approach for crude oil price forecasting , 2017 .

[5]  Florian Ziel,et al.  Variance Stabilizing Transformations for Electricity Spot Price Forecasting , 2018, IEEE Transactions on Power Systems.

[6]  Nees Jan van Eck,et al.  How to normalize cooccurrence data? An analysis of some well-known similarity measures , 2009, J. Assoc. Inf. Sci. Technol..

[7]  H Zareipour,et al.  Classification of Future Electricity Market Prices , 2011, IEEE Transactions on Power Systems.

[8]  Zijun Zhang,et al.  Short-Term Electricity Price Forecasting With Stacked Denoising Autoencoders , 2017, IEEE Transactions on Power Systems.

[9]  Dipankar Das,et al.  Enhanced SenticNet with Affective Labels for Concept-Based Opinion Mining , 2013, IEEE Intelligent Systems.

[10]  Hamidreza Zareipour,et al.  Data Mining for Electricity Price Classification and the Application to Demand-Side Management , 2012, IEEE Transactions on Smart Grid.

[11]  H. Madsen,et al.  Controlling Electricity Consumption by Forecasting its Response to Varying Prices , 2013, IEEE Transactions on Power Systems.

[12]  Chi-Man Vong,et al.  Sparse Bayesian extreme learning machine and its application to biofuel engine performance prediction , 2015, Neurocomputing.

[13]  P. Luh,et al.  Forecasting power market clearing price and its discrete PDF using a Bayesian-based classification method , 2001, 2001 IEEE Power Engineering Society Winter Meeting. Conference Proceedings (Cat. No.01CH37194).

[14]  Bijaya K. Panigrahi,et al.  Electricity price classification using extreme learning machines , 2013, Neural Computing and Applications.

[15]  J. Contreras,et al.  Forecasting next-day electricity prices by time series models , 2002 .

[16]  Bart De Schutter,et al.  Forecasting spot electricity prices Deep learning approaches and empirical comparison of traditional algorithms , 2018 .

[17]  Salim Lahmiri,et al.  Cryptocurrency forecasting with deep learning chaotic neural networks , 2019, Chaos, Solitons & Fractals.

[18]  János Abonyi,et al.  Correlation based dynamic time warping of multivariate time series , 2012, Expert Syst. Appl..

[19]  Stephen P. Boyd,et al.  Greedy Gaussian segmentation of multivariate time series , 2016, Advances in Data Analysis and Classification.

[20]  Nadeem Javaid,et al.  An Accurate and Fast Converging Short-Term Load Forecasting Model for Industrial Applications in a Smart Grid , 2017, IEEE Transactions on Industrial Informatics.

[21]  Jiuwen Cao,et al.  Kernel-Based Multilayer Extreme Learning Machines for Representation Learning , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Saeid Nahavandi,et al.  Quantifying uncertainties of neural network-based electricity price forecasts , 2013 .

[23]  C. Cañizares,et al.  Application of Public-Domain Market Information to Forecast Ontario's Wholesale Electricity Prices , 2006, IEEE Transactions on Power Systems.

[24]  Rafał Weron,et al.  On the importance of the long-term seasonal component in day-ahead electricity price forecasting , 2019, Energy Economics.

[25]  Armin Seibert,et al.  Bayesian estimation of stable CARMA spot models for electricity prices , 2019, Energy Economics.

[26]  Salim Lahmiri,et al.  Comparing Variational and Empirical Mode Decomposition in Forecasting Day-Ahead Energy Prices , 2017, IEEE Systems Journal.

[27]  Taher Niknam,et al.  Probabilistic Forecasting of Hourly Electricity Price by Generalization of ELM for Usage in Improved Wavelet Neural Network , 2017, IEEE Transactions on Industrial Informatics.

[28]  Carolina García-Martos,et al.  Modelling and forecasting fossil fuels, CO2 and electricity prices and their volatilities , 2013 .

[29]  Florentina Paraschiv,et al.  Econometric Analysis of 15-Minute Intraday Electricity Prices , 2016 .

[30]  Junhua Zhao,et al.  A Framework for Electricity Price Spike Analysis With Advanced Data Mining Methods , 2007, IEEE Transactions on Power Systems.

[31]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[32]  Jakub Nowotarski,et al.  Computing electricity spot price prediction intervals using quantile regression and forecast averaging , 2015, Comput. Stat..

[33]  Shanlin Yang,et al.  A review of the decomposition methodology for extracting and identifying the fluctuation characteristics in electricity demand forecasting , 2017 .

[34]  Xin Yao,et al.  MWMOTE--Majority Weighted Minority Oversampling Technique for Imbalanced Data Set Learning , 2014 .

[35]  T. Senjyu,et al.  A Novel Approach to Forecast Electricity Price for PJM Using Neural Network and Similar Days Method , 2007, IEEE Transactions on Power Systems.

[36]  Stephen A. Billings,et al.  A new maximum relevance-minimum multicollinearity (MRmMC) method for feature selection and ranking , 2017, Pattern Recognit..

[37]  Florentina Paraschiv,et al.  Extended forecast methods for day-ahead electricity spot prices applying artificial neural networks , 2016 .

[38]  Christian Igel,et al.  Evolutionary tuning of multiple SVM parameters , 2005, ESANN.

[39]  Antonio J. Serrano,et al.  BELM: Bayesian Extreme Learning Machine , 2011, IEEE Transactions on Neural Networks.

[40]  A.J. Conejo,et al.  Day-ahead electricity price forecasting using the wavelet transform and ARIMA models , 2005, IEEE Transactions on Power Systems.

[41]  Francisco Herrera,et al.  An overview of ensemble methods for binary classifiers in multi-class problems: Experimental study on one-vs-one and one-vs-all schemes , 2011, Pattern Recognit..

[42]  Timothy D. Mount,et al.  Predicting price spikes in electricity markets using a regime-switching model with time-varying parameters , 2006 .

[43]  Alessandra Cataldi,et al.  The Merit-Order Effect in the Italian Power Market: The Impact of Solar and Wind Generation on National Wholesale Electricity Prices , 2014 .

[44]  Kit Po Wong,et al.  Electricity Price Forecasting With Extreme Learning Machine and Bootstrapping , 2012, IEEE Transactions on Power Systems.

[45]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[46]  Guang-Bin Huang,et al.  Trends in extreme learning machines: A review , 2015, Neural Networks.

[47]  Thomas Fischer,et al.  Deep learning with long short-term memory networks for financial market predictions , 2017, Eur. J. Oper. Res..

[48]  Kit Po Wong,et al.  A Hybrid Approach for Probabilistic Forecasting of Electricity Price , 2014, IEEE Transactions on Smart Grid.

[49]  Geoff Holmes,et al.  Classifier Chains for Multi-label Classification , 2009, ECML/PKDD.

[50]  Mohammad Kazem Sheikh-El-Eslami,et al.  Price forecasting of day-ahead electricity markets using a hybrid forecast method , 2011 .

[51]  Jakub Nowotarski,et al.  On the importance of the long-term seasonal component in day-ahead electricity price forecasting , 2016, Energy Economics.

[52]  Yunhe Hou,et al.  A New Recursive Dynamic Factor Analysis for Point and Interval Forecast of Electricity Price , 2013, IEEE Transactions on Power Systems.

[53]  N. Amjady,et al.  Day-Ahead Price Forecasting of Electricity Markets by Mutual Information Technique and Cascaded Neuro-Evolutionary Algorithm , 2009, IEEE Transactions on Power Systems.

[54]  Andrew P. Bradley,et al.  The use of the area under the ROC curve in the evaluation of machine learning algorithms , 1997, Pattern Recognit..

[55]  N. Kumarappan,et al.  A neural network approach to day-ahead deregulated electricity market prices classification , 2012 .

[56]  Grzegorz Marcjasz,et al.  A Note on Averaging Day-Ahead Electricity Price Forecasts Across Calibration Windows , 2019, IEEE Transactions on Sustainable Energy.

[57]  J. Contreras,et al.  Forecasting electricity prices for a day-ahead pool-based electric energy market , 2005 .

[58]  Ioannis P. Panapakidis,et al.  Day-ahead electricity price forecasting via the application of artificial neural network based models , 2016 .

[59]  Shanlin Yang,et al.  A new electricity price prediction strategy using mutual information-based SVM-RFE classification , 2017 .

[60]  P. Gaillard,et al.  Additive models and robust aggregation for GEFCom2014 probabilistic electric load and electricity price forecasting , 2016 .

[61]  R. Weron Modeling and Forecasting Electricity Loads and Prices: A Statistical Approach , 2006 .

[62]  Florian Ziel,et al.  Probabilistic mid- and long-term electricity price forecasting , 2017, Renewable and Sustainable Energy Reviews.