Price spike forecasting in a competitive day-ahead energy market

Sergey Voronin Price spike forecasting in a competitive day-ahead energy market Lappeenranta 2013 177 pages Acta Universitatis Lappeenrantaensis 530 Diss. Lappeenranta University of Technology ISBN 978-952-265-461-8, ISBN 978-952-265-462-5 (PDF), ISSN-L 1456-4491, ISSN 1456-4491 Electricity price forecasting has become an important area of research in the aftermath of the worldwide deregulation of the power industry that launched competitive electricity markets now embracing all market participants including generation and retail companies, transmission network providers, and market managers. Based on the needs of the market, a variety of approaches forecasting day-ahead electricity prices have been proposed over the last decades. However, most of the existing approaches are reasonably effective for normal range prices but disregard price spike events, which are caused by a number of complex factors and occur during periods of market stress. In the early research, price spikes were truncated before application of the forecasting model to reduce the influence of such observations on the estimation of the model parameters; otherwise, a very large forecast error would be generated on price spike occasions. Electricity price spikes, however, are significant for energy market participants to stay competitive in a market. Accurate price spike forecasting is important for generation companies to strategically bid into the market and to optimally manage their assets; for retailer companies, since they cannot pass the spikes onto final customers, and finally, for market managers to provide better management and planning for the energy market. This doctoral thesis aims at deriving a methodology able to accurately predict not only the day-ahead electricity prices within the normal range but also the price spikes. The Finnish day-ahead energy market of Nord Pool Spot is selected as the case market, and its structure is studied in detail. It is almost universally agreed in the forecasting literature that no single method is best in every situation. Since the real-world problems are often complex in nature, no single model is able to capture different patterns equally well. Therefore, a hybrid methodology that enhances the modeling capabilities appears to be a possibly productive strategy for practical use when electricity prices are predicted. The price forecasting methodology is proposed through a hybrid model applied to the price forecasting in the Finnish day-ahead energy market. The iterative search procedure employed within the methodology is developed to tune the model parameters and select the optimal input set of the explanatory variables. The numerical studies show that the proposed methodology has more accurate behavior than all other examined methods most recently applied to case studies of energy markets in different countries. The obtained results can be considered as providing extensive and useful information for participants of the day-ahead energy market, who have limited and uncertain information for price prediction to set up an optimal short-term operation portfolio. Although the focus of this work is primarily on the Finnish price area of Nord Pool Spot, given the result of this work, it is very likely that the same methodology will give good results when forecasting the prices on energy markets of other countries.

[1]  Nowrouz Kohzadi,et al.  A comparison of artificial neural network and time series models for forecasting commodity prices , 1996, Neurocomputing.

[2]  C. Granger Non-Linear Models: Where Do We Go Next - Time Varying Parameter Models? , 2008 .

[3]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[4]  J. Contreras,et al.  ARIMA Models to Predict Next-Day Electricity Prices , 2002, IEEE Power Engineering Review.

[5]  Fausto Cavallaro Electric load analysis using an artificial neural network , 2005 .

[6]  Youyi Wang,et al.  Comparisons of Machine Learning Methods for Electricity Regional Reference Price Forecasting , 2009, ISNN.

[7]  T. Dillon,et al.  Electricity price short-term forecasting using artificial neural networks , 1999 .

[8]  Norman R. Swanson,et al.  A Model Selection Approach to Real-Time Macroeconomic Forecasting Using Linear Models and Artificial Neural Networks , 1997, Review of Economics and Statistics.

[9]  J. Contreras,et al.  Forecasting Next-Day Electricity Prices by Time Series Models , 2002, IEEE Power Engineering Review.

[10]  Kati Järvi,et al.  Ecosystem architecture design: endogenous and exogenous structural properties , 2013 .

[11]  øöö Blockinøø Well-Trained PETs : Improving Probability Estimation , 2000 .

[12]  Huan Liu,et al.  Efficient Feature Selection via Analysis of Relevance and Redundancy , 2004, J. Mach. Learn. Res..

[13]  Z. Tan,et al.  Day-ahead electricity price forecasting using wavelet transform combined with ARIMA and GARCH models , 2010 .

[14]  J. Vauterin The demand for global student talent: Capitalizing on the value of university-industry collaboration , 2012 .

[15]  Guoqiang Peter Zhang,et al.  Neural network forecasting for seasonal and trend time series , 2005, Eur. J. Oper. Res..

[16]  K. Bhattacharya,et al.  Economic Impact of Electricity Market Price Forecasting Errors: A Demand-Side Analysis , 2010, IEEE Transactions on Power Systems.

[17]  Jarmo Partanen,et al.  Forecasting electricity price and demand using a hybrid approach based on wavelet transform, ARIMA and neural networks , 2014 .

[18]  Vladimir Vapnik,et al.  The Nature of Statistical Learning , 1995 .

[19]  D. Goldstein Second Edition, Revised and Expanded , 2003 .

[20]  Muhammad Naeem A comparison of electricity spot prices simulation using ARMA-GARCH and mean-reverting models , 2010 .

[21]  J. Contreras,et al.  Forecasting electricity prices for a day-ahead pool-based electric energy market , 2005 .

[22]  D. Williams STOCHASTIC DIFFERENTIAL EQUATIONS: THEORY AND APPLICATIONS , 1976 .

[23]  T. Ouarda,et al.  Generalized autoregressive conditional heteroscedasticity modelling of hydrologic time series , 2012 .

[24]  M. Shahidehpour,et al.  A Hybrid Model for Day-Ahead Price Forecasting , 2010, IEEE Transactions on Power Systems.

[25]  Eero Jäppinen,et al.  The effects of location, feedstock availability, and supply-chain logistics on the greenhouse gas emissions of forest-biomass energy utilization in Finland , 2013 .

[26]  Heidi Piili,et al.  Characterisation of Laser Beam and Paper Material Interaction , 2013 .

[27]  T. Asano,et al.  ENTROPY , RELATIVE ENTROPY , AND MUTUAL INFORMATION , 2008 .

[28]  Subhes C. Bhattacharyya,et al.  Short‐term electric load forecasting using an artificial neural network: case of Northern Vietnam , 2004 .

[29]  T. Senjyu,et al.  A Novel Approach to Forecast Electricity Price for PJM Using Neural Network and Similar Days Method , 2007, IEEE Transactions on Power Systems.

[30]  G. Burt,et al.  Bidding behaviour and electricity market simulation , 2005, 2004 International Conference on Probabilistic Methods Applied to Power Systems.

[31]  A. Kazemi,et al.  Day-ahead price forecasting in restructured power systems using artificial neural networks , 2008 .

[32]  Mika Sillanpää,et al.  Electrooxidation treatment of pulp and paper mill circulating waters and wastewaters , 2013 .

[33]  Hiroyuki Mori,et al.  Data mining of electricity price forecasting with regression tree and normalized radial basis function network , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[34]  C. Rodriguez,et al.  Energy price forecasting in the Ontario competitive power system market , 2004, IEEE Transactions on Power Systems.

[35]  Larry A. Rendell,et al.  The Feature Selection Problem: Traditional Methods and a New Algorithm , 1992, AAAI.

[36]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Jinxiang Zhu,et al.  Forecasting energy prices in a competitive market , 1999 .

[38]  Alexander Smirnov,et al.  AMB system for high-speed motors using automatic commissioning , 2012 .

[39]  T. Senjyu,et al.  Neural networks approach to forecast several hour ahead electricity prices and loads in deregulated market , 2006 .

[40]  Srujal Shah,et al.  Analysis and validation of space averaged drag model for numerical simulations of gas-solid flows in fluidized beds , 2012 .

[41]  Sergios Theodoridis,et al.  Pattern Recognition & Matlab Intro , 2010 .

[42]  Paula Immonen,et al.  Energy Efficiency of a Diesel-Electric MobileWorking Machine , 2013 .

[43]  Michael E. Tipping Sparse Bayesian Learning and the Relevance Vector Machine , 2001, J. Mach. Learn. Res..

[44]  R. Engle Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation , 1982 .

[45]  Henry Hämäläinen,et al.  Identification of Some Additional Loss Components in High-Power Low-Voltage Permanent Magnet Generators , 2013 .

[46]  Agnaldo J. R. Reis,et al.  Feature extraction via multiresolution analysis for short-term load forecasting , 2005, IEEE Transactions on Power Systems.

[47]  Eduardo S. Schwartz,et al.  Electricity Prices and Power Derivatives: Evidence from the Nordic Power Exchange , 2000 .

[48]  Hannu Olkkonen,et al.  Discrete Wavelet Transforms - Biomedical Applications , 2011 .

[49]  Roberto Battiti,et al.  Using mutual information for selecting features in supervised neural net learning , 1994, IEEE Trans. Neural Networks.

[50]  G. E. Nasr,et al.  Neural networks in forecasting electrical energy consumption: univariate and multivariate approaches , 2002 .

[51]  Nima Amjady,et al.  Day‐ahead price forecasting of electricity markets by a hybrid intelligent system , 2009 .

[52]  S. A. Khaparde,et al.  Modelling volatility clustering in electricity price return series for forecasting value at risk , 2009 .

[53]  D. F. Specht,et al.  Probabilistic neural networks for classification, mapping, or associative memory , 1988, IEEE 1988 International Conference on Neural Networks.

[54]  J. Friedman,et al.  Classification and Regression Trees (Wadsworth Statistics/Probability) , 1984 .

[55]  I. Maqsood,et al.  Random Forests and Decision Trees , 2012 .

[56]  Sylvain Arlot,et al.  A survey of cross-validation procedures for model selection , 2009, 0907.4728.

[57]  Polina Belova,et al.  Quasiclassical Approach to the Vortex State in Iron-based Superconductors , 2012 .

[58]  Eduardo S. Schwartz,et al.  Stochastic Convenience Yield and the Pricing of Oil Contingent Claims , 1990 .

[59]  Jarmo Partanen,et al.  A hybrid electricity price forecasting model for the Nordic electricity spot market , 2014 .

[60]  Igor Kononenko,et al.  Estimating Attributes: Analysis and Extensions of RELIEF , 1994, ECML.

[61]  William Remus,et al.  Time series forecasting using neural networks: should the data be deseasonalized first? , 1999 .

[62]  G. Hirsch Pricing of hourly exercisable electricity swing options using different price processes , 2009 .

[63]  A. Conejo,et al.  A Stochastic Programming Approach to Electric Energy Procurement for Large Consumers , 2007, IEEE Transactions on Power Systems.

[64]  Kristiina Söderholm Licensing Model Development for Small Modular Reactors (SMRs) - Focusing on the Finnish Regulatory Framework , 2013 .

[65]  Junhua Zhao,et al.  A Framework for Electricity Price Spike Analysis With Advanced Data Mining Methods , 2007, IEEE Transactions on Power Systems.

[66]  Zuyi Li,et al.  Adaptive short-term electricity price forecasting using artificial neural networks in the restructured power markets , 2004 .

[67]  Paulo F. Ribeiro,et al.  Exploring the power of wavelet analysis , 1996 .

[68]  Carlos E. Pedreira,et al.  Neural networks for short-term load forecasting: a review and evaluation , 2001 .

[69]  Feng Qiu Surface transformation hardening of carbon steel with high power fiber laser , 2013 .

[70]  Bhojnarine R. Rambharat,et al.  A threshold autoregressive model for wholesale electricity prices , 2003 .

[71]  Guoqiang Peter Zhang,et al.  Time series forecasting using a hybrid ARIMA and neural network model , 2003, Neurocomputing.

[72]  Dogan Keles,et al.  Comparison of extended mean-reversion and time series models for electricity spot price simulation considering negative prices , 2012 .

[73]  D. L. Pepyne,et al.  Gaming and Price Spikes in Electric Power Markets , 2001, IEEE Power Engineering Review.

[74]  P. Mazur On the theory of brownian motion , 1959 .

[75]  Andrey Maglyas,et al.  Overcoming the Complexity of Software Product Management , 2013 .

[76]  B. Ramsay,et al.  A neural network based estimator for electricity spot-pricing with particular reference to weekend and public holidays , 1998, Neurocomputing.

[77]  N. Amjady Day-ahead price forecasting of electricity markets by a new fuzzy neural network , 2006, IEEE Transactions on Power Systems.

[78]  Ivan Zakharchuk Manifestation of the pairing symmetry in the vortex core structure in iron-based superconductors , 2013 .

[79]  Li Bo,et al.  Price Forecasting Based on PSO Train BP Neural Network , 2009, 2009 Asia-Pacific Power and Energy Engineering Conference.

[80]  Iiro Hietanen Design and characterization of large area position sensitive radiation detectors , 2012 .

[81]  Fang-Mei Tseng,et al.  Combining neural network model with seasonal time series ARIMA model , 2002 .

[82]  Marko Robnik-Sikonja,et al.  Theoretical and Empirical Analysis of ReliefF and RReliefF , 2003, Machine Learning.

[83]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[84]  Alexander Maximov,et al.  Theoretical Analysis and Numerical Simulation of Spectral Radiative Properties of Combustion Gases in Oxy/Air-Fired Combustion Systems , 2012 .

[85]  Marco van Akkeren,et al.  A GARCH forecasting model to predict day-ahead electricity prices , 2005, IEEE Transactions on Power Systems.

[86]  Javad Sadeh,et al.  A risk-based approach for bidding strategy in an electricity pay-as-bid auction , 2009 .

[87]  Tuomas Rantalainen Simulation of structural stress history based on dynamic analysis , 2012 .

[88]  H. M. I. Pousinho,et al.  An Artificial Neural Network Approach for Short-Term Wind Power Forecasting in Portugal , 2009, 2009 15th International Conference on Intelligent System Applications to Power Systems.

[89]  Hamidreza Zareipour,et al.  Data Mining for Electricity Price Classification and the Application to Demand-Side Management , 2012, IEEE Transactions on Smart Grid.

[90]  Alicia Troncoso Lora,et al.  A Comparison of Two Techniques for Next-Day Electricity Price Forecasting , 2002, IDEAL.

[91]  Riina Salmimies Acidic dissolution of iron oxides and regeneration of a ceramic filter medium , 2012 .

[92]  Á. Cartea,et al.  Pricing in Electricity Markets: A Mean Reverting Jump Diffusion Model with Seasonality , 2005 .

[93]  Xing Yan,et al.  Electricity market clearing price forecasting in a deregulated electricity market , 2010, 2010 IEEE 11th International Conference on Probabilistic Methods Applied to Power Systems.

[94]  V. Mendes,et al.  Short-term electricity prices forecasting in a competitive market: A neural network approach , 2007 .

[95]  Harri Ryynänen,et al.  From network pictures to network insight in solution business – the role of internal communication , 2013 .

[96]  Juha Soininen Entrepreneurial orientation in small and medium-sized enterprises during economic crisis , 2013 .

[97]  K. Purchala,et al.  Classification of electricity market models worldwide , 2005, International Symposium CIGRE/IEEE PES, 2005..

[98]  Adeline Peter Mtunya MODELLING ELECTRICITY SPOT PRICE TIME SERIES USING COLOURED NOISE FORCES , 2010 .

[99]  H Lee Willis,et al.  Spatial electric load forecasting , 1996 .

[100]  Tuomo Kauranne,et al.  The multiple-mean-reversion jump-diffusion model for Nordic electricity spot prices , 2011 .

[101]  Sami Moisio,et al.  A Soft Contact Collision Method For Real-Time Simulation of Triangularized Geometries in Multibody Dynamics , 2013 .

[102]  Mohammad Kazem Sheikh-El-Eslami,et al.  Price forecasting of day-ahead electricity markets using a hybrid forecast method , 2011 .

[103]  G. Uhlenbeck,et al.  On the Theory of the Brownian Motion , 1930 .

[104]  Dominik Möst,et al.  A survey of stochastic modelling approaches for liberalised electricity markets , 2010, Eur. J. Oper. Res..

[105]  Farshid Keynia,et al.  Day ahead price forecasting of electricity markets by a mixed data model and hybrid forecast method , 2008 .

[106]  A. Papalexopoulos,et al.  Forecasting power market clearing price and quantity using a neural network method , 2000, 2000 Power Engineering Society Summer Meeting (Cat. No.00CH37134).

[107]  Christian Osendorfer,et al.  Sequential Feature Selection for Classification , 2011, Australasian Conference on Artificial Intelligence.

[108]  Mikko Paananen On Innovative Search: the use of internal and external sources of innovation among Finnish innovators , 2012 .

[109]  P. McSharry,et al.  A comparison of univariate methods for forecasting electricity demand up to a day ahead , 2006 .

[110]  Tomi Riipinen Modeling and Control of the Power Conversion Unit in a Solid Oxide Fuel Cell Environment , 2012 .

[111]  Markku Pirinen The effects of welding heat input on the usability of high strength steels in welded structures , 2013 .

[112]  Juhani Kuronen Jatkuvan äänitehojakautuman algoritmi pitkien käytävien äänikenttien mallintamiseen , 2013 .

[113]  Su-Shing Chen,et al.  Cancer classification: Mutual information, target network and strategies of therapy , 2012, Journal of Clinical Bioinformatics.

[114]  Terry Robinson Electricity pool prices: a case study in nonlinear time-series modelling , 2000 .

[115]  R. Weron Modeling and Forecasting Electricity Loads and Prices: A Statistical Approach , 2006 .

[116]  Farshid Keynia,et al.  Electricity market price spike analysis by a hybrid data model and feature selection technique , 2010 .

[117]  Mika Ikonen,et al.  Power cycling lifetime estimation of IGBT power modules based on chip temperature modeling , 2012 .

[118]  Ralf Becker,et al.  Modeling Spikes in Electricity Prices , 2007 .

[119]  Anne Pässilä,et al.  Reflexive model of research-based theatre – processing innovation at the crossroads of theatre, reflection and practice-based innovation activities , 2012 .

[120]  Vesa Väisänen,et al.  Performance and scalability of isolated DC-DC converter topologies in low voltage, high current applications , 2012 .

[121]  Elena Fedorova Interdependence of Emerging Eastern European stock markets , 2013 .

[122]  Z. Dong,et al.  Electricity market price spike forecast with data mining techniques , 2005 .

[123]  M. Sarkkinen STRATEGIC INNOVATION MANAGEMENT BASED ON THREE DIMENSIONS , 2013 .

[124]  Jani Heikkinen Virtual technology and haptic interface solutions for design and control of mobile working machines , 2013 .

[125]  S. Viljainen,et al.  The impact of emissions trading on electricity spot market price behavior , 2012 .

[126]  Zuyi Li,et al.  Risk-Constrained Bidding Strategy With Stochastic Unit Commitment , 2007, IEEE Transactions on Power Systems.

[127]  Leena Eloranta Innovation in a Non-Formal Adult Education Organisation – Multi-Case Study in Four Adult Education Centres , 2013 .

[128]  Zhao Yang Dong,et al.  Electricity market price spike forecasting and decision making , 2007 .

[129]  Ying Chen,et al.  Short-Term Load Forecasting: Similar Day-Based Wavelet Neural Networks , 2010, IEEE Transactions on Power Systems.

[130]  Jianguo Zhao,et al.  Application of relevance vector regression model based on sparse bayesian learning to long-term electricity demand forecasting , 2009, 2009 International Conference on Mechatronics and Automation.

[131]  A. Gjelsvik,et al.  Generation scheduling in a deregulated system. The Norwegian case , 1999 .

[132]  Chong-Ho Choi,et al.  Input feature selection for classification problems , 2002, IEEE Trans. Neural Networks.

[133]  Gwo-Ching Liao A Novel Particle Swarm Optimization Approach Combined with Fuzzy Neural Networks for Short-Term Load Forecasting , 2007, 2007 IEEE Power Engineering Society General Meeting.

[134]  Marja-Leena Kääriäinen Atomic layer deposited titanium and zinc oxides; structure and doping effects on their photoactivity, photocatalytic activity and bioactivity , 2013 .

[135]  F. Wolak Market Design and Price Behavior in Restructured Electricity Markets: An International Comparison , 2000 .

[136]  Sari Monto,et al.  Towards Inter-organizational Working Capital Management , 2013 .

[137]  Ashwani Kumar,et al.  Electricity price forecasting in deregulated markets: A review and evaluation , 2009 .

[138]  M. Barlow A DIFFUSION MODEL FOR ELECTRICITY PRICES , 2002 .

[139]  Rafal Weron,et al.  Modeling Electricity Prices with Regime Switching Models , 2004, International Conference on Computational Science.

[140]  A.J. Conejo,et al.  Day-ahead electricity price forecasting using the wavelet transform and ARIMA models , 2005, IEEE Transactions on Power Systems.

[141]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[142]  Antero Kutvonen Strategic external deployment of intellectual assets , 2012 .

[143]  Analysis of outliers in electricity spot prices with exampleof New England and New Zealand markets , 2008 .

[144]  Pavlos S. Georgilakis,et al.  Market Clearing Price Forecasting in Deregulated Electricity Markets Using Adaptively Trained Neural Networks , 2006, SETN.

[145]  A. Conejo,et al.  Multimarket optimal bidding for a power producer , 2005, IEEE Transactions on Power Systems.

[146]  Milla Laisi,et al.  Deregulation’s Impact on the Railway Freight Transport Sector’s Future in the Baltic Sea Region , 2013 .

[147]  Zhou Quan,et al.  RBF Neural Network and ANFIS-Based Short-Term Load Forecasting Approach in Real-Time Price Environment , 2008, IEEE Transactions on Power Systems.

[148]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[149]  Yong Fu,et al.  Different models and properties on LMP calculations , 2006, 2006 IEEE Power Engineering Society General Meeting.

[150]  Timo Leivo Pricing anomalies in the Finnish stock market , 2012 .