Forecasting Energy Commodity Prices Using Neural Networks

A new machine learning approach for price modeling is proposed. The use of neural networks as an advanced signal processing tool may be successfully used to model and forecast energy commodity prices, such as crude oil, coal, natural gas, and electricity prices. Energy commodities have shown explosive growth in the last decade. They have become a new asset class used also for investment purposes. This creates a huge demand for better modeling as what occurred in the stock markets in the 1970s. Their price behavior presents unique features causing complex dynamics whose prediction is regarded as a challenging task. The use of a Mixture of Gaussian neural network may provide significant improvements with respect to other well-known models. We propose a computationally efficient learning of this neural network using the maximum likelihood estimation approach to calibrate the parameters. The optimal model is identified using a hierarchical constructive procedure that progressively increases the model complexity. Extensive computer simulations validate the proposed approach and provide an accurate description of commodities prices dynamics.

[1]  Á. Cartea,et al.  Pricing in Electricity Markets: A Mean Reverting Jump Diffusion Model with Seasonality , 2005 .

[2]  Simon Haykin,et al.  Making sense of a complex world , 1998 .

[3]  T. Bollerslev,et al.  Generalized autoregressive conditional heteroskedasticity , 1986 .

[4]  R. Donaldson,et al.  An artificial neural network-GARCH model for international stock return volatility , 1997 .

[5]  Heping Pan,et al.  Forecasting model for crude oil prices based on artificial neural networks , 2008, 2008 International Conference on Intelligent Sensors, Sensor Networks and Information Processing.

[6]  Lean Yu,et al.  A New Method for Crude Oil Price Forecasting Based on Support Vector Machines , 2006, International Conference on Computational Science.

[7]  P. Bühlmann,et al.  Volatility estimation with functional gradient descent for very high-dimensional financial time series , 2003 .

[8]  Raffaele Parisi,et al.  Source Localization in Reverberant Environments by Consistent Peak Selection , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[9]  Jonathan D. Cryer,et al.  Time Series Analysis , 1986 .

[10]  Robert M. Wharton Model-Free Curve Estimation , 1995 .

[11]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[12]  Massimo Panella,et al.  Advances in biological time series prediction by neural networks , 2011, Biomed. Signal Process. Control..

[13]  Anil K. Jain,et al.  Unsupervised Learning of Finite Mixture Models , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Sancho Salcedo-Sanz,et al.  Improving the prediction of average total ozone in column over the Iberian Peninsula using neural networks banks , 2011, Neurocomputing.

[15]  Massimo Panella A Hierarchical Procedure for the Synthesis of ANFIS Networks , 2012, Adv. Fuzzy Syst..

[16]  Massimo Panella,et al.  Neurofuzzy Networks With Nonlinear Quantum Learning , 2009, IEEE Transactions on Fuzzy Systems.

[17]  T. Dillon,et al.  Electricity price short-term forecasting using artificial neural networks , 1999 .

[18]  Donald B. Percival,et al.  Spectral Analysis for Physical Applications , 1993 .

[19]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[20]  Jia-Wei Zhang,et al.  Time Series Forecasting for Density of Wood Growth Ring using ARIMA and Neural Networks , 2007, 2007 International Conference on Machine Learning and Cybernetics.

[21]  Stephen L. Chiu,et al.  Fuzzy Model Identification Based on Cluster Estimation , 1994, J. Intell. Fuzzy Syst..

[22]  James D. Hamilton,et al.  Understanding Crude Oil Prices , 2008 .

[23]  Zita Marossy Commodities and Commodity Derivatives, Modeling and Pricing for Agriculturals, Metals and Energy, Helyette Geman, Wiley Finance (2005). 416 pages, ISBN: 978-0-470-01218-5 , 2007 .

[24]  Kyoung-jae Kim,et al.  Financial time series forecasting using support vector machines , 2003, Neurocomputing.

[25]  Antonello Rizzi,et al.  Refining accuracy of environmental data prediction by MoG neural networks , 2003, Neurocomputing.

[26]  R. Dase,et al.  Application of Artificial Neural Network for stock market predictions: A review of literature , 2010 .

[27]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .

[28]  Carlo Mari,et al.  Random movements of power prices in competitive markets: a hybrid model approach , 2008 .

[29]  Alan Pankratz,et al.  Forecasting with Dynamic Regression Models: Pankratz/Forecasting , 1991 .

[30]  N. Burgess,et al.  Modelling market volatilities: the neural network perspective , 1997 .

[31]  E. Mizutani,et al.  Neuro-Fuzzy and Soft Computing-A Computational Approach to Learning and Machine Intelligence [Book Review] , 1997, IEEE Transactions on Automatic Control.

[32]  Bernard Widrow,et al.  Neural nets for adaptive filtering and adaptive pattern recognition , 1988, Computer.

[33]  S. Haykin,et al.  Making sense of a complex world [chaotic events modeling] , 1998, IEEE Signal Process. Mag..

[34]  M. Panella,et al.  A Probabilistic PCA Clustering Approach to the SVD Estimate of Signal Subspaces , 2004, WIRN.

[35]  Siddhivinayak Kulkarni,et al.  Forecasting Model for Crude Oil Price Using Artificial Neural Networks and Commodity Futures Prices , 2009, ArXiv.

[36]  H. Geman Commodities and Commodity Derivatives: Modelling and Pricing for Agriculturals, Metals and Energy , 2005 .

[37]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[38]  Klaus Obermayer,et al.  Gaussian Process Regression: Active Data Selection and Test Point Rejection , 2000, DAGM-Symposium.

[39]  Massimo Panella,et al.  Neural Networks to Model Energy Commodity Price Dynamics , 2011 .

[40]  Ioannis Pitas,et al.  Median radial basis function neural network , 1996, IEEE Trans. Neural Networks.

[41]  Zhao Yang Dong,et al.  An adaptive neural-wavelet model for short term load forecasting , 2001 .

[42]  Radford M. Neal Monte Carlo Implementation of Gaussian Process Models for Bayesian Regression and Classification , 1997, physics/9701026.

[43]  Bart De Moor,et al.  The singular value decomposition and long and short spaces of noisy matrices , 1993, IEEE Trans. Signal Process..

[44]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[45]  Zoubin Ghahramani,et al.  Solving inverse problems using an EM approach to density estimation , 1993 .

[46]  R. Baillie,et al.  Prediction in dynamic models with time-dependent conditional variances , 1992 .

[47]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[48]  Henry D. I. Abarbanel,et al.  Analysis of Observed Chaotic Data , 1995 .

[49]  Leandro dos Santos Coelho,et al.  A RBF neural network model with GARCH errors: Application to electricity price forecasting , 2011 .

[50]  Massimo Panella,et al.  Neural networks with quantum architecture and quantum learning , 2011, Int. J. Circuit Theory Appl..

[51]  R. Engle Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation , 1982 .

[52]  Antonello Rizzi,et al.  A constructive EM approach to density estimation for learning , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[53]  Terence C. Mills,et al.  Time series techniques for economists , 1990 .

[54]  M. C. Jones,et al.  Model-Free Curve Estimation , 1993 .

[55]  Peter Tiño,et al.  Financial volatility trading using recurrent neural networks , 2001, IEEE Trans. Neural Networks.

[56]  T. Bollerslev,et al.  A CONDITIONALLY HETEROSKEDASTIC TIME SERIES MODEL FOR SPECULATIVE PRICES AND RATES OF RETURN , 1987 .

[57]  Giuseppe Acciani,et al.  A feature extraction unsupervised neural network for an environmental data set , 2003, Neural Networks.

[58]  Soushan Wu,et al.  Comparison of support-vector machines and back propagation neural networks in forecasting the six major Asian stock markets , 2006 .

[59]  Michael I. Jordan,et al.  On Convergence Properties of the EM Algorithm for Gaussian Mixtures , 1996, Neural Computation.

[60]  Chun-yu Jia,et al.  High Precision Prediction of Rolling Force Based on Fuzzy and Nerve Method for Cold Tandem Mill , 2008 .

[61]  A. Dhamija,et al.  Financial Time Series Forecasting : Comparison of Neural Networks and ARCH Models , 2010 .

[62]  José M. Matías,et al.  Boosting GARCH and neural networks for the prediction of heteroskedastic time series , 2010, Math. Comput. Model..

[63]  Eduardo S. Schwartz,et al.  Stochastic Convenience Yield and the Pricing of Oil Contingent Claims , 1990 .

[64]  Yu. N. Gusev,et al.  Calibration of Multifactor Models in Electricity Markets , 2003 .

[65]  Joseph E. Aldy,et al.  Issues in Designing U.S. Climate Change Policy , 2008 .

[66]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[67]  Francesco Barcellona,et al.  Subband prediction of energy commodity prices , 2012, 2012 IEEE 13th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[68]  David R. Cox,et al.  Time Series Analysis , 2012 .

[69]  Massimo Panella,et al.  The quantum approach leading from evolutionary to exhaustive optimization , 2012 .

[70]  Massimo Panella,et al.  Modeling Energy Markets Using Neural Networks and Spectral Analysis , 2012 .

[71]  E. Dockner,et al.  Forecasting Time-dependent Conditional Densities: A Semi-non- parametric Neural Network Approach , 2000 .

[72]  Andrew R. Barron,et al.  Mixture Density Estimation , 1999, NIPS.