Dynamic clustering of energy markets: An extended hidden Markov approach

This paper studies the synchronization of energy markets using an extended hidden Markov model that captures between- and within-heterogeneity in time series by defining clusters and hidden states, respectively. The model is applied to U.S. data in the period from 1999 to 2012. While oil and natural gas returns are well portrayed by two volatility states, electricity markets need three additional states: two transitory and one to capture a period of abnormally high volatility. Although some states are common to both clusters, results favor the segmentation of energy markets as they are not in the same state at the same time.

[1]  Huajing Fang,et al.  Increasing mapping based hidden Markov model for dynamic process monitoring and diagnosis , 2014, Expert Syst. Appl..

[2]  Donghua Zhou,et al.  A model for real-time failure prognosis based on hidden Markov model and belief rule base , 2010, Eur. J. Oper. Res..

[3]  Sebastian Edwards,et al.  Stock Market Cycles, Financial Liberalization and Volatility , 2003 .

[4]  Wai Mun Fong,et al.  A Markov switching model of the conditional volatility of crude oil futures prices , 2002 .

[5]  Yassine Ruichek,et al.  A novel evidence based model for detecting dangerous situations in level crossing environments , 2014, Expert Syst. Appl..

[6]  Chung-Chian Hsu,et al.  Pattern recognition in time series database: A case study on financial database , 2007, Expert Syst. Appl..

[7]  Felipe Trujillo-Romero,et al.  Evolutionary approach for integration of multiple pronunciation patterns for enhancement of dysarthric speech recognition , 2014, Expert Syst. Appl..

[8]  Reza Yaesoubi,et al.  Generalized Markov models of infectious disease spread: A novel framework for developing dynamic health policies , 2011, Eur. J. Oper. Res..

[9]  José G. Dias,et al.  An empirical comparison of EM, SEM and MCMC performance for problematic Gaussian mixture likelihoods , 2004, Stat. Comput..

[10]  R. Huisman,et al.  Regime Jumps in Electricity Prices , 2001 .

[11]  S. Rachev,et al.  Spot and Derivative Pricing in the EEX Power Market , 2007 .

[12]  José G. Dias,et al.  When markets fall down: are emerging markets all equal? , 2008 .

[13]  R. Bhushan Gopaluni,et al.  Adaptive signal processing of asset price dynamics with predictability analysis , 2008, Inf. Sci..

[14]  David A. Bessler,et al.  Market integration among electricity markets and their major fuel source markets , 2009 .

[15]  José G. Dias,et al.  Mining categorical sequences from data using a hybrid clustering method , 2014, Eur. J. Oper. Res..

[16]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[17]  José G. Dias,et al.  When Markets Fall Down: Are Emerging Markets All the Same? , 2010 .

[18]  Marie-Anne Guerry,et al.  Hidden heterogeneity in manpower systems: A Markov-switching model approach , 2011, Eur. J. Oper. Res..

[19]  José G. Dias,et al.  Latent class modeling of website users’ search patterns: Implications for online market segmentation , 2007 .

[20]  Paresh Date,et al.  Filtering and forecasting commodity futures prices under an HMM framework , 2013 .

[21]  José G. Dias,et al.  Mixture Hidden Markov Models in Finance Research , 2008, GfKl.

[22]  S. Palanivel,et al.  Lip reading of hearing impaired persons using HMM , 2011, Expert Syst. Appl..

[23]  Hong Zhang,et al.  An autonomous and intelligent expert system for residential water end-use classification , 2014, Expert Syst. Appl..

[24]  R. Pindyck.  Irreversibility, Uncertainty, and Investment , 1990 .

[25]  H. Bessembinder,et al.  Equilibrium Pricing and Optimal Hedging in Electricity Forward Markets , 2002 .

[26]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[27]  R. Mantegna.  Hierarchical structure in financial markets , 1998, cond-mat/9802256.

[28]  Hamid Hassanpour,et al.  Using Hidden Markov Models for paper currency recognition , 2009, Expert Syst. Appl..

[29]  The cyclical behavior of monthly NYMEX energy prices , 1998 .

[30]  Jiaqi Liu,et al.  A novel clustering method on time series data , 2011, Expert Syst. Appl..

[31]  Jorge Caiado,et al.  Clustering financial time series with variance ratio statistics , 2014 .

[32]  María Lourdes Borrajo Diz,et al.  An HMM-based over-sampling technique to improve text classification , 2013, Expert Syst. Appl..

[33]  James D. Hamilton.  A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle , 1989 .

[34]  Robert J. Elliott,et al.  A Double HMM approach to Altman Z-scores and credit ratings , 2014, Expert Syst. Appl..

[35]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[36]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[37]  José G. Dias,et al.  The aftermath of the subprime crisis: a clustering analysis of world banking sector , 2014 .

[38]  A. Petkau,et al.  Application of hidden Markov models to multiple sclerosis lesion count data , 2005, Statistics in medicine.

[39]  Luis González Abril,et al.  Trip destination prediction based on past GPS log using a Hidden Markov Model , 2010, Expert Syst. Appl..

[40]  Jan Bulla,et al.  Hidden Markov models with t components. Increased persistence and other aspects , 2011 .

[41]  I. Csiszár,et al.  The consistency of the BIC Markov order estimator , 2000 .

[42]  Joanna Janczura,et al.  An empirical comparison of alternate regime-switching models or electricity spot prices , 2010 .