Analysis of Multistate Autoregressive Models

In this paper, we consider the inference problem for a wide class of time-series models, referred to as multistate autoregressive models. The time series that we consider are composed of multiple epochs, each modeled by an autoregressive process. The number of epochs is unknown, and the transitions of states follow a Markov process of an unknown order. We propose an inference strategy that enables reliable and efficient offline analysis of this class of time series. The inference is carried out through a three-step approach: detecting the structural changes of the time series using a recently proposed multiwindow algorithm, identifying each segment as a state and selecting the most appropriate number of states, and estimating the Markov source based upon the symbolic sequence obtained from previous steps. We provide theoretical results and algorithms in order to facilitate the inference procedure described above. We demonstrate the accuracy, efficiency, and wide applicability of the proposed algorithms via an array of experiments using synthetic and real-world data.

[1]  Wolfgang Härdle,et al.  Localized Realized Volatility Modeling , 2010 .

[2]  Jeffrey D. Scargle,et al.  An algorithm for optimal partitioning of data on an interval , 2003, IEEE Signal Processing Letters.

[3]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[4]  R. Sutton,et al.  Atlantic Ocean Forcing of North American and European Summer Climate , 2005, Science.

[5]  Jie Ding,et al.  Data-driven learning of the number of states in multi-state autoregressive models , 2015, 2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[6]  Jie Ding,et al.  Bridging AIC and BIC: A New Criterion for Autoregression , 2015, IEEE Transactions on Information Theory.

[7]  James D. Hamilton Regime switching models , 2010 .

[8]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[9]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .

[10]  T. Cipra Statistical Analysis of Time Series , 2010 .

[11]  Jonathan D. Cryer,et al.  Time Series Analysis , 1986 .

[12]  Stability in an Era of Instability: Regime Changes in the Market Relationship Between Liquefied Petroleum Gases, Oil and Natural Gas , 2017 .

[13]  Michael I. Jordan,et al.  Bayesian Nonparametric Methods for Learning Markov Switching Processes , 2010, IEEE Signal Processing Magazine.

[14]  Sastry G. Pantula,et al.  A note on strong mixing of ARMA processes , 1986 .

[15]  E. Prescott,et al.  Postwar U.S. Business Cycles: An Empirical Investigation , 1997 .

[16]  P. Ciaian,et al.  The economics of BitCoin price formation , 2014, 1405.4498.

[17]  Maciej Niedzwiecki,et al.  Identification of Time-Varying Processes , 2000 .

[18]  H. Tong,et al.  Threshold Autoregression, Limit Cycles and Cyclical Data , 1980 .

[19]  Aeilko H. Zwinderman,et al.  Analysis of a sleep-dependent neuronal feedback loop: the slow-wave microcontinuity of the EEG , 2000, IEEE Transactions on Biomedical Engineering.

[20]  Neal O. Jeffries A note on 'Testing the number of components in a normal mixture' , 2003 .

[21]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[22]  P. Fearnhead,et al.  Optimal detection of changepoints with a linear computational cost , 2011, 1101.1438.

[23]  Maurice C. Aalders,et al.  Practical Implementation of Blood Stain Age Estimation Using Spectroscopy , 2016, IEEE Journal of Selected Topics in Quantum Electronics.

[24]  A. Wald Note on the Consistency of the Maximum Likelihood Estimate , 1949 .

[25]  Jie Ding,et al.  Multiple Change Point Analysis: Fast Implementation and Strong Consistency , 2016, IEEE Transactions on Signal Processing.

[26]  Hanan Naser,et al.  Estimating and forecasting the real prices of crude oil: A data rich model using a dynamic model averaging (DMA) approach , 2016 .

[27]  Petia Radeva,et al.  Personalization and user verification in wearable systems using biometric walking patterns , 2011, Personal and Ubiquitous Computing.

[28]  Philip Hans Franses,et al.  Periodic Time Series Models , 1996 .

[29]  A. V. Vecchia PERIODIC AUTOREGRESSIVE‐MOVING AVERAGE (PARMA) MODELING WITH APPLICATIONS TO WATER RESOURCES , 1985 .

[30]  C. Lawrence,et al.  Algorithms for the optimal identification of segment neighborhoods , 1989 .

[31]  Y. Shtarkov,et al.  Sequential Weighting Algorithms for Multi-Alphabet Sources ∗ , 1993 .

[32]  Water exchange traded funds: A study on idiosyncratic risk using Markov switching analysis , 2016 .

[33]  Mecit Cetin,et al.  Adaptive traffic parameter prediction: Effect of number of states and transferability of models , 2016 .

[34]  Yi-Ching Yao Estimation of a Noisy Discrete-Time Step Function: Bayes and Empirical Bayes Approaches , 1984 .

[35]  William T. Shaw,et al.  Correlation structure and dynamics in volatile markets , 2010 .

[36]  G. Koop,et al.  Forecasting In ation Using Dynamic Model Averaging , 2009 .

[37]  G. Lindgren Markov regime models for mixed distributions and switching regressions , 1978 .

[38]  Rowan Sutton,et al.  Climate Response to Basin-Scale Warming and Cooling of the North Atlantic Ocean , 2007 .

[39]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[40]  Dimitris Kugiumtzis,et al.  Dynamics of Epileptiform Discharges Induced by Transcranial Magnetic Stimulation in Genetic Generalized Epilepsy , 2017, Int. J. Neural Syst..

[41]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[42]  A. B. Poritz,et al.  Linear predictive hidden Markov models and the speech signal , 1982, ICASSP.

[43]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[44]  Stephen P. Boyd,et al.  Segmentation of ARX-models using sum-of-norms regularization , 2010, Autom..

[45]  Zaïd Harchaoui,et al.  Catching Change-points with Lasso , 2007, NIPS.

[46]  Michael I. Jordan,et al.  Bayesian Nonparametric Inference of Switching Dynamic Linear Models , 2010, IEEE Transactions on Signal Processing.

[47]  A. Assaf The Stochastic Volatility Model, Regime Switching and Value-at-Risk (VaR) in International Equity Markets , 2017 .

[48]  Richard A. Davis,et al.  Structural Break Estimation for Nonstationary Time Series Models , 2006 .

[49]  Y. Shtarkov,et al.  The context-tree weighting method: basic properties , 1995, IEEE Trans. Inf. Theory.

[50]  W. Li,et al.  On a mixture autoregressive model , 2000 .

[51]  Eyup Dogan,et al.  Analyzing the linkage between renewable and non-renewable energy consumption and economic growth by considering structural break in time-series data , 2016 .

[52]  Georgios B. Giannakis,et al.  Group lassoing change-points in piecewise-stationary AR signals , 2011, 2011 17th International Conference on Digital Signal Processing (DSP).

[53]  H. Akaike Statistical predictor identification , 1970 .

[54]  P. A. P. Moran,et al.  The statistical analysis of the Canadian Lynx cycle. , 1953 .

[55]  Laura Astolfi,et al.  Tracking the Time-Varying Cortical Connectivity Patterns by Adaptive Multivariate Estimators , 2008, IEEE Transactions on Biomedical Engineering.

[56]  Arnaud Dufays,et al.  Autoregressive Moving Average Infinite Hidden Markov-Switching Models , 2015 .

[57]  S. Goldfeld,et al.  A Markov model for switching regressions , 1973 .

[58]  A. Scott,et al.  A Cluster Analysis Method for Grouping Means in the Analysis of Variance , 1974 .

[59]  Prasad A. Naik,et al.  Extending the Akaike Information Criterion to Mixture Regression Models , 2007 .

[60]  Francis K. C. Hui,et al.  Order selection in finite mixture models: complete or observed likelihood information criteria? , 2015 .