Multiple Change Points Detection in Low Rank and Sparse High Dimensional Vector Autoregressive Models

Identifying change/break points in multivariate time series represents a canonical problem in signal processing, due to numerous applications related to anomaly detection problems. The underlying detection methodology heavily depends on the nature of the mechanism determining the temporal dynamics of the data. Vector auto-regressive models (VAR) constitute a widely used model in diverse areas, including surveillance applications, economics/finance and neuroscience. In this work, we consider piece-wise stationary VAR models exhibiting break points between the corresponding stationary segments, wherein the transition matrices that govern the model's temporal evolution are decomposed into a common low-rank component and time evolving sparse ones. Further, we assume that the number of available time points are smaller than the number of model parameters and hence we are operating in a high-dimensional regime. We develop a three-step strategy that accurately detects the number of change points together with their location and subsequently estimates the model parameters in each stationary segment. The effectiveness of the proposed procedure is illustrated on both synthetic and real data sets.

[1]  George Michailidis,et al.  Change point estimation in high dimensional Markov random‐field models , 2014, Journal of the Royal Statistical Society. Series B, Statistical methodology.

[2]  W. H. Deitenbeck Introduction to statistical process control. , 1995, Healthcare facilities management series.

[3]  A. Meucci Risk and asset allocation , 2005 .

[4]  C. Granger Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[5]  F F Nobre,et al.  A monitoring system to detect changes in public health surveillance data. , 1994, International journal of epidemiology.

[6]  C. Ing,et al.  Threshold Estimation via Group Orthogonal Greedy Algorithm , 2017 .

[7]  Le Song,et al.  Estimating time-varying networks , 2008, ISMB 2008.

[8]  E. Fama,et al.  A Five-Factor Asset Pricing Model , 2014 .

[9]  Pablo A. Parrilo,et al.  Rank-Sparsity Incoherence for Matrix Decomposition , 2009, SIAM J. Optim..

[10]  Piotr Fryzlewicz,et al.  Multiple‐change‐point detection for high dimensional time series via sparsified binary segmentation , 2015, 1611.08639.

[11]  C.W. Anderson,et al.  Multivariate autoregressive models for classification of spontaneous electroencephalographic signals during mental tasks , 1998, IEEE Transactions on Biomedical Engineering.

[12]  V. Liebscher,et al.  Consistencies and rates of convergence of jump-penalized least squares estimators , 2009, 0902.4838.

[13]  Korbinian Strimmer,et al.  Learning causal networks from systems biology time course data: an effective model selection procedure for the vector autoregressive process , 2007, BMC Bioinformatics.

[14]  G. Michailidis,et al.  Autoregressive models for gene regulatory network inference: sparsity, stability and causality issues. , 2013, Mathematical biosciences.

[15]  Yajun Mei,et al.  Large-Scale Multi-Stream Quickest Change Detection via Shrinkage Post-Change Estimation , 2015, IEEE Transactions on Information Theory.

[16]  Biing-Hwang Juang,et al.  Mixture autoregressive hidden Markov models for speech signals , 1985, IEEE Trans. Acoust. Speech Signal Process..

[17]  Jiaqi Ma,et al.  Short-Term Prediction of Signal Cycle on an Arterial With Actuated-Uncoordinated Control Using Sparse Time Series Models , 2019, IEEE Transactions on Intelligent Transportation Systems.

[18]  A. Rinaldo Properties and refinements of the fused lasso , 2008, 0805.0234.

[19]  Ali Shojaie,et al.  Joint Structural Break Detection and Parameter Estimation in High-Dimensional Nonstationary VAR Models , 2017, Journal of the American Statistical Association.

[20]  Alessandro Casini,et al.  Structural Breaks in Time Series , 2018, Oxford Research Encyclopedia of Economics and Finance.

[21]  George Michailidis,et al.  Regularized Estimation and Testing for High-Dimensional Multi-Block Vector-Autoregressive Models , 2017, J. Mach. Learn. Res..

[22]  H. Ombao,et al.  Detection of Changes in Multivariate Time Series With Application to EEG Data , 2015 .

[23]  Martin J. Wainwright,et al.  Noisy matrix decomposition via convex relaxation: Optimal rates in high dimensions , 2011, ICML.

[24]  G. Michailidis,et al.  Regularized estimation in sparse high-dimensional time series models , 2013, 1311.4175.

[25]  Haeran Cho,et al.  Change-point detection in panel data via double CUSUM statistic , 2016, 1611.08631.

[26]  Michèle Basseville,et al.  Detecting changes in signals and systems - A survey , 1988, Autom..

[27]  Z. Harchaoui,et al.  Multiple Change-Point Estimation With a Total Variation Penalty , 2010 .

[28]  Piotr Fryzlewicz,et al.  Simultaneous multiple change-point and factor analysis for high-dimensional time series , 2016, Journal of Econometrics.

[29]  Heiga Zen,et al.  Autoregressive Models for Statistical Parametric Speech Synthesis , 2013, IEEE Transactions on Audio, Speech, and Language Processing.

[30]  Cun-Hui Zhang,et al.  The sparsity and bias of the Lasso selection in high-dimensional linear regression , 2008, 0808.0967.

[31]  Jean-Philippe Vert,et al.  The group fused Lasso for multiple change-point detection , 2011, 1106.4199.

[32]  Martin J. Wainwright,et al.  A unified framework for high-dimensional analysis of $M$-estimators with decomposable regularizers , 2009, NIPS.

[33]  Manabu Honda,et al.  Statistical analysis for multiplicatively modulated nonlinear autoregressive model and its applications to electrophysiological signal analysis in humans , 2006, IEEE Transactions on Signal Processing.

[34]  N. Chan,et al.  Group LASSO for Structural Break Time Series , 2014 .

[35]  J. Bai,et al.  Estimation and Inference of Change Points in High Dimensional Factor Models , 2018 .

[36]  Chee-Ming Ting,et al.  Statistical models for brain signals with properties that evolve across trials , 2017, NeuroImage.

[37]  Yajun Mei,et al.  Quickest Change Detection and Kullback-Leibler Divergence for Two-State Hidden Markov Models , 2015, IEEE Transactions on Signal Processing.

[38]  J. Lewellen The Cross Section of Expected Stock Returns , 2014 .

[39]  George Michailidis,et al.  Low Rank and Structured Modeling of High-Dimensional Vector Autoregressions , 2018, IEEE Transactions on Signal Processing.

[40]  Peter Buhlmann,et al.  Computationally efficient change point detection for high-dimensional regression , 2016, 1601.03704.

[41]  Jutta Kretzberg,et al.  Single and Multiple Change Point Detection in Spike Trains: Comparison of Different CUSUM Methods , 2016, Front. Syst. Neurosci..

[42]  S. Johansen Estimation and Hypothesis Testing of Cointegration Vectors in Gaussian Vector Autoregressive Models , 1991 .

[43]  Christos Faloutsos,et al.  SNARE: a link analytic system for graph labeling and risk detection , 2009, KDD.