Change-Point Detection in Time-Series Data Based on Subspace Identification

In this paper, we propose series of algorithms for detecting change points in time-series data based on subspace identification, meaning a geometric approach for estimating linear state-space models behind time-series data. Our algorithms are derived from the principle that the subspace spanned by the columns of an observability matrix and the one spanned by the subsequences of time-series data are approximately equivalent. In this paper, we derive a batch-type algorithm applicable to ordinary time-series data, i.e. consisting of only output series, and then introduce the online version of the algorithm and the extension to be available with input-output time-series data. We illustrate the effectiveness of our algorithms with comparative experiments using some artificial and real datasets.

[1]  Fredrik Gustafsson,et al.  Adaptive filtering and change detection , 2000 .

[2]  Hisashi Kashima,et al.  Eigenspace-based anomaly detection in computer systems , 2004, KDD.

[3]  Kenji Yamanishi,et al.  A unifying framework for detecting outliers and change points from non-stationary time series data , 2002, KDD.

[4]  Tohru Katayama,et al.  Subspace Methods for System Identification , 2005 .

[5]  Kenji Yamanishi,et al.  A unifying framework for detecting outliers and change points from time series , 2006, IEEE Transactions on Knowledge and Data Engineering.

[6]  Giorgio Picci,et al.  Realization of stochastic systems with exogenous inputs and subspace identification methods , 1999, Autom..

[7]  Eamonn J. Keogh,et al.  Finding the most unusual time series subsequence: algorithms and applications , 2006, Knowledge and Information Systems.

[8]  Sameer Singh,et al.  Novelty detection: a review - part 2: : neural network based approaches , 2003, Signal Process..

[9]  Richard J. Martin.  A metric for ARMA processes , 2000, IEEE Trans. Signal Process..

[10]  M. Lovera,et al.  Recursive subspace identification based on instrumental variable unconstrained quadratic optimization , 2004 .

[11]  V. Moskvina,et al.  An Algorithm Based on Singular Spectrum Analysis for Change-Point Detection , 2003 .

[12]  Sameer Singh,et al.  Novelty detection: a review - part 1: statistical approaches , 2003, Signal Process..

[13]  Messaoud Benidir,et al.  The propagator method for source bearing estimation , 1995, Signal Process..

[14]  H. Akaike.  Markovian Representation of Stochastic Processes by Canonical Variables , 1975 .

[15]  Jessica Lin,et al.  HOT SAX: Finding the Most Unusual Time Series Subsequence: Algorithms and Applications , 2004 .

[16]  Michèle Basseville,et al.  Detection of Abrupt Changes: Theory and Applications. , 1995 .

[17]  Michèle Basseville,et al.  Detection of abrupt changes: theory and application , 1993 .

[18]  U. Desai,et al.  A realization approach to stochastic model reduction , 1985 .