A Note on Online Change Point Detection

Online change point detection is originated in sequential analysis, which has been thoroughly studied for more than half century. A variety of methods and optimality results have been established over the years. In this paper, we are concerned with the univariate online change point detection problem allowing for all model parameters to change. We establish a theoretical framework to allow for more refined minimax results. This includes a phase transition phenomenon and a study of the detection delay under three forms of Type-I error controls. We also examine a common belief on the conservativeness of different Type-I error control strategies and provide results for potentially multiple change points scenarios.

[1]  Yudong Chen,et al.  High‐dimensional, multiscale online changepoint detection , 2020, Journal of the Royal Statistical Society: Series B (Statistical Methodology).

[2]  H. Dette,et al.  A new approach for open‐end sequential change point monitoring , 2019, Journal of Time Series Analysis.

[3]  Andrew Starr,et al.  Online change detection techniques in time series: An overview , 2019, 2019 IEEE International Conference on Prognostics and Health Management (ICPHM).

[4]  Michael Pecht,et al.  Prognostics and Health Management , 2013 .

[5]  Odalric-Ambrym Maillard,et al.  Sequential change-point detection: Laplace concentration of scan statistics and non-asymptotic delay bounds , 2019, ALT.

[6]  A. Rinaldo,et al.  Univariate mean change point detection: Penalization, CUSUM and optimality , 2018, Electronic Journal of Statistics.

[7]  Jon D. McAuliffe,et al.  Uniform, nonparametric, non-asymptotic confidence sequences , 2018 .

[8]  Xi He,et al.  Sequential Graph Scanning Statistic for Change-point Detection , 2018, 2018 52nd Asilomar Conference on Signals, Systems, and Computers.

[9]  Xiaodong Wang,et al.  Real-Time Nonparametric Anomaly Detection in High-Dimensional Settings , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  George Michailidis,et al.  Sequential change-point detection in high-dimensional Gaussian graphical models , 2018, J. Mach. Learn. Res..

[11]  Marie Husková,et al.  Bootstrap Procedures for Online Monitoring of Changes in Autoregressive Models , 2016, Commun. Stat. Simul. Comput..

[12]  Hao Chen,et al.  Sequential change-point detection based on nearest neighbors , 2016, The Annals of Statistics.

[13]  M. Basseville,et al.  Sequential Analysis: Hypothesis Testing and Changepoint Detection , 2014 .

[14]  Claudia Kirch,et al.  Bootstrapping sequential change-point tests for linear regression , 2012 .

[15]  Guangliang Chen,et al.  Kernel Spectral Curvature Clustering (KSCC) , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[16]  Matthew Reimherr,et al.  Delay times of sequential procedures for multiple time series regression models , 2009 .

[17]  Claudia Kirch,et al.  Bootstrapping Sequential Change-Point Tests , 2008 .

[18]  P. Fearnhead,et al.  On‐line inference for multiple changepoint problems , 2007 .

[19]  M. Davy,et al.  An online kernel change detection algorithm , 2005, IEEE Transactions on Signal Processing.

[20]  Alexander Aue,et al.  Delay time in sequential detection of change , 2004 .

[21]  Tze Leung Lai,et al.  Information Bounds and Quick Detection of Parameter Changes in Stochastic Systems , 1998, IEEE Trans. Inf. Theory.

[22]  T. Lai.  Sequential changepoint detection in quality control and dynamical systems , 1995 .

[23]  Y. Ritov.  Decision Theoretic Optimality of the Cusum Procedure , 1990 .

[24]  G. Moustakides.  Optimal stopping times for detecting changes in distributions , 1986 .

[25]  D. Siegmund.  Sequential Analysis: Tests and Confidence Intervals , 1985 .

[26]  T. Lai.  Asymptotic Optimality of Invariant Sequential Probability Ratio Tests , 1981 .

[27]  W. A. Wallis.  The Statistical Research Group, 1942–1945 , 1980 .

[28]  B. K. Ghosh,et al.  Sequential Tests of Statistical Hypotheses. , 1972 .

[29]  G. Lorden.  PROCEDURES FOR REACTING TO A CHANGE IN DISTRIBUTION , 1971 .

[30]  E. S. Page.  CONTINUOUS INSPECTION SCHEMES , 1954 .

[31]  A. Wald.  Sequential Tests of Statistical Hypotheses , 1945 .

[32]  H. Dette.  Online Supplement to: A likelihood ratio approach to sequential change point detection for a general class of parameters , 2019 .

[33]  Claudia Kirch,et al.  Modified sequential change point procedures based on estimating functions , 2018 .

[34]  Claudia Kirch,et al.  Fourier Methods for Sequential Change Point Analysis in Autoregressive Models , 2010, COMPSTAT.

[35]  Y. Mei.  Efficient scalable schemes for monitoring a large number of data streams , 2010 .

[36]  T. Lai.  SEQUENTIAL ANALYSIS: SOME CLASSICAL PROBLEMS AND NEW CHALLENGES , 2001 .

[37]  H. White,et al.  Monitoring Structural Change , 1996 .