Sequential Change-Point Detection Procedures That are Nearly Optimal and Computationally Simple

Abstract Sequential schemes for detecting a change in distribution often require that all of the observations be stored in memory. Lai (1995, Journal of Royal Statistical Society, Series B 57: 613–658) proposed a class of detection schemes that enable one to retain a finite window of the most recent observations, yet promise first-order optimality. The asymptotics are such that the window size is asymptotically unbounded. We argue that what's of computational importance isn't having a finite window of observations, but rather making do with a finite number of registers. We illustrate in the context of detecting a change in the parameter of an exponential family that one can achieve eventually even second-order asymptotic optimality through using only three registers for storing information of the past. We propose a very simple procedure, and show by simulation that it is highly efficient for typical applications.

[1]  E. S. Page CONTINUOUS INSPECTION SCHEMES , 1954 .

[2]  D. Siegmund,et al.  Using the Generalized Likelihood Ratio Statistic for Sequential Detection of a Change-Point , 1995 .

[3]  D. Siegmund,et al.  Sequential Detection of a Change in a Normal Mean when the Initial Value is Unknown , 1991 .

[4]  Benjamin Yakir,et al.  ON THE AVERAGE RUN LENGTH TO FALSE ALARM IN SURVEILLANCE PROBLEMS WHICH POSSESS , 1998 .

[5]  M. Pollak Average Run Lengths of an Optimal Method of Detecting a Change in Distribution. , 1987 .

[6]  H. Robbins,et al.  The Expected Sample Size of Some Tests of Power One , 1974 .

[7]  M. Pollak,et al.  Nonanticipating estimation applied to sequential analysis and changepoint detection , 2005, math/0507434.

[8]  Moshe Pollak,et al.  Average run length to false alarm for surveillance schemes designed with partially specified pre-change distribution , 1997 .

[9]  Surveillance of a Simple Linear Regression , 2003 .

[10]  M. Pollak Optimal Detection of a Change in Distribution , 1985 .

[11]  G. Moustakides Optimal stopping times for detecting changes in distributions , 1986 .

[12]  L. Gordon,et al.  An Efficient Sequential Nonparametric Scheme for Detecting a Change of Distribution , 1994 .

[13]  Moshe Pollak,et al.  Detecting a change in regression: first-order optimality , 1999 .

[14]  T. Lai Sequential changepoint detection in quality control and dynamical systems , 1995 .

[15]  Moshe Pollak,et al.  A Robust Surveillance Scheme for Stochastically Ordered Alternatives , 1995 .

[16]  Y. Ritov Decision Theoretic Optimality of the Cusum Procedure , 1990 .

[17]  D. McDonald A cusum procedure based on sequential ranks , 1990 .

[18]  Moshe Pollak,et al.  An efficient nonparametric detection scheme and its application to surveillance of a Bernoulli process with unknown baseline , 1994 .

[19]  Moshe Pollak,et al.  Optimality and Almost Optimality of Mixture Stopping Rules , 1978 .