Nonparametric Sequential Change-Point Detection by a Vertically Trimmed Box Method

This paper examines a new method for sequential detection of a sudden and unobservable change in a sequence of independent observations with completely unspecified distribution functions. A nonparametric detection rule is proposed which relies on the concept of a moving vertically trimmed box. As such, it will be coined as the Vertical Box Control Chart (V-Box Chart). Its implementation requires merely to count the number of data points which fall into the box attached to the last available observation. No a priori knowledge of data distributions is required and proper tuning of the box size provides a quick detection technique. This is supported by establishing statistical properties of the method which explain the role of the tuning parameters used in the V-Box Chart. These theoretical results are verified by simulation studies which indicate that the V-Box Chart may provide quick detection with zero delay for jumps of moderate sizes. Its averaged run length to detection is more favorable than the one for the classical EWMA method. By comparison with the classical Shewhart chart, which was optimized for normal errors, our method provides comparable or better performance.

[1]  Okyoung Na,et al.  The Cusum Test for Parameter Change in Time Series Models , 2003 .

[2]  William H. Woodall,et al.  Alarm rates for quality control charts , 1995 .

[3]  Ansgar Steland,et al.  On detecting jumps in time series: nonparametric setting , 2004 .

[4]  W. Cholewa,et al.  Fault Diagnosis: Models, Artificial Intelligence, Applications , 2004 .

[5]  H. Vincent Poor,et al.  An Introduction to Signal Detection and Estimation , 1994, Springer Texts in Electrical Engineering.

[6]  L. Gordon,et al.  An Efficient Sequential Nonparametric Scheme for Detecting a Change of Distribution , 1994 .

[7]  W. Marsden I and J , 2012 .

[8]  Fred Spiring,et al.  Introduction to Statistical Quality Control , 2007, Technometrics.

[9]  Malcolm R Leadbetter,et al.  Extremes and local dependence in stationary sequences , 1983 .

[10]  Alan S. Willsky,et al.  A survey of design methods for failure detection in dynamic systems , 1976, Autom..

[11]  Amir Dembo,et al.  Large Deviations Techniques and Applications , 1998 .

[12]  E. S. Page A test for a change in a parameter occurring at an unknown point , 1955 .

[13]  Adam Krzyzak,et al.  A Distribution-Free Theory of Nonparametric Regression , 2002, Springer series in statistics.

[14]  T. Lai SEQUENTIAL ANALYSIS: SOME CLASSICAL PROBLEMS AND NEW CHALLENGES , 2001 .

[15]  H. Vincent Poor,et al.  Detection of Stochastic Processes , 1998, IEEE Trans. Inf. Theory.

[16]  Igor V. Nikiforov,et al.  A generalized change detection problem , 1995, IEEE Trans. Inf. Theory.

[17]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[18]  M. R. Leadbetter,et al.  Extremes and Related Properties of Random Sequences and Processes: Springer Series in Statistics , 1983 .

[19]  G. Moustakides Optimal stopping times for detecting changes in distributions , 1986 .

[20]  Ansgar Steland,et al.  On the distribution of the clipping median under a mixture model , 2005 .

[21]  Igor V. Nikiforov,et al.  Two strategies in the problem of change detection and isolation , 1997, IEEE Trans. Inf. Theory.

[22]  Douglas C. Montgomery,et al.  Research Issues and Ideas in Statistical Process Control , 1999 .

[23]  A. Steland Jump-preserving monitoring of dependent time series using pilot estimators , 2003 .

[24]  Ansgar Steland,et al.  Nonparametric monitoring of financial time series by jump-preserving control charts , 2002 .

[25]  Y. Ritov Decision Theoretic Optimality of the Cusum Procedure , 1990 .

[26]  Wolfgang Schmid,et al.  On the run length of a Shewhart chart for correlated data , 1995 .

[27]  T. Lai Sequential changepoint detection in quality control and dynamical systems , 1995 .

[28]  Jean-Pierre Vila,et al.  Optimality of CUSUM Rule Approximations in Change-Point Detection Problems: Application to Nonlinear State–Space Systems , 2008, IEEE Transactions on Information Theory.

[29]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[30]  Namrata Vaswani,et al.  Additive Change Detection in Nonlinear Systems With Unknown Change Parameters , 2007, IEEE Transactions on Signal Processing.

[31]  Igor V. Nikiforov A suboptimal quadratic change detection scheme , 2000, IEEE Trans. Inf. Theory.

[32]  E. S. Page CONTINUOUS INSPECTION SCHEMES , 1954 .

[33]  D. Farnsworth A First Course in Order Statistics , 1993 .

[34]  Saralees Nadarajah,et al.  Asymptotics of Maxima of Discrete Random Variables , 2002 .

[35]  William H. Woodall,et al.  Control Charts Based on Attribute Data: Bibliography and Review , 1997 .

[36]  H. Poor Quickest detection with exponential penalty for delay , 1998 .

[37]  S. Chakraborti,et al.  Nonparametric Control Charts: An Overview and Some Results , 2001 .

[38]  D. Aldous Probability Approximations via the Poisson Clumping Heuristic , 1988 .

[39]  Michèle Basseville,et al.  Detection of abrupt changes: theory and application , 1993 .

[40]  A. Steland Weighted Dickey–Fuller processes for detecting stationarity , 2007, 1001.1833.

[41]  Arjun K. Gupta,et al.  Parametric Statistical Change Point Analysis , 2000 .

[42]  G. S. Watson,et al.  Extreme Values in Samples from $m$-Dependent Stationary Stochastic Processes , 1954 .

[43]  Narayanaswamy Balakrishnan,et al.  A First Course in Order Statistics (Classics in Applied Mathematics) , 2008 .

[44]  Marion R. Reynolds,et al.  EWMA CONTROL CHARTS FOR MONITORING THE MEAN OF AUTOCORRELATED PROCESSES , 1999 .

[45]  G. Lorden PROCEDURES FOR REACTING TO A CHANGE IN DISTRIBUTION , 1971 .

[46]  Wilbert C.M. Kallenberg,et al.  Estimation in Shewhart control charts: effects and corrections , 2004 .

[47]  Y. Mei Sequential change-point detection when unknown parameters are present in the pre-change distribution , 2006, math/0605322.

[48]  B. Brodsky,et al.  Nonparametric Methods in Change Point Problems , 1993 .

[49]  Wolfgang Schmid,et al.  Some properties of the EWMA control chart in the presence of autocorrelation , 1997 .