On robustness of the Shiryaev–Roberts change-point detection procedure under parameter misspecification in the post-change distribution

ABSTRACT The gist of the quickest change-point detection problem is to detect the presence of a change in the statistical behavior of a series of sequentially made observations, and do so in an optimal detection-speed-versus-“false-positive”-risk manner. When optimality is understood either in the generalized Bayesian sense or as defined in Shiryaev's multi-cyclic setup, the so-called Shiryaev–Roberts (SR) detection procedure is known to be the “best one can do”, provided, however, that the observations’ pre- and post-change distributions are both fully specified. We consider a more realistic setup, viz. one where the post-change distribution is assumed known only up to a parameter, so that the latter may be misspecified. The question of interest is the sensitivity (or robustness) of the otherwise “best” SR procedure with respect to a possible misspecification of the post-change distribution parameter. To answer this question, we provide a case study where, in a specific Gaussian scenario, we allow the SR procedure to be “out of tune” in the way of the post-change distribution parameter, and numerically assess the effect of the “mistuning” on Shiryaev's (multi-cyclic) Stationary Average Detection Delay delivered by the SR procedure. The comprehensive quantitative robustness characterization of the SR procedure obtained in the study can be used to develop the respective theory as well as to provide a rational for practical design of the SR procedure. The overall qualitative conclusion of the study is an expected one: the SR procedure is less (more) robust for less (more) contrast changes and for lower (higher) levels of the false alarm risk.

[1]  Sven Knoth,et al.  The Art of Evaluating Monitoring Schemes — How to Measure the Performance of Control Charts? , 2006 .

[2]  Alexander G. Tartakovsky,et al.  Nearly Optimal Change-Point Detection with an Application to Cybersecurity , 2012, 1202.2849.

[3]  G. Moustakides Optimal stopping times for detecting changes in distributions , 1986 .

[4]  Albert N. Shiryaev,et al.  On the Linear and Nonlinear Generalized Bayesian Disorder Problem (Discrete Time Case) , 2009 .

[5]  Lonnie C. Vance,et al.  The Economic Design of Control Charts: A Unified Approach , 1986 .

[6]  Albert N. Shiryaev,et al.  Quickest Detection Problems in the Technical Analysis of the Financial Data , 2002 .

[7]  George V. Moustakides,et al.  Numerical Comparison of CUSUM and Shiryaev–Roberts Procedures for Detecting Changes in Distributions , 2009, 0908.4119.

[8]  M. Pollak Average Run Lengths of an Optimal Method of Detecting a Change in Distribution. , 1987 .

[9]  D. Siegmund,et al.  A diffusion process and its applications to detecting a change in the drift of Brownian motion , 1984 .

[10]  Grigory Sokolov,et al.  Quickest Change-Point Detection: A Bird's Eye View , 2013, 1310.3285.

[11]  Alexander G. Tartakovsky,et al.  Efficient Computer Network Anomaly Detection by Changepoint Detection Methods , 2012, IEEE Journal of Selected Topics in Signal Processing.

[12]  E. S. Page CONTINUOUS INSPECTION SCHEMES , 1954 .

[13]  Wenyu Du,et al.  Efficient performance evaluation of the generalized Shiryaev-Roberts detection procedure in a multi-cyclic setup , 2013, 1312.5002.

[14]  Design and Comparison of Shiryaev-Roberts and CUSUM-Type Change-Point Detection Procedures , 2009 .

[15]  Taposh Banerjee,et al.  Quickest Change Detection , 2012, ArXiv.

[16]  M. Srivastava,et al.  Comparison of EWMA, CUSUM and Shiryayev-Roberts Procedures for Detecting a Shift in the Mean , 1993 .

[17]  A. Shiryaev On Optimum Methods in Quickest Detection Problems , 1963 .

[18]  Alexander G. Tartakovsky,et al.  Optimal Design and Analysis of the Exponentially Weighted Moving Average Chart for Exponential Data , 2013, 1307.7126.

[19]  George V. Moustakides,et al.  A NUMERICAL APPROACH TO PERFORMANCE ANALYSIS OF QUICKEST CHANGE-POINT DETECTION PROCEDURES , 2009, 0907.3521.

[20]  G. Lorden PROCEDURES FOR REACTING TO A CHANGE IN DISTRIBUTION , 1971 .

[21]  Acheson J. Duncan,et al.  The Economic Design of X Charts Used to Maintain Current Control of a Process , 1956 .

[22]  G. Moustakides,et al.  State-of-the-Art in Bayesian Changepoint Detection , 2010 .

[23]  Douglas C. Montgomery,et al.  The Economic Design of Control Charts: A Review and Literature Survey , 1980 .

[24]  Michèle Basseville,et al.  Detection of abrupt changes: theory and application , 1993 .

[25]  William H. Woodall,et al.  Performance comparison of some likelihood ratio-based statistical surveillance methods , 2008 .

[26]  M. Basseville,et al.  Sequential Analysis: Hypothesis Testing and Changepoint Detection , 2014 .

[27]  M. Pollak Optimal Detection of a Change in Distribution , 1985 .

[28]  Kenneth E. Case,et al.  Economic Design of Control Charts: A Literature Review for 1981–1991 , 1994 .

[29]  Moshe Pollak,et al.  ON OPTIMALITY PROPERTIES OF THE SHIRYAEV-ROBERTS PROCEDURE , 2007, 0710.5935.

[30]  S. W. Roberts A Comparison of Some Control Chart Procedures , 1966 .

[31]  Albert N. Shiryaev,et al.  Optimal Stopping Rules , 2011, International Encyclopedia of Statistical Science.

[32]  S. W. Roberts,et al.  Control Chart Tests Based on Geometric Moving Averages , 2000, Technometrics.

[33]  M. Woodroofe Nonlinear Renewal Theory in Sequential Analysis , 1987 .

[34]  Y. Ritov Decision Theoretic Optimality of the Cusum Procedure , 1990 .

[35]  A. Shiryaev,et al.  Quickest detection of drift change for Brownian motion in generalized Bayesian and minimax settings , 2006 .

[36]  Ron S. Kenett,et al.  Data-analytic aspects of the Shiryayev-Roberts control chart: Surveillance of a non-homogeneous Poisson process , 1996 .

[37]  M. Pollak,et al.  Exact optimality of the Shiryaev-Roberts procedure for detecting changes in distributions , 2008, 2008 International Symposium on Information Theory and Its Applications.

[38]  Aleksey S. Polunchenko,et al.  State-of-the-Art in Sequential Change-Point Detection , 2011, 1109.2938.

[39]  Alʹbert Nikolaevich Shiri︠a︡ev,et al.  Optimal stopping rules , 1977 .

[40]  Grigory Sokolov,et al.  An Accurate Method for Determining the Pre-Change Run Length Distribution of the Generalized Shiryaev-Roberts Detection Procedure , 2013, 1307.3214.