Asymptotic Optimality of Change-Point Detection Schemes in General Continuous-Time Models

Abstract In the early 1960s, Shiryaev obtained the structure of Bayesian stopping rules for detecting abrupt changes in independent and identically distributed sequences as well as in a constant drift of the Brownian motion. Since then, the methodology of optimal change-point detection has concentrated on the search for stopping rules that achieve the best balance of the mean detection delay and the rate of false alarms or minimize the mean delay under a fixed false alarm probability. In this respect, analysis of the performance of the Shiryaev procedure has been an open problem. Recently, Tartakovsky and Veeravalli (2005) investigated asymptotic performance of the Shiryaev Bayesian change detection procedure, the Page procedure, and the Shiryaev–Roberts procedure when the false alarm probability goes to zero for general discrete-time models. In this article, we investigate the asymptotic performance of Shiryaev and Shiryaev–Roberts procedures for general continuous-time stochastic models for a small false alarm probability and small cost of detection delay. We show that the Shiryaev procedure has asymptotic optimality properties under mild conditions, while the Shiryaev–Roberts procedure may or may not be asymptotically optimal depending on the type of the prior distribution. The presented asymptotic Bayesian detection theory substantially generalizes previous work in the field of change-point detection for continuous-time processes.

[1]  Rakesh K. Bansal,et al.  An algorithm for detecting a change in a stochastic process , 1986, IEEE Trans. Inf. Theory.

[2]  E. S. Page CONTINUOUS INSPECTION SCHEMES , 1954 .

[3]  Albert N. Shiryaev,et al.  Solving the Poisson Disorder Problem , 2002 .

[4]  M. Srivastava,et al.  Comparison of EWMA, CUSUM and Shiryayev-Roberts Procedures for Detecting a Shift in the Mean , 1993 .

[5]  George V. Moustakides,et al.  Optimality of the CUSUM procedure in continuous time , 2003 .

[6]  V. Veeravalli,et al.  General Asymptotic Bayesian Theory of Quickest Change Detection , 2005 .

[7]  C. Fuh Asymptotic operating characteristics of an optimal change point detection in hidden Markov models , 2004, math/0503682.

[8]  L. Baum,et al.  Convergence rates in the law of large numbers , 1963 .

[9]  A. Shiryaev On Optimum Methods in Quickest Detection Problems , 1963 .

[10]  M. Pollak Average Run Lengths of an Optimal Method of Detecting a Change in Distribution. , 1987 .

[11]  S. Kent,et al.  On the trail of intrusions into information systems , 2000 .

[12]  T. Lai Asymptotic Optimality of Invariant Sequential Probability Ratio Tests , 1981 .

[13]  Venugopal V. Veeravalli,et al.  Multihypothesis sequential probability ratio tests - Part I: Asymptotic optimality , 1999, IEEE Trans. Inf. Theory.

[14]  Cheng-Der Fuh,et al.  SPRT and CUSUM in hidden Markov models , 2003 .

[15]  Y. Ritov Decision Theoretic Optimality of the Cusum Procedure , 1990 .

[16]  Volker Strassen,et al.  Almost sure behavior of sums of independent random variables and martingales , 1967 .

[17]  Alexander G. Tartakovsky,et al.  Asymptotic Optimality of Certain Multihypothesis Sequential Tests: Non‐i.i.d. Case , 1998 .

[18]  M. Beibel A note on Ritov's Bayes approach to the minimax property of the cusum procedure , 1996 .

[19]  P. Sen,et al.  Sequential Estimation: Ghosh/Sequential , 1997 .

[20]  Venugopal V. Veeravalli,et al.  An efficient sequential procedure for detecting changes in multichannel and distributed systems , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[21]  Alʹbert Nikolaevich Shiri︠a︡ev,et al.  Statistics of random processes , 1977 .

[22]  G. Moustakides Optimal stopping times for detecting changes in distributions , 1986 .

[23]  H Robbins,et al.  Complete Convergence and the Law of Large Numbers. , 1947, Proceedings of the National Academy of Sciences of the United States of America.

[24]  Tze Leung Lai,et al.  Information Bounds and Quick Detection of Parameter Changes in Stochastic Systems , 1998, IEEE Trans. Inf. Theory.

[25]  Michèle Basseville,et al.  Detection of abrupt changes: theory and application , 1993 .

[26]  Alexander G. Tartakovsky,et al.  Effective adaptive spatial-temporal technique for clutter rejection in IRST , 2000, SPIE Defense + Commercial Sensing.

[27]  A. Borovkov Asymptotically Optimal Solutions in the Change-Point Problem , 1999 .

[28]  Alexander G. Tartakovsky Asymptotically optimal sequential tests for nonhomogeneous processes , 1998 .

[29]  Alexander G. Tartakovsky,et al.  A novel approach to detection of \denial{of{service" attacks via adaptive sequential and batch{sequential change{point detection methods , 2001 .

[30]  Benjamin Yakir A note on optimal detection of a change in distribution , 1997 .

[31]  Michael Baron,et al.  Bayes and asymptotically pointwise optimal stopping rules for the detection of influenza epidemics , 2002 .

[32]  M. Baron BAYES STOPPING RULES IN A CHANGE-POINT MODEL WITH A RANDOM HAZARD RATE , 2001 .

[33]  M. Beibel SEQUENTIAL DETECTION OF SIGNALS WITH KNOWN SHAPE AND UNKNOWN MAGNITUDE , 2000 .

[34]  D. Siegmund Sequential Analysis: Tests and Confidence Intervals , 1985 .

[35]  Benjamin Yakir,et al.  Optimal detection of a change in distribution when the observations form a Markov chain with a finite state space , 1994 .

[36]  Alan S. Willsky,et al.  A survey of design methods for failure detection in dynamic systems , 1976, Autom..

[37]  I. Ibragimov,et al.  On Sequential Estimation , 1975 .

[38]  A. Shiryaev COMMUNICATIONS OF THE MOSCOW MATHEMATICAL SOCIETY: Minimax optimality of the method of cumulative sums (cusum) in the case of continuous time , 1996 .

[39]  M. Pollak Optimal Detection of a Change in Distribution , 1985 .

[40]  G. Lorden PROCEDURES FOR REACTING TO A CHANGE IN DISTRIBUTION , 1971 .

[41]  Tze Leung Lai,et al.  On $r$-Quick Convergence and a Conjecture of Strassen , 1976 .

[42]  A. Tartakovsky ASYMPTOTIC PROPERTIES OF CUSUM AND SHIRYAEV'S PROCEDURES FOR DETECTING A CHANGE IN A NONHOMOGENEOUS GAUSSIAN PROCESS , 1995 .

[43]  Kang G. Shin,et al.  Detecting SYN flooding attacks , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[44]  Rudolf B. Blazek,et al.  Detection of intrusions in information systems by sequential change-point methods , 2005 .

[45]  Dawei Huang,et al.  Testing for a Change in the Parameter Values and Order of an Autoregressive Model , 1995 .

[46]  P. Bickel,et al.  Asymptotically pointwise optimal procedures in sequential analysis , 1967 .

[47]  D. Siegmund,et al.  A diffusion process and its applications to detecting a change in the drift of Brownian motion , 1984 .

[48]  Alʹbert Nikolaevich Shiri︠a︡ev,et al.  Optimal stopping rules , 1977 .