Quickest detection with exponential penalty for delay

The problem of detecting a change in the probability distribution of a random sequence is considered. Stopping times are derived that optimize the tradeoff between detection delay and false alarms within two criteria. In both cases, the detection delay is penalized exponentially rather than linearly, as has been the case in previous formulations of this problem. The first of these two criteria is to minimize a worst-case measure of the exponential detection delay within a lower-bound constraint on the mean time between false alarms. Expressions for the performance of the optimal detection rule are also developed for this case. It is seen, for example, that the classical Page CUSUM test can be arbitrarily unfavorable relative to the optimal test under exponential delay penalty. The second criterion considered is a Bayesian one, in which the unknown change point is assumed to obey a geometric prior distribution. In this case, the optimal stopping time effects an optimal trade-off between the expected exponential detection delay and the probability of false alarm. Finally, generalizations of these results to problems in which the penalties for delay may be path dependent are also considered.

[1]  Kai Lai Chung,et al.  A Course in Probability Theory , 1949 .

[2]  J. Kiefer,et al.  Sequential Decision Problems for Processes with Continuous time Parameter. Testing Hypotheses , 1953 .

[3]  J. Doob Stochastic processes , 1953 .

[4]  E. S. Page CONTINUOUS INSPECTION SCHEMES , 1954 .

[5]  A. Shiryaev On Optimum Methods in Quickest Detection Problems , 1963 .

[6]  L. Dubins,et al.  OPTIMAL STOPPING WHEN THE FUTURE IS DISCOUNTED , 1967 .

[7]  David Siegmund,et al.  Great expectations: The theory of optimal stopping , 1971 .

[8]  G. Lorden PROCEDURES FOR REACTING TO A CHANGE IN DISTRIBUTION , 1971 .

[9]  A. N. Sirjaev,et al.  Statistical Sequential Analysis , 1973 .

[10]  H. M. Taylor A Stopped Brownian Motion Formula , 1975 .

[11]  J. Neveu,et al.  Discrete Parameter Martingales , 1975 .

[12]  M. R. Reynolds Approximations to the Average Run Length in Cumulative Sum Control Charts , 1975 .

[13]  D. P. Kennedy Some martingales related to cumulative sum tests and single-server queues , 1976 .

[14]  J. Lehoczky FORMULAS FOR STOPPED DIFFUSION PROCESSES WITH STOPPING TIMES BASED ON THE MAXIMUM , 1977 .

[15]  R. Khan Wald's approximations to the average run length in cusum procedures , 1978 .

[16]  T. Bojdecki,et al.  On a generalized disorder problem , 1984 .

[17]  G. Moustakides Optimal stopping times for detecting changes in distributions , 1986 .

[18]  S. Janson Moments for first-passage and last-exit times, the minimum, and related quantities for random walks with positive drift , 1986, Advances in Applied Probability.

[19]  Pelkowitz Lionel The general discrete time disorder problem , 1987 .

[20]  D. Siegmund,et al.  Conditional boundary crossing probabilities, with applications to change-point problems , 1988 .

[21]  Y. Ritov Decision Theoretic Optimality of the Cusum Procedure , 1990 .

[22]  B. Brodsky,et al.  Nonparametric Methods in Change Point Problems , 1993 .

[23]  Feza Kerestecioglu,et al.  Change Detection and Input Design in Dynamical Systems , 1993 .

[24]  Edward Carlstein,et al.  Change-point problems , 1994 .

[25]  M. Beibel Bayes problems in change-point models for the Wiener process , 1994 .

[26]  Michèle Basseville,et al.  Detection of Abrupt Changes: Theory and Applications. , 1995 .

[27]  B. Yakir Dynamic sampling policy for detecting a change in distribution, with a probability bound on false alarm , 1996 .

[28]  M. Beibel A note on Ritov's Bayes approach to the minimax property of the cusum procedure , 1996 .

[29]  H. R. Lerche,et al.  A New Look at Optimal Stopping Problems related to Mathematical Finance , 1997 .