Asymptotic Exponentiality of the Distribution of First Exit Times for a Class of Markov Processes with Applications to Quickest Change Detection

We consider the first exit time of a nonnegative Harris-recurrent Markov process from the interval $[0,A]$ as $A\to\infty$. We provide an alternative method of proof of asymptotic exponentiality of the first exit time (suitably standardized) that does not rely on embedding in a regeneration process. We show that under certain conditions the moment generating function of a suitably standardized version of the first exit time converges to that of Exponential$(1)$, and we connect between the standardizing constant and the quasi-stationary distribution (assuming it exists). The results are applied to the evaluation of a distribution of run length to false alarm in change-point detection problems.

[1]  Benjamin Yakir.  A Note on the Run Length to False Alarm of a Change-Point Detection Policy , 1995 .

[2]  Gian-Carlo Rota,et al.  Stochastic processes in queuing theory: A. A. Borovkov, Springer, 1976, 280 pp. , 1977 .

[3]  M. Woodroofe.  Nonlinear Renewal Theory in Sequential Analysis , 1987 .

[4]  H. Kesten.  Random difference equations and Renewal theory for products of random matrices , 1973 .

[5]  Moshe Pollak,et al.  A Small Sample Size Comparison of the Cusum and Shiryayev-Roberts Approaches: Changepoint Detection , 1991 .

[6]  Paul Glasserman,et al.  Limits of First Passage Times to Rare Sets in Regenerative Processes , 1995 .

[7]  T. E. Harris,et al.  The Theory of Branching Processes. , 1963 .

[8]  M. Pollak.  Average Run Lengths of an Optimal Method of Detecting a Change in Distribution. , 1987 .

[9]  Rasul A. Khan.  Detecting changes in probabilities of a multi—component process , 1995 .

[10]  E. S. Page.  CONTINUOUS INSPECTION SCHEMES , 1954 .

[11]  Dmitry Korshunov,et al.  Large-Deviation Probabilities for One-Dimensional Markov ChainsPart 1: Stationary Distributions , 1997 .

[12]  Sلأren Asmussen,et al.  Applied Probability and Queues , 1989 .

[13]  V. Veeravalli,et al.  General Asymptotic Bayesian Theory of Quickest Change Detection , 2005 .

[14]  T. E. Harris,et al.  The Theory of Branching Processes. , 1963 .

[15]  Søren Asmussen,et al.  Applied probability and queues, Second Edition , 2003, Applications of mathematics.

[16]  M. Pollak.  Optimal Detection of a Change in Distribution , 1985 .

[17]  A. Tartakovsky.  Asymptotic Performance of a Multichart CUSUM Test Under False Alarm Probability Constraint , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[18]  D. Siegmund.  Sequential Analysis: Tests and Confidence Intervals , 1985 .

[19]  Moshe Pollak,et al.  Convergence of quasi-stationary to stationary distributions for stochastically monotone Markov processes , 1986 .