Computable exponential convergence rates for stochastically ordered Markov processes

for every initial state F ' x. 0 The goal of this paper is to identify the largest exponential convergence rate a , or at least to find computationally reasonable bounds for such a ‘‘best’’ a . Coupling techniques are used to derive such results in terms of Ž . 4 i the moment-generating function of the first passage time into state 0 Ž . and ii solutions to drift inequalities involving the generator of the process. The results give explicit bounds for total variation convergence of w Ž .x Ž . Ž . the process; convergence rates for E f F to H f y p dy for an unx t bounded function f are also found. We prove that frequently the bounds obtained are the best possible. Applications are given to dam models and queues where first passage time distributions are tractable, and to one-dimensional reflected diffusions where the generator is the more appropriate tool. An extension of the results to a multivariate setting and an analysis of a tandem queue are also included.

[1]  A comparison of convergence rates for three models in the theory of dams , 1997 .

[2]  Richard L. Tweedie,et al.  Geometric Convergence Rates for Stochastically Ordered Markov Chains , 1996, Math. Oper. Res..

[3]  S. Meyn,et al.  Exponential and Uniform Ergodicity of Markov Processes , 1995 .

[4]  Mark H. Davis Markov Models and Optimization , 1995 .

[5]  Vladimir Kalashnikov,et al.  Topics on Regenerative Processes , 1994 .

[6]  R. Lund A Dam with seasonal input , 1994, Journal of Applied Probability.

[7]  François Baccelli,et al.  Ergodicity of Jackson-type queueing networks , 1994, Queueing Syst. Theory Appl..

[8]  Sean P. Meyn,et al.  Stability of Generalized Jackson Networks , 1994 .

[9]  S. Meyn,et al.  Stability of Markovian processes III: Foster–Lyapunov criteria for continuous-time processes , 1993, Advances in Applied Probability.

[10]  S. Meyn,et al.  Stability of Markovian processes II: continuous-time processes and sampled chains , 1993, Advances in Applied Probability.

[11]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[12]  W. Whitt,et al.  Useful martingales for stochastic storage processes with Lévy input , 1992, Journal of Applied Probability.

[13]  Alexander I. Zeifman Some estimates of the rate of convergence for birth and death processes , 1991 .

[14]  D. Yao,et al.  Stochastic monotonicity in general queueing networks , 1989, Journal of Applied Probability.

[15]  Upendra Dave,et al.  Applied Probability and Queues , 1987 .

[16]  W. Whitt,et al.  Transient behavior of regulated Brownian motion, I: Starting at the origin , 1987, Advances in Applied Probability.

[17]  Conditions for exponential ergodicity and bounds for the decay parameter of a birth-death process , 1985, Advances in Applied Probability.

[18]  L. G. Afanas'eva On periodic distribution of waiting-time process , 1985 .

[19]  N. L. Lawrie,et al.  Comparison Methods for Queues and Other Stochastic Models , 1984 .

[20]  H. Thorisson The coupling of regenerative processes , 1983, Advances in Applied Probability.

[21]  Walter A. Rosenkrantz Calculation of the Laplace Transform of the Length of the Busy Period for the M|G|1 Queue Via Martingales , 1983 .

[22]  R. Tweedie,et al.  Storage processes with general release rule and additive inputs , 1982, Advances in Applied Probability.

[23]  E. A. Doorn Stochastic Monotonicity and Queueing Applications of Birth-Death Processes , 1981 .

[24]  R. Tweedie,et al.  Exponential ergodicity in Markovian queueing and dam models , 1979, Journal of Applied Probability.

[25]  T. Kamae,et al.  Stochastic Inequalities on Partially Ordered Spaces , 1977 .

[26]  J. Teugels,et al.  The exponential rate of convergence of the distribution of the maximum of a random walk , 1975, Journal of Applied Probability.

[27]  Hiroshi Kunita,et al.  A classification of the second order degenerate elliptic operators and its probabilistic characterization , 1974 .