Exponential ergodicity in Markovian queueing and dam models

We investigate conditions under which the transition probabilities of various Markovian storage processes approach a stationary limiting distribution π at an exponential rate. The models considered include the waiting time of the M/G/1 queue, and models for dams with additive input and state-dependent release rule satisfying a ‘negative mean drift' condition. A typical result is that this exponential ergodicity holds provided the input process is ‘exponentially bounded'; for example, in the case of a compound Poisson input, a sufficient condition is an exponential bound on the tail of the input size distribution. The results are proved by comparing the discrete-time skeletons of the Markov process with the behaviour of a random walk, and then showing that the continuous process inherits the exponential ergodicity of any of its skeletons.

[1]  Pekka Tuominen,et al.  Exponential decay and ergodicity of general Markov processes and their discrete skeletons , 1979, Advances in Applied Probability.

[2]  R. Tweedie,et al.  The recurrence structure of general Markov processes , 1979, Advances in Applied Probability.

[3]  R. Tweedie,et al.  Techniques for establishing ergodic and recurrence properties of continuous‐valued markov chains , 1978 .

[4]  R. Tweedie,et al.  Geometric Ergodicity and R-positivity for General Markov Chains , 1978 .

[5]  P. Brockwell.  Stationary distributions for dams with additive input and content-dependent release rate , 1977, Advances in Applied Probability.

[6]  R. Tweedie.  Criteria for classifying general Markov chains , 1976, Advances in Applied Probability.

[7]  J. Michael Harrison,et al.  The Stationary Distribution and First Exit Probabilities of a Storage Process with General Release Rule , 1976, Math. Oper. Res..

[8]  G. O'Brien.  The Comparison Method for Stochastic Processes , 1975 .

[9]  E. Çinlar,et al.  On dams with additive inputs and a general release rule , 1972, Journal of Applied Probability.

[10]  Erhan Çinlar,et al.  A stochastic integral in storage theory , 1971 .

[11]  Manfred Schäl,et al.  The analysis of queues by state-dependent parameters by Markov renewal processes , 1971, Advances in Applied Probability.

[12]  S. Orey.  Lecture Notes on Limit Theorems for Markov Chain Transition Probabilities , 1971 .

[13]  Marcel F. Neuts,et al.  Exponential Ergodicity of the $M/G/1$ Queue , 1969 .

[14]  D. Daley.  Stochastically monotone Markov Chains , 1968 .

[15]  I. Kovalenko.  An introduction to probability theory and its applications. Vol. II , 1968 .

[16]  H. D. Miller.  Geometric ergodicity in a class of denumerable Markov chains , 1966 .

[17]  C. Heathcote,et al.  On the rate of convergence of waiting times , 1965, Journal of the Australian Mathematical Society.

[18]  E. Shtatland.  On the Distribution of the Maximum of a Process with Independent Increments , 1965 .

[19]  E. C. Titchmarsh,et al.  The Laplace Transform , 1991, Heat Transfer 1.