Subgeometric ergodicity for continuous-time Markov chains

Abstract In this paper, subgeometric ergodicity is investigated for continuous-time Markov chains. Several equivalent conditions, based on the first hitting time or the drift function, are derived as the main theorem. In its corollaries, practical drift criteria are given for l-ergodicity and computable bounds on subgeometric convergence rates are obtained for stochastically monotone Markov chains. These results are illustrated by examples.

[1]  G. Roberts,et al.  Polynomial convergence rates of Markov chains. , 2002 .

[2]  Yong-Hua Mao,et al.  Ergodic degrees for continuous-time Markov chains , 2004 .

[3]  Mu-Fa Chen.  Eigenvalues, inequalities and ergodic theory , 2000 .

[4]  R. Douc,et al.  Subgeometric rates of convergence of f-ergodic strong Markov processes , 2006, math/0605791.

[5]  Anyue Chen,et al.  Stochastic Comparability and Dual Q-Functions , 1999 .

[6]  E. Nummelin,et al.  The rate of convergence in Orey's theorem for Harris recurrent Markov chains with applications to renewal theory , 1983 .

[7]  A. Chen.  Ergodicity and stability of generalised Markov branching processes with resurrection , 2002, Journal of Applied Probability.

[8]  Zhenting Hou,et al.  Subgeometric rates of convergence for a class of continuous-time Markov process , 2005 .

[9]  S. Meyn,et al.  Computable exponential convergence rates for stochastically ordered Markov processes , 1996 .

[10]  G. Roberts,et al.  SUBGEOMETRIC ERGODICITY OF STRONG MARKOV PROCESSES , 2005, math/0505260.

[11]  W. J. Anderson.  Continuous-Time Markov Chains: An Applications-Oriented Approach , 1991 .

[12]  Ching-Feng Kuo,et al.  Homogeneous denumerable Markov processes , 1988 .

[13]  Zhenting Hou,et al.  Several types of ergodicity for M/G/1-type Markov chains and Markov processes , 2006 .

[14]  A. Sapozhnikov.  Subgeometric rates of convergence of f-ergodic Markov chains , 2006 .

[15]  Mu-Fa Chen,et al.  From Markov Chains to Non-Equilibrium Particle Systems , 1992 .

[16]  H. Thorisson.  The queue GI/G/1: Finite moments of the cycle variables and uniform rates of convergence☆ , 1985 .

[17]  R. Douc,et al.  Practical drift conditions for subgeometric rates of convergence , 2004, math/0407122.