Error bounds for augmented truncation approximations of continuous-time Markov chains

Abstract This paper considers the augmented truncation approximation of the generator of an ergodic continuous-time Markov chain with a countably infinite state space. The main purpose of this paper is to present bounds for the absolute difference between the stationary distributions of the original generator and its augmented truncation. As examples, we apply the bounds to an M ∕ M ∕ s retrial queue and an upper Hessenberg Markov chain.

[1]  Hiroyuki Masuyama,et al.  Error Bounds for Augmented Truncations of Discrete-Time Block-Monotone Markov Chains under Geometric Drift Conditions , 2015, Advances in Applied Probability.

[2]  Yiqiang Q. Zhao,et al.  Censoring technique and numerical computations of invariant distribution for continuous-time Markov chains , 2015 .

[3]  Yiqiang Q. Zhao,et al.  Stochastic block–monotonicity in the approximation of the stationary distribution of infinite markov chains , 2000 .

[4]  W. J. Anderson Continuous-Time Markov Chains: An Applications-Oriented Approach , 1991 .

[5]  Bin Liu,et al.  Analyzing retrial queues by censoring , 2010, Queueing Syst. Theory Appl..

[6]  Hiroyuki Masuyama,et al.  Error bounds for last-column-block-augmented truncations of block-structured Markov chains , 2016, 1601.03489.

[7]  Hiroyuki Masuyama Error Bounds for Augmented Truncations of Discrete-Time Block-Monotone Markov Chains under Subgeometric Drift Conditions , 2016, SIAM J. Matrix Anal. Appl..

[8]  Richard L. Tweedie,et al.  Truncation approximations of invariant measures for Markov chains , 1998, Journal of Applied Probability.

[9]  Hiroyuki Masuyama,et al.  Continuous-time block-monotone Markov chains and their block-augmented truncations , 2015, 1511.04669.

[10]  Danielle Liu,et al.  The censored Markov chain and the best augmentation , 1996, Journal of Applied Probability.

[11]  Yuanyuan Liu,et al.  Error bounds for augmented truncation approximations of Markov chains via the perturbation method , 2018, Advances in Applied Probability.

[12]  Eugene Seneta,et al.  Augmented truncations of infinite stochastic matrices , 1987 .

[13]  S. Meyn,et al.  Stability of Markovian processes III: Foster–Lyapunov criteria for continuous-time processes , 1993, Advances in Applied Probability.

[14]  Yang Woo Shin,et al.  Fundamental Matrix of Transient QBD Generator with Finite States and Level Dependent Transitions , 2009, Asia Pac. J. Oper. Res..

[15]  Yuanyuan Liu,et al.  Augmented truncation approximations of discrete-time Markov chains , 2010, Oper. Res. Lett..

[16]  Eugene Seneta,et al.  Monotone infinite stochastic matrices and their augmented truncations , 1987 .

[17]  Sean P. Meyn,et al.  A Liapounov bound for solutions of the Poisson equation , 1996 .