Quasistationary distributions for level-dependent quasi-birth-and-death processes

In this paper we provide a complete quasistationary analysis for the class of level-dependent, discrete-time quasi-birth-and-death processes (QBDs) for which level zero has been collapsed into an absorbing state. We show that the form of a quasistationary distribution depends upon whether the eigenvalue of a certain matrix is equal to one or less than one. Furthermore, we show how to calculate the convergence norm a of such a QBD and observe that the QBD is a-recurrent in the first case mentioned above and a-transient in the second case. The further classification of an a-recurrent QBD as a-positive or a-null depends on whether the convergence radius a2 of the modified QBD in which level one is collapsed into an absorbing state is strictly greater than, or equal to, a. In the first of these cases the QBD is a-positive, while in the second case the QBD may be a-positive or a-null

[1]  D. Vere-Jones.  Ergodic properties of nonnegative matrices. II , 1967 .

[2]  Harry Kesten,et al.  A RATIO LIMIT THEOREM FOR (SUB) MARKOV CHAINS ON {1,2, * } WITH BOUNDED JUMPS , 1995 .

[3]  V Ramaswami.  Matrix Analytic Methods: A Tutorial Overview with Some Extensions and New Results , 1996 .

[4]  Erik A. van Doorn,et al.  Geomatric ergodicity and quasi-stationarity in discrete-time birth-death processes , 1995, The Journal of the Australian Mathematical Society. Series B. Applied Mathematics.

[5]  S. Kalpakam,et al.  QUASI-STATIONARY DISTRIBUTION OF A TWO-UNIT WARM-STANDBY REDUNDANT SYSTEM , 1983 .

[6]  Further results on the relationship between μ-invariant measures and quasi-stationary distributions for absorbing continuous-time Markov chains , 2000 .

[7]  D. Klein.  The introduction, increase, and crash of reindeer on St. Matthew Island. , 1968 .

[8]  Samuel Karlin,et al.  The classification of birth and death processes , 1957 .

[9]  W. J. Anderson.  Continuous-Time Markov Chains: An Applications-Oriented Approach , 1991 .

[10]  Peter G. Taylor,et al.  Invariant measures for quasi-birth-and-death processes , 1998 .

[11]  Vaidyanathan Ramaswami,et al.  A logarithmic reduction algorithm for quasi-birth-death processes , 1993, Journal of Applied Probability.

[12]  E. Seneta,et al.  On quasi-stationary distributions in discrete-time Markov chains with a denumerable infinity of states , 1966 .

[13]  Richard L. Tweedie,et al.  Truncation approximations of invariant measures for Markov chains , 1998, Journal of Applied Probability.

[14]  Samuel Karlin,et al.  Many server queueing processes with Poisson input and exponential service times , 1958 .

[15]  P. Taylor,et al.  Some properties of the rate operators in level dependent quasi-birth-and-death processes with a countable number of phases , 1996 .

[16]  S. Karlin,et al.  The differential equations of birth-and-death processes, and the Stieltjes moment problem , 1957 .

[17]  P. Coolen-Schrijner.  QUASI-STATIONARITY OF DISCRETE-TIME MARKOV CHAINSWITH DRIFT TO INFINITYPAULINE , 1998 .

[18]  W. J. Anderson.  Continuous-Time Markov Chains , 1991 .

[19]  Marcel F. Neuts,et al.  Structured Stochastic Matrices of M/G/1 Type and Their Applications , 1989 .

[20]  D. Vere-Jones.  GEOMETRIC ERGODICITY IN DENUMERABLE MARKOV CHAINS , 1962 .

[21]  D. Daley.  Stochastically monotone Markov Chains , 1968 .

[22]  Nigel G. Bean,et al.  The quasi-stationary behavior of quasi-birth-and-death processes , 1997 .

[23]  Valerie Isham,et al.  Non‐Negative Matrices and Markov Chains , 1983 .

[24]  P. Pollett,et al.  Quasistationary distributions for autocatalytic reactions , 1987 .

[25]  K. Knopp,et al.  Theory and Applications of Infinite Series , 1972 .

[26]  Peter G. Taylor,et al.  Calculating the equilibrium distribution in level dependent quasi-birth-and-death processes , 1995 .

[27]  Marcel F. Neuts,et al.  Matrix-Geometric Solutions in Stochastic Models , 1981 .

[28]  P. Taylor,et al.  The quasistationary distributions of level-independent quasi-birth-and-death processes , 1998 .

[29]  Michel Moreau,et al.  Note on the stochastic theory of a self-catalytic chemical reaction. II , 1981 .