Operator-geometric stationary distributions for markov chains, with application to queueing models

This paper considers a class of Markov chains on a bivariate state space , whose transition probabilities have a particular ‘block-partitioned' structure. Examples of such chains include those studied by Neuts [8] who took E to be finite; they also include chains studied in queueing theory, such as (Nn , Sn ) where Nn is the number of customers in a GI/G/1 queue immediately before, and Sn the remaining service time immediately after, the nth arrival. We show that the stationary distribution Πfor these chains has an ‘operator-geometric' nature, with , where the operator S is the minimal solution of a non-linear operator equation. Necessary and sufficient conditions for Πto exist are also found. In the case of the GI/G/1 queueing chain above these are exactly the usual stability conditions. G1/G/1 QUEUE; PHASE-TYPE; INVARIANT MEASURE; FOSTER'S CONDITIONS

[1]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[2]  Kai Lai Chung,et al.  Markov Chains with Stationary Transition Probabilities , 1961 .

[3]  P. D. Finch.  On the busy period in the queueing system GI/G/1 , 1961, Journal of the Australian Mathematical Society.

[4]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[5]  Matthew Rosenshine,et al.  QUEUES WITH STATE-DEPENDENT SERVICE TIMES , 1967 .

[6]  Marcel F. Neuts,et al.  The queue with Poisson input and general service times, treated as a branching process , 1969 .

[7]  S. Orey.  Lecture Notes on Limit Theorems for Markov Chain Transition Probabilities , 1971 .

[8]  D. Vere-Jones.  Markov Chains , 1972, Nature.

[9]  R. Tweedie.  $R$-Theory for Markov Chains on a General State Space I: Solidarity Properties and $R$-Recurrent Chains , 1974 .

[10]  R. Cogburn.  A Uniform Theory for Sums of Markov Chain Transition Probabilities , 1975 .

[11]  R. Tweedie.  Criteria for classifying general Markov chains , 1976, Advances in Applied Probability.

[12]  M. Neuts.  Markov chains with applications in queueing theory, which have a matrix-geometric invariant probability vector , 1978, Advances in Applied Probability.

[13]  R. Tweedie,et al.  The recurrence structure of general Markov processes , 1979, Advances in Applied Probability.

[14]  Marcel F. Neuts.  The probabilistic significance of the rate matrix in matrix-geometric invariant vectors , 1980 .

[15]  Marcel F. Neuts,et al.  Matrix-geometric solutions in stochastic models - an algorithmic approach , 1982 .