An improved method for bounding stationary measures of finite Markov processes

A new method to compute bounds on stationary results of finite Markov processes in discrete or continuous time is introduced. The method extends previously published approaches using polyhedra of eigenvectors for stochastic matrices with a known lower and upper bound of their elements. Known techniques compute bounds for the elements of the stationary vector with respect to the lower bounds of the matrix elements and another set of bounds with respect to the upper bounds of matrix elements. The resulting bounds are usually not sharp, if lower and upper bounds for the elements are known. The new approach combines lower and upper bounds resulting in sharp bounds which are often much tighter than bounds computed using only one bounding value for the matrix elements.

[1]  Giovanni Chiola,et al.  Stochastic Well-Formed Coloured Nets and Multiprocessor Modelling Applications , 1991 .

[2]  John G. Kemeny,et al.  Finite Markov chains , 1960 .

[3]  Pierre Semal,et al.  Bounds for the Positive Eigenvectors of Nonnegative Matrices and for their Approximations by Decomposition , 1984, JACM.

[4]  Giovanni Chiola,et al.  Stochastic Well-Formed Colored Nets and Symmetric Modeling Applications , 1993, IEEE Trans. Computers.

[5]  Pierre Semal Refinable Bounds for Large Markov Chains , 1995, IEEE Trans. Computers.

[6]  William W. Hager,et al.  Updating the Inverse of a Matrix , 1989, SIAM Rev..

[7]  P. Courtois,et al.  On polyhedra of Perron-Frobenius eigenvectors , 1985 .

[8]  G. Franceschinis,et al.  Bounds for Quasi-Lumpable Markow Chains , 1994, Perform. Evaluation.

[9]  John C. S. Lui,et al.  Computing bounds on steady state availability of repairable computer systems , 1994, JACM.

[10]  William J. Stewart,et al.  Introduction to the numerical solution of Markov Chains , 1994 .

[11]  William H. Sanders,et al.  Reduced Base Model Construction Methods for Stochastic Activity Networks , 1991, IEEE J. Sel. Areas Commun..

[12]  P. Buchholz Exact and ordinary lumpability in finite Markov chains , 1994, Journal of Applied Probability.

[13]  M. J. D. Powell,et al.  A Theorem on Rank One Modifications to a Matrix and Its Inverse , 1969, Comput. J..

[14]  Peter Buchholz An iterative bounding method for stochastic automata networks , 2002, Perform. Evaluation.

[15]  Gerardo Rubino,et al.  Bound Computation of Dependability and Performance Measures , 2001, IEEE Trans. Computers.