Structured Markov chains solver: algorithms

We analyze the problem of the numerical solution of structured Markov chains encountered in queuing models: we describe the main computational problems and present the most advanced algorithms currently available for their solutions.

[1]  Beatrice Meini,et al.  Improved cyclic reduction for solving queueing problems , 1997, Numerical Algorithms.

[2]  Beatrice Meini,et al.  An improved FFT-based version of Ramaswami's formula , 1997 .

[3]  Vaidyanathan Ramaswami,et al.  Introduction to Matrix Analytic Methods in Stochastic Modeling , 1999, ASA-SIAM Series on Statistics and Applied Mathematics.

[4]  K. Sohraby,et al.  An invariant subspace approach in m/g/l and g/m/l type markov chains , 1997 .

[5]  Beatrice Meini,et al.  New convergence results on functional iteration techniques for the numerical solution of M/G/1 type Markov chains , 1997 .

[6]  H. R. Gail,et al.  Non-Skip-Free M/G/1 and G/M/1 Type Markov Chains , 1997, Advances in Applied Probability.

[7]  Beatrice Meini,et al.  Analyzing M/G/1 paradigmsthrough QBDs: the role of the block structure in computing the matrixG , 2000 .

[8]  V. Ramaswami A stable recursion for the steady state vector in markov chains of m/g/1 type , 1988 .

[9]  Vaidyanathan Ramaswami,et al.  A logarithmic reduction algorithm for quasi-birth-death processes , 1993, Journal of Applied Probability.

[10]  Beatrice Meini,et al.  On the Solution of a Nonlinear Matrix Equation Arising in Queueing Problems , 1996, SIAM J. Matrix Anal. Appl..

[11]  Noah H. Rhee,et al.  A Shifted Cyclic Reduction Algorithm for Quasi-Birth-Death Problems , 2002, SIAM J. Matrix Anal. Appl..

[12]  Guy Latouche,et al.  Newton's iteration for nonlinear equations in Markov chains , 1994 .

[13]  Beatrice Meini,et al.  Numerical Methods for Structured Markov Chains (Numerical Mathematics and Scientific Computation) , 2005 .

[14]  B. Meini,et al.  Structured Markov chains solver: software tools , 2006, SMCtools '06.

[15]  Beatrice Meini,et al.  Solving matrix polynomial equations arising in queueing problems , 2002 .

[16]  G. Latouche ALGORITHMS FOR INFINITE MARKOV CHAINS WITH REPEATING COLUMNS , 1993 .

[17]  Beatrice Meini,et al.  Solving certain matrix equations by means of Toeplitz computations: algorithms and applications , 2001 .

[18]  Marcel F. Neuts,et al.  Matrix-Geometric Solutions in Stochastic Models , 1981 .

[19]  Beatrice Meini,et al.  Numerical methods for structured Markov chains , 2005 .

[20]  B. Conolly Structured Stochastic Matrices of M/G/1 Type and Their Applications , 1991 .

[21]  Peter G. Taylor,et al.  Advances in Algorithmic Methods for Stochastic Models , 2000 .