Clearing Analysis on Phases: Exact Limiting Probabilities for Skip-Free, Unidirectional, Quasi-Birth-Death Processes

A variety of problems in computing, service, and manufacturing systems can be modeled via infinite repeating Markov chains with an infinite number of levels and a finite number of phases. Many such chains are quasi-birth-death processes with transitions that are skip-free in level, in that one can only transition between consecutive levels, and unidirectional in phase, in that one can only transition from lower-numbered phases to higher-numbered phases. We present a procedure, which we call Clearing Analysis on Phases (CAP), for determining the limiting probabilities of such Markov chains exactly. The CAP method yields the limiting probability of each state in the repeating portion of the chain as a linear combination of scalar bases raised to a power corresponding to the level of the state. The weights in these linear combinations can be determined by solving a finite system of linear equations.

[1]  Qi-Ming He,et al.  Fundamentals of Matrix-Analytic Methods , 2013, Springer New York.

[2]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[3]  Marcel F. Neuts,et al.  Matrix-geometric solutions in stochastic models - an algorithmic approach , 1982 .

[4]  Mark S. Squillante,et al.  Quasi-Birth-and-Death Processes, Lattice Path Counting, and Hypergeometric Functions , 2009, Journal of Applied Probability.

[5]  Uri Yechiali,et al.  AnM/M/s Queue with Servers''Vacations , 1976 .

[6]  Mor Harchol-Balter,et al.  Performance Modeling and Design of Computer Systems: Queueing Theory in Action , 2013 .

[7]  Alan Scheller-Wolf,et al.  Exact analysis of the M/M/k/setup class of Markov chains via recursive renewal reward , 2013, SIGMETRICS '13.

[8]  Ivo J. B. F. Adan,et al.  The snowball effect of customer slowdown in critical many-server systems , 2015, 1502.02856.

[9]  Tuan Phung-Duc,et al.  Exact solutions for M/M/c/Setup queues , 2014, Telecommun. Syst..

[10]  Samuel Karlin,et al.  A First Course on Stochastic Processes , 1968 .

[11]  Tom Burr,et al.  Introduction to Matrix Analytic Methods in Stochastic Modeling , 2001, Technometrics.

[12]  Attahiru S. Alfa,et al.  Matrix Analytic Methods: A Tutorial Overview with Some Extensions and New Results , 2016 .

[13]  Ram Chakka,et al.  Spectral Expansion Solution for a Class of Markov Models: Application and Comparison with the Matrix-Geometric Method , 1995, Perform. Evaluation.

[14]  Ivo J. B. F. Adan,et al.  Joint queue length distribution of multi-class, single-server queues with preemptive priorities , 2014, Queueing Syst. Theory Appl..

[15]  Johan van Leeuwaarden,et al.  Triangular M/G/1-Type and Tree-Like Quasi-Birth-Death Markov Chains , 2011, INFORMS J. Comput..

[16]  Armann Ingolfsson,et al.  Modeling Load and Overwork Effects in Queueing Systems with Adaptive Service Rates , 2016, Oper. Res..

[17]  Gianfranco Ciardo,et al.  ETAQA-MG1: an efficient technique for the analysis of a class of M/G/1-type processes by aggregation , 2004, Perform. Evaluation.

[18]  Alma Riska,et al.  Bridging ETAQA and Ramaswami's formula for the solution of M/G/1-type processes , 2005, Perform. Evaluation.

[19]  Gianfranco Ciardo,et al.  ETAQA: An Efficient Technique for the Analysis of QBD-Processes by Aggregation , 1999, Perform. Evaluation.

[20]  Alma Riska,et al.  ETAQA Solutions for Infinite Markov Processes with Repetitive Structure , 2007, INFORMS J. Comput..

[21]  Alma Riska,et al.  M/G/1-Type Markov Processes: A Tutorial , 2002, Performance.

[22]  Alma Riska,et al.  Exact aggregate solutions for M/G/1-type Markov processes , 2002, SIGMETRICS '02.

[23]  Mor Harchol-Balter,et al.  AutoScale: Dynamic, Robust Capacity Management for Multi-Tier Data Centers , 2012, TOCS.

[24]  J.S.H. van Leeuwaarden,et al.  Quasi-Birth-and-Death Processes with an Explicit Rate Matrix , 2006 .

[25]  Upendra Dave,et al.  Applied Probability and Queues , 1987 .

[26]  Carri W. Chan,et al.  The Impact of Delays on Service Times in the Intensive Care Unit , 2017, Manag. Sci..

[27]  Guy Latouche,et al.  A general class of Markov processes with explicit matrix-geometric solutions , 1986 .

[28]  Johan van Leeuwaarden,et al.  Product-Form Solutions for a Class of Structured Multidimensional Markov Processes , 2013, SIAM J. Appl. Math..

[29]  Peter G. Taylor,et al.  Calculating the equilibrium distribution in level dependent quasi-birth-and-death processes , 1995 .

[30]  W. Whitt,et al.  Transient behavior of the M/M/1 queue via Laplace transforms , 1988, Advances in Applied Probability.

[31]  DANIELLE LIU,et al.  DETERMINATION OF EXPLICIT SOLUTION FOR A GENERAL CLASS OF MARKOV PROCESSES , 2004 .

[32]  Vaidyanathan Ramaswami,et al.  A logarithmic reduction algorithm for quasi-birth-death processes , 1993, Journal of Applied Probability.