Stochastic Complement Analysis of Multi-Server Threshold Queues with Histeresis

Abstract We consider a K -server threshold-based queueing system with hysteresis, for which a set of forward thresholds ( F 1 , F 2 ,…, F K −1 ) and a set of reverse thresholds ( R 1 , R 2 ,…, R K −1 ) are defined. A simple version of this multi-server queueing system behaves as follows. When a customer arrives to an empty system, it is serviced by a single server. Whenever the number of customers exceeds a forward threshold F i , a server is added to the system and server activation is instantaneous. Whenever the number of customer falls below a reverse threshold R i , a server is removed from the system. We consider and solve several variations of this problem, namely: (1) homogeneous servers with Poisson arrivals, (2) homogeneous servers with bulk (Poisson) arrivals, and (3) heterogeneous servers with Poisson arrivals. We place no restrictions on the number of servers or the bulk sizes or the size of the waiting room. In [O.C. Ibe, J. Keilson, Multi-server threshold queues with hysteresis, Performance Evaluation 21 (1995) 185–212], the authors solve a limited form of this problem using Green’s function method. More specifically, they give a closed-form solution for a K -server system, when the servers are homogeneous, and for a two-server system, when the servers are heterogeneous; the authors experienced difficulties in extending Green’s function method beyond the case of two heterogeneous servers. Rather than using Green’s function, we solve this problem using the concept of stochastic complementation, which is a more intuitive and more easily extensible method. For the case of a homogeneous multi-server system we are able to derive a closed-form solution for the steady state probability vector; for the remaining cases we give an algorithmic solution. Note, however, that we can use stochastic complementation to derive closed-form solutions for some limited forms of cases (2) and (3), such as heterogeneous servers with K =2 and bulk arrivals with a limited bulk size. Finally, our technique works both for systems with finite and infinite waiting rooms.

[1]  Winfried K. Grassmann Transient solutions in markovian queueing systems , 1977, Comput. Oper. Res..

[2]  Oliver C. Ibe,et al.  An Approximation Method for a Class of Queueing Systems , 1985, Perform. Evaluation.

[3]  Stephen C. Graves,et al.  The Compensation Method Applied to a One-Product Production/Inventory Problem , 1981, Math. Oper. Res..

[4]  Donald F. Towsley,et al.  Approximating the Mean Time in System in a Multiple-Server Queue that Uses Threshold Scheduling , 1987, Oper. Res..

[5]  John C. S. Lui,et al.  Computing bounds on steady state availability of repairable computer systems , 1994, JACM.

[6]  John C. S. Lui,et al.  Bounding of performance measures for a threshold-based queueing system with hysteresis , 1997, SIGMETRICS '97.

[7]  William J. Stewart,et al.  Introduction to the numerical solution of Markov Chains , 1994 .

[8]  Julian Keilson Green's Function Methods in Probability Theory , 1965 .

[9]  Ashok K. Agrawala,et al.  Control of a Heterogeneous Two-Server Exponential Queueing System , 1983, IEEE Transactions on Software Engineering.

[10]  Frank Kelly,et al.  Reversibility and Stochastic Networks , 1979 .

[11]  John A. Morrison Two-server queue with one server idle below a threshold , 1990, Queueing Syst. Theory Appl..

[12]  Carl D. Meyer,et al.  Stochastic Complementation, Uncoupling Markov Chains, and the Theory of Nearly Reducible Systems , 1989, SIAM Rev..

[13]  P. R. Kumar,et al.  Optimal control of a queueing system with two heterogeneous servers , 1984 .

[14]  Donald F. Towsley,et al.  Bounding the Mean Response Time of the Minimum Expected Delay Routing Policy: An Algorithmic Approach , 1995, IEEE Trans. Computers.

[15]  J. Little A Proof for the Queuing Formula: L = λW , 1961 .

[16]  J. Keilson Markov Chain Models--Rarity And Exponentiality , 1979 .

[17]  S. Wittevrongel,et al.  Queueing Systems , 2019, Introduction to Stochastic Processes and Simulation.

[18]  Shang Zhi,et al.  A proof of the queueing formula: L=λW , 2001 .

[19]  Julian Keilson,et al.  Multi-Server Threshold Queues with Hysteresis , 1995, Perform. Evaluation.

[20]  Pierre Semal,et al.  Computable Bounds for Conditional Steady-State Probabilities in Large Markov Chains and Queueing Models , 1986, IEEE J. Sel. Areas Commun..