Steady-state analysis of shortest expected delay routing

We consider a queueing system consisting of two nonidentical exponential servers, where each server has its own dedicated queue and serves the customers in that queue FCFS. Customers arrive according to a Poisson process and join the queue promising the shortest expected delay, which is a natural and near-optimal policy for systems with nonidentical servers. This system can be modeled as an inhomogeneous random walk in the quadrant. By stretching the boundaries of the compensation approach we prove that the equilibrium distribution of this random walk can be expressed as a series of product forms that can be determined recursively. The resulting series expression is directly amenable to numerical calculations and it also provides insight into the asymptotic behavior of the equilibrium probabilities as one of the state coordinates tends to infinity.

[1]  Onno Boxma,et al.  Boundary value problems in queueing system analysis , 1983 .

[2]  Anthony Ephremides,et al.  A simple dynamic routing problem , 1980 .

[3]  Johan van Leeuwaarden,et al.  Erlang arrivals joining the shorter queue , 2013, Queueing Syst. Theory Appl..

[4]  D. McDonald,et al.  Join the shortest queue: stability and exact asymptotics , 2001 .

[5]  G. Fayolle,et al.  Random Walks in the Quarter Plane: Algebraic Methods, Boundary Value Problems, Applications to Queueing Systems and Analytic Combinatorics , 2018 .

[6]  Sayed Atef Banawan,et al.  A comparative study of load sharing in heterogeneous multicomputer systems , 1992, Annual Simulation Symposium.

[7]  Hans Blanc Bad Luck When Joining the Shortest Queue , 2008 .

[8]  Ivo J. B. F. Adan,et al.  Queueing Models with Multiple Waiting Lines , 2001, Queueing Syst. Theory Appl..

[9]  B. Hajek Optimal control of two interacting service stations , 1982, 1982 21st IEEE Conference on Decision and Control.

[10]  On the Oscillation Theorems of Pringsheim and Landau , 2000 .

[11]  Charles Knessl,et al.  ON THE INFINITE SERVER SHORTEST QUEUE PROBLEM: SYMMETRIC CASE , 2005 .

[12]  A. Markushevich Analytic Function Theory , 1996 .

[13]  GuptaVarun,et al.  Analysis of join-the-shortest-queue routing for web server farms , 2007 .

[14]  Shlomo Halfin The shortest queue problem , 1985 .

[15]  N. D. Bruijn Asymptotic methods in analysis , 1958 .

[17]  Hui Li,et al.  Geometric Decay in a QBD Process with Countable Background States with Applications to a Join-the-Shortest-Queue Model , 2007 .

[18]  G. Fayolle,et al.  Random Walks in the Quarter-Plane: Algebraic Methods, Boundary Value Problems and Applications , 1999 .

[19]  J. Cohen Analysis of the asymmetrical shortest two-server queueing model , 1995 .

[20]  Ward Whitt,et al.  Deciding Which Queue to Join: Some Counterexamples , 1986, Oper. Res..

[21]  Ivo J. B. F. Adan,et al.  Shortest expected delay routing for Erlang servers , 1996, Queueing Syst. Theory Appl..

[22]  J. Kingman Two Similar Queues in Parallel , 1961 .

[23]  Ivo J. B. F. Adan,et al.  Approximate performance analysis of generalized join the shortest queue routing , 2015, EAI Endorsed Trans. Ubiquitous Environ..

[24]  Charles Knessl,et al.  On the Shortest Queue Version of the Erlang Loss Model , 2008 .

[25]  H. Gould,et al.  THE GIRARD-WARING POWER SUM FORMULAS FOR SYMMETRIC FUNCTIONS AND FIBONACCI SEQUENCES , 1999 .

[26]  J. Hunter Two Queues in Parallel , 1969 .

[27]  I. J. B. F. Adan,et al.  A compensation approach for two-dimensional Markov processes , 1993, Advances in Applied Probability.

[28]  Ivo J. B. F. Adan,et al.  Analysis of the symmetric shortest queue problem , 1990 .

[29]  J. D. Smit The queue GI/M/s with customers of different types or the queue GI/Hm/s , 1983 .