Approximate performance analysis of generalized join the shortest queue routing

In this paper we propose a highly accurate approximate performance analysis of a heterogeneous server system with a processor sharing service discipline and a general job-size distribution under a generalized join the shortest queue (GJSQ) routing protocol. The GJSQ routing protocol is a natural extension of the well-known join the shortest queue routing policy that takes into account the non-identical service rates in addition to the number of jobs at each server. The performance metrics that are of interest here are the equilibrium distribution and the mean and standard deviation of the number of jobs at each server. We show that the latter metrics are near-insensitive to the job-size distribution using simulation experiments. By applying a single queue approximation we model each server as a single server queue with a state-dependent arrival process, independent of other servers in the system, and derive the distribution of the number of jobs at the server. These state-dependent arrival rates are intended to capture the inherent correlation between servers in the original system and behave in a rather atypical way.

[1]  Esa Hyytiä,et al.  Size- and state-aware dispatching problem with queue-specific job sizes , 2012, Eur. J. Oper. Res..

[2]  Mark S. Squillante,et al.  On maximizing service-level-agreement profits , 2001, PERV.

[3]  Johan van Leeuwaarden,et al.  Steady-state analysis of shortest expected delay routing , 2015, Queueing Systems.

[4]  Randolph D. Nelson,et al.  An approximation to the response time for shortest queue routing , 1989, SIGMETRICS '89.

[5]  Donald F. Towsley,et al.  Bounding the Mean Response Time of the Minimum Expected Delay Routing Policy: An Algorithmic Approach , 1995, IEEE Trans. Computers.

[6]  C. Laws Resource pooling in queueing networks with dynamic routing , 1992, Advances in Applied Probability.

[7]  G. J. Foschini,et al.  A Basic Dynamic Routing Problem and Diffusion , 1978, IEEE Trans. Commun..

[8]  Mor Harchol-Balter,et al.  Performance Modeling and Design of Computer Systems: Queueing Theory in Action , 2013 .

[9]  Mor Harchol-Balter,et al.  Size-based scheduling to improve web performance , 2003, TOCS.

[10]  John Zahorjan,et al.  Load sharing in heterogeneous queueing systems , 1989, IEEE INFOCOM '89, Proceedings of the Eighth Annual Joint Conference of the IEEE Computer and Communications Societies.

[11]  Philip S. Yu,et al.  The state of the art in locally distributed Web-server systems , 2002, CSUR.

[12]  W. Whitt,et al.  Analysis of join-the-shortest-queue routing for web server farms , 2007, Perform. Evaluation.

[14]  Urtzi Ayesta,et al.  Load balancing in processor sharing systems , 2011, Telecommun. Syst..

[15]  Ward Whitt,et al.  Deciding Which Queue to Join: Some Counterexamples , 1986, Oper. Res..