A symptotic analysis of large heterogeneous queueing systems

As a simple example of a large heterogeneous queueing system, we consider a single queue with many servers with differing service rates. In the limit of infinitely many servers, we identify a queue control policy that minimizes the average system delay. When there are only two possible server speeds, we can analyze the convergence of this policy to optimality. Based on this result, we propose policies for large but finite systems with a general distribution of server speeds.

[1]  D. Jagerman.  Some properties of the erlang loss function , 1974 .

[2]  Ward Whitt,et al.  Deciding Which Queue to Join: Some Counterexamples , 1986, Oper. Res..

[3]  A. Weinrib,et al.  Greed is not enough: adaptive load sharing in large heterogeneous systems , 1988, IEEE INFOCOM '88,Seventh Annual Joint Conference of the IEEE Computer and Communcations Societies. Networks: Evolution or Revolution?.

[4]  G. J. Foschini,et al.  A Basic Dynamic Routing Problem and Diffusion , 1978, IEEE Trans. Commun..

[5]  Shaler Stidham,et al.  Individual versus Social Optimization in Exponential Congestion Systems , 1977, Oper. Res..

[6]  P. R. Kumar,et al.  Optimal control of a queueing system with two heterogeneous servers , 1984 .

[7]  K. Krishnan,et al.  State-dependent routing for telephone traffic: Theory and results , 1986, 1986 25th IEEE Conference on Decision and Control.

[8]  S. Stidham,et al.  Individual versus Social Optimization in the Allocation of Customers to Alternative Servers , 1983 .

[9]  Tak-Shing Peter Yum,et al.  The Join-Biased-Queue Rule and Its Application to Routing in Computer Communication Networks , 1981, IEEE Trans. Commun..

[10]  Jr. Shaler Stidham.  Optimal control of admission to a queueing system , 1985 .

[11]  Ronald A. Howard,et al.  Dynamic Programming and Markov Processes , 1960 .

[12]  Walter H. Kohler,et al.  Models for Dynamic Load Balancing in a Heterogeneous Multiple Processor System , 1979, IEEE Transactions on Computers.

[13]  Gordon F. Newell,et al.  Approximate Stochastic Behavior of n-Server Service Systems with Large n , 1973 .

[14]  Shaler Stidham,et al.  Scheduling, Routing, and Flow Control in Stochastic Networks , 1988 .

[15]  F. Kelly.  Routing in circuit-switched networks: optimization, shadow prices and decentralization , 1988, Advances in Applied Probability.