Allocation of Service Time in a Multiserver System

Reducing congestion is a primary concern in the design and analysis of queueing networks, especially in systems where sources of randomness are characterized by high variability. This paper considers a multiserver first-come, first-served (FCFS) queueing model where we arrange servers in two stations in series. All arrivals join the first service center, where they receive a maximum of T units of service. Arrivals with service requirements that exceed the threshold T join the second queue, where they receive their remaining service. For a variety of heavy tail service time distributions, characterized by large coefficient of variations, analytical and numerical comparisons show that our scheme provides better system performance than the standard parallel multiserver model in the sense of reducing the mean delay per customer in heavy traffic systems. Our model is likely to be useful in systems where high variability is a cause for degradation and where numerous service interruptions are not desired.

[1]  S. A. Nozaki,et al.  Approximations in finite-capacity multi-server queues by Poisson arrivals , 1978, Journal of Applied Probability.

[2]  Mor Harchol-Balter Task assignment with unknown duration , 2002, JACM.

[3]  J. Wolfowitz,et al.  On the Characteristics of the General Queueing Process, with Applications to Random Walk , 1956 .

[4]  W. D. Ray,et al.  Stochastic Models: An Algorithmic Approach , 1995 .

[5]  Alan Scheller-Wolf,et al.  Delay moments for FIFO GI/GI/s queues , 1997, Queueing Syst. Theory Appl..

[6]  Technical Note - Some Simpler Bounds on the Mean Queuing Time , 1978, Oper. Res..

[7]  Mor Harchol-Balter,et al.  On Choosing a Task Assignment Policy for a Distributed Server System , 1998, J. Parallel Distributed Comput..

[8]  Ralph L. Disney,et al.  Traffic processes in queueing networks: a Markov renewal approach , 1987 .

[9]  Eric Torng,et al.  New directions in machine scheduling , 2000 .

[10]  John N. Daigle,et al.  A Little's Result Approach to the Service Constrained Spares Provisioning Problem for Repairable Items , 1997, Oper. Res..

[11]  J. Medhi,et al.  Stochastic models in queueing theory , 1991 .

[12]  A. Federgruen,et al.  Approximations for the steady-state probabilities in the M/G/c queue , 1981, Advances in Applied Probability.

[13]  Ward Whitt,et al.  Approximating a point process by a renewal process , 1981 .

[14]  Jon W. Mark,et al.  Approximation of the Mean Queue Length of an M/G/c Queueing System , 1995, Oper. Res..

[15]  Ward Whitt,et al.  Understanding the Efficiency of Multi-Server Service Systems , 1992 .

[16]  John A. Buzacott,et al.  Commonalities in Reengineered Business Processes: Models and Issues , 1996 .

[17]  Ward Whitt,et al.  Partitioning Customers Into Service Groups , 1999 .

[18]  Nadim E. Abboud,et al.  The Markovian Two-echelon Repairable Item Provisioning Problem , 1996 .

[19]  Ward Whitt,et al.  Departures from a Queue with Many Busy Servers , 1984, Math. Oper. Res..

[20]  Per Hokstad,et al.  Approximations for the M/G/m Queue , 1978, Oper. Res..

[21]  Ward Whitt,et al.  Approximating a Point Process by a Renewal Process, I: Two Basic Methods , 1982, Oper. Res..

[22]  Toshikazu Kimura A two-moment approximation for the mean waiting time in the GI/G/s queue , 1985 .

[23]  G. Cosmetatos Notes Approximate Explicit Formulae For The Average Queueing Time In The Processes (M/D/r) and (D/M/r) , 1975 .

[24]  Muhammad El-Taha,et al.  Allocation of service time in a two-server system , 2003, Comput. Oper. Res..

[25]  Sheldon M. Ross,et al.  Introduction to Probability Models, Eighth Edition , 1972 .

[26]  W. Whitt Planning queueing simulations , 1989 .

[27]  Carl M. Harris,et al.  Fundamentals of queueing theory (2nd ed.). , 1985 .

[28]  Martin J. Fischer,et al.  Using quantile estimates in simulating Internet queues with Pareto service times , 2001, Proceeding of the 2001 Winter Simulation Conference (Cat. No.01CH37304).

[29]  W. Whitt,et al.  The Queueing Network Analyzer , 1983, The Bell System Technical Journal.

[30]  Alan Scheller-Wolf,et al.  New bounds for expected delay in FIFO M/G/c queues , 1997, Queueing Syst. Theory Appl..

[31]  Avishai Mandelbaum,et al.  On Pooling in Queueing Networks , 1998 .