On multiplexing flows: Does it hurt or not?

This paper analyzes queueing behavior subject to multiplexing a stochastic process M(n) of flows, and not a constant as conventionally assumed. By first considering the case when M(n) is iid, it is shown that flows' multiplexing `hurts' the queue size (i.e., the queue size increases in distribution). The simplicity of the iid case enables the quantification of the `best' and `worst' distributions of M(n), i.e., minimizing/maximizing the queue size. The more general, and also realistic, case when M(n) is Markov-modulated reveals an interesting behavior: flows' multiplexing `hurts' but only when the multiplexed flows are sufficiently long. An important caveat raised by such observations is that the conventional approximation of M(n) by a constant can be very misleading for queueing analysis.

[1]  Nick G. Duffield,et al.  Exponential bounds for queues with Markovian arrivals , 1994, Queueing Syst. Theory Appl..

[2]  M. L. Chaudhry,et al.  A first course in bulk queues , 1983 .

[3]  B. A. Rogozin Some Extremal Problems in the Theory of Mass Service , 1966 .

[4]  Bruce E. Hajek,et al.  The Proof of a Folk Theorem on Queuing Delay with Applications to Routing in Networks , 1983, JACM.

[5]  Frank Kelly,et al.  Networks of queues with customers of different types , 1975, Journal of Applied Probability.

[6]  Nikhil Bansal Analysis of the M/G/1 processor-sharing queue with bulk arrivals , 2003, Oper. Res. Lett..

[7]  Søren Asmussen,et al.  Does Markov-Modulation Increase the Risk? , 1995, ASTIN Bulletin.

[8]  K. Mani Chandy,et al.  Open, Closed, and Mixed Networks of Queues with Different Classes of Customers , 1975, JACM.

[9]  W. Whitt On approximations for queues, I: Extremal distributions , 1984, AT&T Bell Laboratories Technical Journal.

[10]  Stephen S. Lavenberg,et al.  Mean-Value Analysis of Closed Multichain Queuing Networks , 1980, JACM.

[11]  David D. Yao,et al.  On bounds for bulk arrival queues , 1984 .

[12]  Ward Whitt,et al.  The effect of variability in the GI/G/s queue , 1980, Journal of Applied Probability.

[13]  David Gamarnik,et al.  Performance Analysis of Queueing Networks via Robust Optimization , 2010, Oper. Res..

[14]  Yong Liu,et al.  Stochastic Network Calculus , 2008 .

[15]  MassouliéLaurent,et al.  Impact of fairness on Internet performance , 2001 .

[16]  Ravi Mazumdar,et al.  Performance Modeling, Loss Networks, and Statistical Multiplexing , 2010, Performance Modeling, Loss Networks, and Statistical Multiplexing.

[17]  Ward Whitt,et al.  Waiting-time tail probabilities in queues with long-tail service-time distributions , 1994, Queueing Syst. Theory Appl..

[18]  Cheng-Shang Chang,et al.  Performance guarantees in communication networks , 2000, Eur. Trans. Telecommun..

[19]  Thomas E. Stern,et al.  Analysis of separable Markov-modulated rate models for information-handling systems , 1991, Advances in Applied Probability.

[20]  S. Ross Bounds on the delay distribution in GI/G/1 queues , 1974, Journal of Applied Probability.

[21]  2015 IEEE Conference on Computer Communications, INFOCOM 2015, Kowloon, Hong Kong, April 26 - May 1, 2015 , 2015, IEEE Conference on Computer Communications.

[22]  C. D. Litton,et al.  A First Course in Bulk Queues , 1983 .

[23]  S. Ross Average delay in queues with non-stationary Poisson arrivals , 1978, Journal of Applied Probability.

[24]  Armand M. Makowski,et al.  Simple Proofs of Some Folk Theorems for Parallel Queues. , 1989 .

[25]  Hideaki Takagi,et al.  Priority queues with batch Poisson arrivals , 1991, Oper. Res. Lett..

[26]  Jeffrey P. Buzen,et al.  Computational algorithms for closed queueing networks with exponential servers , 1973, Commun. ACM.

[27]  J. Schmitt,et al.  Perspectives on network calculus: no free lunch, but still good value , 2012, SIGCOMM '12.

[28]  P. J. Burke Technical Note - Delays in Single-Server Queues with Batch Input , 1975, Oper. Res..

[29]  Laurent Massoulié,et al.  Impact of fairness on Internet performance , 2001, SIGMETRICS '01.

[30]  Tomasz Rolski,et al.  A MONOTONICITY RESULT FOR THE WORKLOAD IN MARKOV-MODULATED QUEUES , 1998 .

[31]  Mor Harchol-Balter,et al.  Bounding delays in packet-routing networks , 1995, STOC '95.

[32]  Stochastic Orders , 2008 .

[33]  Ana Busic,et al.  Worst Case Analysis of Batch Arrivals with the Increasing Convex Ordering , 2006, EPEW.

[34]  Ness B. Shroff,et al.  Improved loss calculations at an ATM multiplexer , 1998, TNET.

[35]  Søren Asmussen,et al.  On the Tail of the Waiting Time in a Markov-Modulated M/G/1 Queue , 2002, Oper. Res..

[36]  Kai Furmans,et al.  An analytical method for the calculation of the waiting time distribution of a discrete time G/G/1-queueing system with batch arrivals , 2007, OR Spectr..

[37]  T. Bonald,et al.  Flow-level Stability of Utility-Based Allocations for Non-Convex Rate Regions , 2006, 2006 40th Annual Conference on Information Sciences and Systems.

[38]  W. Whitt Comparison conjectures about the M/G/ s queue , 1983 .

[39]  Ward Whitt,et al.  Squeezing the Most Out of ATM , 1995, IEEE Trans. Commun..

[40]  Alexandre Proutière,et al.  Statistical bandwidth sharing: a study of congestion at flow level , 2001, SIGCOMM.

[41]  Donald F. Towsley,et al.  Exponential bounds with applications to call admission , 1997, JACM.

[42]  H. Vincent Poor,et al.  Stability, Fairness, and Performance: A Flow-Level Study on Nonconvex and Time-Varying Rate Regions , 2009, IEEE Transactions on Information Theory.

[43]  Gustavo de Veciana,et al.  Stability and performance analysis of networks supporting services with rate control-could the Internet be unstable? , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[44]  J. Kingman A martingale inequality in the theory of queues , 1964 .

[45]  Pierre A. Humblet,et al.  Determinism minimizes waiting time in queues , 1982 .

[46]  Laurent Massoulié,et al.  Bandwidth sharing and admission control for elastic traffic , 2000, Telecommun. Syst..

[47]  D. Mitra,et al.  Stochastic theory of a data-handling system with multiple sources , 1982, The Bell System Technical Journal.

[48]  Frank Kelly,et al.  Notes on effective bandwidths , 1994 .

[49]  CiucuFlorin,et al.  Perspectives on network calculus , 2012 .

[50]  J. Tsitsiklis,et al.  The worst bulk arrival process to a queue , 1992 .