Queueing analysis of network traffic: methodology and visualization tools

In this paper we provide a framework for analyzing network traffic traces through trace-driven queueing. We also introduce several queueing metrics together with the associated visualization tools (some novel) that provide insight into the traffic features and facilitate comparisons between traces. Some techniques for non-stationary data are discussed. Applying our framework to both real and synthetic traces we (i) illustrate how to compare traces using trace-driven queueing, and (ii) show that traces that look ''similar'' under various statistical measures (such as the Hurst index) can exhibit rather different behavior under queueing simulation.

[1]  Fouad A. Tobagi,et al.  Provisioning IP backbone networks to support latency sensitive traffic , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[2]  Richard G. Baraniuk,et al.  Multiscale queuing analysis of long-range-dependent network traffic , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[3]  Laurent Massoulié,et al.  Large buffer asymptotics for the queue with fractional brownian input , 1999 .

[4]  Dimitrios Hatzinakos,et al.  Network heavy traffic modeling using α-stable self-similar processes , 2001, IEEE Trans. Commun..

[5]  John S. Heidemann,et al.  A framework for classifying denial of service attacks , 2003, SIGCOMM '03.

[6]  Murad S. Taqqu,et al.  Theory and applications of long-range dependence , 2003 .

[7]  Peter B. Danzig,et al.  A measurement-based admission control algorithm for integrated service packet networks , 1997, TNET.

[8]  S. Resnick,et al.  Is network traffic approximated by stable Levy motion or fractional Brownian motion , 2002 .

[9]  Ilkka Norros.  Queueing Behavior Under Fractional Brownian Traffic , 2002 .

[10]  Walter Willinger,et al.  On the self-similar nature of Ethernet traffic , 1993, SIGCOMM '93.

[11]  Félix Hernández-Campos,et al.  How Real Can Synthetic Network Traffic Be , 2001 .

[12]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[13]  Ilkka Norros,et al.  A storage model with self-similar input , 1994, Queueing Syst. Theory Appl..

[14]  Mark Handley,et al.  Congestion control for high bandwidth-delay product networks , 2002, SIGCOMM '02.

[15]  Athina P. Petropulu,et al.  Long-range dependence and heavy-tail modeling for teletraffic data , 2002, IEEE Signal Process. Mag..

[16]  Kevin Jeffay,et al.  Modeling and generating TCP application workloads , 2007, 2007 Fourth International Conference on Broadband Communications, Networks and Systems (BROADNETS '07).

[17]  David D. Denison,et al.  Nonlinear estimation and classification , 2003 .

[18]  Desmond P. Taylor,et al.  On the SelfSimilar Nature of Ethernet Traffic (Extended Version) , 2007 .

[19]  J. Hüsler,et al.  Extremes of a certain class of Gaussian processes , 1999 .

[20]  S. Asmussen,et al.  Applied Probability and Queues , 1989 .

[21]  Sally Floyd,et al.  Wide area traffic: the failure of Poisson modeling , 1995, TNET.

[22]  Walter Willinger,et al.  Self-similarity through high-variability: statistical analysis of Ethernet LAN traffic at the source level , 1997, TNET.

[23]  A. W. Kemp,et al.  Applied Probability and Queues , 1989 .

[24]  Jin Cao,et al.  Internet Traffic Tends Toward Poisson and Independent as the Load Increases , 2003 .

[25]  Walter Willinger,et al.  Experimental queueing analysis with long-range dependent packet traffic , 1996, TNET.

[26]  Murad S. Taqqu.  The Modelling of Ethernet Data and of Signals that are Heavy‐tailed with Infinite Variance* , 2002 .

[27]  François Baccelli,et al.  Elements Of Queueing Theory , 1994 .

[28]  Nick Duffield,et al.  Large deviations and overflow probabilities for the general single-server queue, with applications , 1995 .

[29]  Walter Willinger,et al.  Self-Similar Network Traffic and Performance Evaluation , 2000 .

[30]  Luigi Rizzo,et al.  Dummynet: a simple approach to the evaluation of network protocols , 1997, CCRV.

[31]  Kevin Jeffay,et al.  Generating Realistic TCP Workloads , 2004, Int. CMG Conference.

[32]  Anja Feldmann,et al.  TCP/IP traffic dynamics and network performance: a lesson in workload modeling, flow control, and trace-driven simulations , 2001, CCRV.

[33]  Zhi-Li Zhang,et al.  Small-time scaling behaviors of Internet backbone traffic: an empirical study , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[34]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1951 .

[35]  Vern Paxson,et al.  Fast, approximate synthesis of fractional Gaussian noise for generating self-similar network traffic , 1997, CCRV.

[36]  Donald F. Towsley,et al.  On designing improved controllers for AQM routers supporting TCP flows , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[37]  Ilkka Nomos.  On the Use of Fractional Brownian Motion in the Theory of Connectionless Networks , 1995 .

[38]  Michalis Faloutsos,et al.  A nonstationary Poisson view of Internet traffic , 2004, IEEE INFOCOM 2004.

[39]  D. Rolls.  Limit Theorems and Estimation for Structural and Aggregate Teletraffic Models , 2003 .

[40]  Jean C. Walrand,et al.  Effective bandwidths for multiclass Markov fluids and other ATM sources , 1993, TNET.

[41]  Debasis Mitra,et al.  Effective bandwidth of general Markovian traffic sources and admission control of high speed networks , 1993, IEEE INFOCOM '93 The Conference on Computer Communications, Proceedings.

[42]  V. Jacobson,et al.  Congestion avoidance and control , 1988, CCRV.

[43]  P. Glynn,et al.  Logarithmic asymptotics for steady-state tail probabilities in a single-server queue , 1994, Journal of Applied Probability.

[44]  QUTdN QeO,et al.  Random early detection gateways for congestion avoidance , 1993, TNET.

[45]  Walter Willinger,et al.  Proof of a fundamental result in self-similar traffic modeling , 1997, CCRV.

[46]  Patrice Abry,et al.  Wavelet Analysis of Long-Range-Dependent Traffic , 1998, IEEE Trans. Inf. Theory.

[47]  Michael Devetsikiotis,et al.  In search of better statistics for traffic characterization , 1999, J. Braz. Comput. Soc..

[48]  Fernando Paganini,et al.  Internet congestion control , 2002 .

[49]  Samuel Karlin,et al.  A First Course on Stochastic Processes , 1968 .

[50]  Sally Floyd,et al.  Difficulties in simulating the internet , 2001, TNET.