Long range dependence in Internet backbone traffic

We report the first statistical analysis of Internet backbone traffic, based on traces with levels of aggregation 10 times larger and timestamp accuracy 1000 times better than in previous studies. We analyze the first three moments, marginal distributions and correlation structures of packet size, packet inter-arrival time, byte count and packet count, and find that the highly aggregated Internet backbone traffic is still long-range dependent and self-similar. In fact, all time series examined (packet size, inter-arrival time, byte count, packet count) exhibit long-range dependency and self-similarity. In addition to the now-classical analysis at large time-scales (> 100 ms), we report the first statistically relevant results on the short-term correlation ([50 /spl mu/s, 10 ms]) of byte and packet count processes. We also study fitness of various analytical models to the traffic traces. The empirical queuing analysis confirms the long-range dependence detected through direct analysis by showing that the queue behavior at high level of aggregation still diverges greatly from that predicted by Poisson model. As expected, statistical multiplexing gains improve the queuing performance, leading to economy of scale.

[1]  Walter Willinger,et al.  Self-similarity and heavy tails: structural modeling of network traffic , 1998 .

[2]  Sally Floyd,et al.  Wide-area traffic: the failure of Poisson modeling , 1994 .

[3]  Walter Willinger,et al.  Long-range dependence in variable-bit-rate video traffic , 1995, IEEE Trans. Commun..

[4]  Murad S. Taqqu,et al.  On the Self-Similar Nature of Ethernet Traffic , 1993, SIGCOMM.

[5]  Ilkka Norros,et al.  On the Use of Fractional Brownian Motion in the Theory of Connectionless Networks , 1995, IEEE J. Sel. Areas Commun..

[6]  Jin Cao,et al.  Internet Traffic Tends Toward Poisson and Independent as the Load Increases , 2003 .

[7]  Walter Willinger,et al.  Experimental queueing analysis with long-range dependent packet traffic , 1996, TNET.

[8]  Walter Willinger,et al.  Statistical analysis of CCSN/SS7 traffic data from working CCS subnetworks , 1994, IEEE J. Sel. Areas Commun..

[9]  Walter Willinger,et al.  Self-similarity through high-variability: statistical analysis of Ethernet LAN traffic at the source level , 1997, TNET.

[10]  Dimitri P. Bertsekas,et al.  Data Networks , 1986 .

[11]  Walter Willinger,et al.  Self-similarity through high-variability: statistical analysis of Ethernet LAN traffic at the source level , 1997, TNET.

[12]  Azer Bestavros,et al.  Self-similarity in World Wide Web traffic: evidence and possible causes , 1996, SIGMETRICS '96.

[13]  Jan Beran,et al.  Statistics for long-memory processes , 1994 .

[14]  W. Willinger,et al.  ESTIMATORS FOR LONG-RANGE DEPENDENCE: AN EMPIRICAL STUDY , 1995 .

[15]  Arnold L. Neidhardt,et al.  The concept of relevant time scales and its application to queuing analysis of self-similar traffic (or is Hurst naughty or nice?) , 1998, SIGMETRICS '98/PERFORMANCE '98.

[16]  Sally Floyd,et al.  Why we don't know how to simulate the Internet , 1997, WSC '97.

[17]  Alfred C. Weaver,et al.  Statistical characterization of wide-area IP traffic , 1997, Proceedings of Sixth International Conference on Computer Communications and Networks.

[18]  R. Wilder,et al.  Wide-area Internet traffic patterns and characteristics , 1997, IEEE Netw..

[19]  Walter Willinger,et al.  On the Self-Similar Nature of Ethernet Traffic ( extended version ) , 1995 .