Long-range dependence and heavy-tail modeling for teletraffic data

The analysis and modeling of computer network traffic is a daunting task considering the amount of available data. This is quite obvious when considering the spatial dimension of the problem, since the number of interacting computers, gateways and switches can easily reach several thousands, even in a local area network (LAN) setting. This is also true for the time dimension: Willinger and Paxson (see Ann. Statist., vol.25, no.5, p.1856-66, 1997) cite the figures of 439 million packets and 89 gigabytes of data for a single week record of the activity of a university gateway in 1995. The complexity of the problem further increases when considering wide area network (WAN) data. In light of the above, it is clear that a notion of importance for modern network engineering is that of invariants, i.e., characteristics that are observed with some reproducibility and independently of the precise settings of the network under consideration. In this tutorial article, we focus on two such invariants related to the time dimension of the problem, namely, long-range dependence, or self-similarity, and heavy-tail marginal distributions.

[1]  Walter Willinger,et al.  Long-range dependence in variable-bit-rate video traffic , 1995, IEEE Trans. Commun..

[2]  Clifford M. Hurvich,et al.  An Efficient Taper for Potentially Overdifferenced Long‐memory Time Series , 1998 .

[3]  Liudas Giraitis,et al.  Adaptive Semiparametric Estimation of the Memory Parameter , 2000 .

[4]  Athina P. Petropulu,et al.  The extended alternating fractal renewal process for modeling traffic in high-speed communication networks , 2001, IEEE Trans. Signal Process..

[5]  É. Moulines,et al.  Broadband log-periodogram regression of time series with long-range dependence , 1999 .

[6]  C. Granger,et al.  AN INTRODUCTION TO LONG‐MEMORY TIME SERIES MODELS AND FRACTIONAL DIFFERENCING , 1980 .

[7]  Walter Willinger,et al.  On the self-similar nature of Ethernet traffic , 1993, SIGCOMM '93.

[8]  J. Geweke,et al.  THE ESTIMATION AND APPLICATION OF LONG MEMORY TIME SERIES MODELS , 1983 .

[9]  Richard A. Davis,et al.  Limit Theory for the Sample Covariance and Correlation Functions of Moving Averages , 1986 .

[10]  R. J. Bhansali,et al.  Estimation of the Long-Memory Parameter: A Review of Recent Developments and an Extension , 2001 .

[11]  S. Resnick,et al.  Empirical Testing Of The Infinite Source Poisson Data Traffic Model , 2003 .

[12]  Liudas Giraitis,et al.  RATE OPTIMAL SEMIPARAMETRIC ESTIMATION OF THE MEMORY PARAMETER OF THE GAUSSIAN TIME SERIES WITH LONG‐RANGE DEPENDENCE , 1997 .

[13]  Richard G. Baraniuk,et al.  Multiscale nature of network traffic , 2002, IEEE Signal Process. Mag..

[14]  Matthias Grossglauser,et al.  On the relevance of long-range dependence in network traffic , 1996, SIGCOMM '96.

[15]  Athina P. Petropulu,et al.  Power-Law Shot Noise and Its Relationship To Long-Memory �-Stable Processes , 2000 .

[16]  S. Resnick,et al.  Is network traffic approximated by stable Levy motion or fractional Brownian motion , 2002 .

[17]  Piotr Kokoszka,et al.  Can One Use the Durbin–Levinson Algorithm to Generate Infinite Variance Fractional ARIMA Time Series? , 2001 .

[18]  Walter Willinger,et al.  Self-similarity through high-variability: statistical analysis of Ethernet LAN traffic at the source level , 1997, TNET.

[19]  Dimitrios Hatzinakos,et al.  Network heavy traffic modeling using α-stable self-similar processes , 2001, IEEE Trans. Commun..

[20]  Teich,et al.  Fractal renewal processes generate 1/f noise. , 1993, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[21]  Sally Floyd,et al.  Wide-area traffic: the failure of Poisson modeling , 1994 .

[22]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .

[23]  Marc Henry,et al.  Robust Automatic Bandwidth for Long Memory , 2001 .

[24]  Walter Willinger,et al.  Proof of a fundamental result in self-similar traffic modeling , 1997, CCRV.

[25]  Azer Bestavros,et al.  Self-similarity in World Wide Web traffic: evidence and possible causes , 1996, SIGMETRICS '96.

[26]  Jan Beran,et al.  Statistics for long-memory processes , 1994 .

[27]  C. L. Nikias,et al.  Signal processing with alpha-stable distributions and applications , 1995 .

[28]  Jacek Ilow.  Forecasting network traffic using FARIMA models with heavy tailed innovations , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[29]  B. M. Hill,et al.  A Simple General Approach to Inference About the Tail of a Distribution , 1975 .

[30]  Eric Moulines,et al.  Adaptive estimation of the fractional differencing coefficient , 2001 .

[31]  Murad S. Taqqu,et al.  On estimating the intensity of long-range dependence in finite and infinite variance time series , 1998 .

[32]  S. Resnick.  Heavy tail modeling and teletraffic data: special invited paper , 1997 .

[33]  Benoit B. Mandelbrot,et al.  Fractal Geometry of Nature , 1984 .

[34]  H. E. Hurst,et al.  Long-Term Storage Capacity of Reservoirs , 1951 .

[35]  Gennady Samorodnitsky,et al.  Heavy Tails and Long Range Dependence in On/Off Processes and Associated Fluid Models , 1998, Math. Oper. Res..

[36]  Eric Moulines,et al.  The FEXP estimator for potentially non-stationary linear time series , 2002 .

[37]  Zhen Liu,et al.  Traffic model and performance evaluation of Web servers , 2001, Perform. Evaluation.

[38]  Sidney I. Resnick,et al.  Heavy Tail Modelling and Teletraffic Data , 1995 .

[39]  Walter Willinger,et al.  Self-similarity through high-variability: statistical analysis of Ethernet LAN traffic at the source level , 1997, TNET.

[40]  T. V. Lakshman,et al.  What are the implications of long-range dependence for VBR-video traffic engineering? , 1996, TNET.

[41]  Walter Willinger,et al.  Analysis, modeling and generation of self-similar VBR video traffic , 1994, SIGCOMM.

[42]  Barnes.  Discussion of the Paper , 1961, Public health papers and reports.

[43]  M. Taqqu,et al.  Stable Non-Gaussian Random Processes : Stochastic Models with Infinite Variance , 1995 .

[44]  Richard G. Baraniuk,et al.  Wavelet and Multiscale Analysis of Network Traffic , 2002 .