Global Modeling and Prediction of Computer Network Traffic

We develop a probabilistic framework for global modeling of the traffic over a computer network. This model integrates existing single-link (-flow) traffic models with the routing over the network to capture the global traffic behavior. It arises from a limit approximation of the traffic fluctuations as the time--scale and the number of users sharing the network grow. The resulting probability model is comprised of a Gaussian and/or a stable, infinite variance components. They can be succinctly described and handled by certain 'space-time' random fields. The model is validated against simulated and real data. It is then applied to predict traffic fluctuations over unobserved links from a limited set of observed links. Further, applications to anomaly detection and network management are briefly discussed.

[1]  Alfio Lombardo,et al.  A novel analytical framework compounding statistical traffic modeling and aggregate-level service curve disciplines: network performance and efficiency implications , 2004, IEEE/ACM Transactions on Networking.

[2]  Murad S. Taqqu,et al.  Semi-parametric estimation of the long-range dependence parameter : A survey , 2003 .

[3]  Gennady Samorodnitsky,et al.  Scaling Limits for Cumulative Input Processes , 2007, Math. Oper. Res..

[4]  Patrice Abry,et al.  Wavelet Analysis of Long-Range-Dependent Traffic , 1998, IEEE Trans. Inf. Theory.

[5]  M. Crovella,et al.  Heavy-tailed probability distributions in the World Wide Web , 1998 .

[6]  Patrice Abry,et al.  Cluster processes: a natural language for network traffic , 2003, IEEE Trans. Signal Process..

[7]  Gennady Samorodnitsky,et al.  Limit Behavior of Fluid Queues and Networks , 2005, Oper. Res..

[8]  Walter Willinger,et al.  Self-Similar Network Traffic and Performance Evaluation , 2000 .

[9]  Murad S. Taqqu,et al.  Wavelet Estimation for the Hurst Parameter in Stable Processes , 2003 .

[10]  Murad S. Taqqu,et al.  Semi-parametric graphical estimation techniques for long-memory data. , 1996 .

[11]  Walter Willinger,et al.  Self-similarity through high-variability: statistical analysis of Ethernet LAN traffic at the source level , 1997, TNET.

[12]  S. Resnick,et al.  Activity rates with very heavy tails , 2006 .

[13]  Parag Pruthi,et al.  Self-Similarity in High-Speed Network Traffic Measurements: Fact or Artifact? , 1995 .

[14]  Azer Bestavros,et al.  Self-similarity in World Wide Web traffic: evidence and possible causes , 1996, SIGMETRICS '96.

[15]  Félix Hernández-Campos,et al.  Queueing analysis of network traffic: methodology and visualization tools , 2005, Comput. Networks.

[16]  Murad S. Taqqu,et al.  On the Self-Similar Nature of Ethernet Traffic , 1993, SIGCOMM.

[17]  Murad S. Taqqu,et al.  Asymptotic self‐similarity and wavelet estimation for long‐range dependent fractional autoregressive integrated moving average time series with stable innovations , 2005 .

[18]  Vijayan N. Nair,et al.  Network tomography: A review and recent developments , 2006 .

[19]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .

[20]  Zhi-Li Zhang,et al.  Profiling internet backbone traffic: behavior models and applications , 2005, SIGCOMM '05.

[21]  G. Smaragdakis,et al.  Spatio-Temporal Network Anomaly Detection by Assessing Deviations of Empirical Measures , 2009, IEEE/ACM Transactions on Networking.

[22]  Peter G. Harrison,et al.  Network traffic behaviour in switched Ethernet systems , 2002, Proceedings. 10th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunications Systems.

[23]  Mark Crovella,et al.  Network Kriging , 2005, IEEE Journal on Selected Areas in Communications.

[24]  Walter Willinger,et al.  Proof of a fundamental result in self-similar traffic modeling , 1997, CCRV.

[25]  G. Michailidis,et al.  Identifiability of flow distributions from link measurements with applications to computer networks , 2007 .

[26]  Kihong Park,et al.  On the relationship between file sizes, transport protocols, and self-similar network traffic , 1996, Proceedings of 1996 International Conference on Network Protocols (ICNP-96).

[27]  Konstantina Papagiannaki,et al.  Structural analysis of network traffic flows , 2004, SIGMETRICS '04/Performance '04.

[28]  Walter Willinger,et al.  On the Self-Similar Nature of Ethernet Traffic ( extended version ) , 1995 .

[29]  J. S. Marron,et al.  LASS: a tool for the local analysis of self-similarity , 2006, Comput. Stat. Data Anal..

[30]  Vladas Pipiras,et al.  Estimation of the self-similarity parameter in linear fractional stable motion , 2002, Signal Process..

[31]  Nick Duffield,et al.  Sampling for Passive Internet Measurement: A Review , 2004 .

[32]  S. Resnick,et al.  Is network traffic approximated by stable Levy motion or fractional Brownian motion , 2002 .

[33]  Noel A Cressie,et al.  Statistics for Spatial Data, Revised Edition. , 1994 .

[34]  António Pacheco,et al.  An integrated traffic model for multimedia wireless networks , 2002, Comput. Networks.

[35]  I. Kaj,et al.  Convergence of scaled renewal processes and a packet arrival model , 2003 .

[36]  M. Taqqu,et al.  Slow, fast and arbitrary growth conditions for renewal-reward processes when both the renewals and the rewards are heavy-tailed , 2004 .

[37]  Lili Yang,et al.  Sampled Based Estimation of Network Traffic Flow Characteristics , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[38]  J. S. Marron,et al.  On the wavelet spectrum diagnostic for Hurst parameter estimation in the analysis of Internet traffic , 2005, Comput. Networks.

[39]  Peter G. Harrison,et al.  Network traffic behaviour in switched Ethernet systems , 2004, Perform. Evaluation.

[40]  Donald F. Towsley,et al.  Self-similarity and long range dependence on the internet: a second look at the evidence, origins and implications , 2005, Comput. Networks.