On the complexity of Internet traffic dynamics on its topology

Most studies of Internet traffic rely on observations from a single link. The corresponding traffic dynamics has been studied for more than a decade and is well understood. The study of how traffic on the Internet topology, on the other hand, is poorly understood and has been largely limited to the distribution of traffic among source-destination pairs inside the studied network, also called the traffic matrix. In this paper, we make a first step towards understanding the way traffic gets distributed onto the whole topology of the Internet. For this, we rely on the traffic seen by a transit network, for a period of more than a week. As we are still at the stage of understanding the topological traffic distribution, we do not try to model the traffic dynamics. Rather we concentrate on understanding the complexity of describing the traffic observed by a transit network, how it maps onto the AS-level topology of the Internet and how it changes over time. For this, we rely on well-known tools of multi-variate analysis and multi-resolution analysis.Our first observation is that the structure of the Internet topology highly impacts the traffic distribution. Second, our attempts at compressing the traffic on the topology through dimension reduction suggests two options for traffic modeling: (1) to ignore links on the topology for which we do not see much traffic, or (2) to ignore time scales smaller than a few hours. In either case, important properties of the traffic might be lost, so might not be an option to build realistic models of Internet traffic.Realistic models of Internet traffic on the topology are not out of reach though. In this paper, we identify two properties such models should have: (1) use a compact representation of the dependencies of the traffic on the topology, and (2) be able to capture the complex multi-scale nature of traffic dynamics on different types of links.

[1]  Steve Uhlig,et al.  Modeling the routing of an autonomous system with C-BGP , 2005, IEEE Network.

[2]  Richard G. Baraniuk,et al.  Multiscale nature of network traffic , 2002, IEEE Signal Process. Mag..

[3]  Jacek Kowalski,et al.  Modelling Traffic Demand Between Nodes in a Telecommunications Network , 1995 .

[4]  Will E. Leland,et al.  High time-resolution measurement and analysis of LAN traffic: Implications for LAN interconnection , 1991, IEEE INFCOM '91. The conference on Computer Communications. Tenth Annual Joint Comference of the IEEE Computer and Communications Societies Proceedings.

[5]  Ellen W. Zegura,et al.  How to model an internetwork , 1996, Proceedings of IEEE INFOCOM '96. Conference on Computer Communications.

[6]  Gary Scott Malkin,et al.  Traceroute Using an IP Option , 1993, RFC.

[7]  UhligSteve Non-stationarity and high-order scaling in TCP flow arrivals , 2004 .

[8]  D. B. Preston Spectral Analysis and Time Series , 1983 .

[9]  Olivier Bonaventure,et al.  Interdomain traffic engineering with BGP , 2003, IEEE Commun. Mag..

[10]  Konstantina Papagiannaki,et al.  Traffic matrices: balancing measurements, inference and modeling , 2005, SIGMETRICS '05.

[11]  Walter Willinger,et al.  Self-Similar Network Traffic and Performance Evaluation , 2000 .

[12]  Nick Feamster,et al.  Network-wide BGP route prediction for traffic engineering , 2002, SPIE ITCom.

[13]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[14]  Olivier Bonaventure,et al.  Implications of the topological properties of Internet traffic on traffic engineering , 2004, SAC '04.

[15]  A. Vespignani,et al.  The architecture of complex weighted networks. , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[17]  Jin Cao,et al.  On the nonstationarity of Internet traffic , 2001, SIGMETRICS '01.

[18]  Olivier Bonaventure,et al.  Implications of Interdomain Traffic Characteristics on Traffic Engineering , 2002, Eur. Trans. Telecommun..

[19]  George C. Polyzos,et al.  Traffic characteristics of the T1 NSFNET backbone , 1993, IEEE INFOCOM '93 The Conference on Computer Communications, Proceedings.

[20]  Leonard Kleinrock,et al.  On measured behavior of the ARPA network , 1899, AFIPS '74.

[21]  Jennifer Rexford,et al.  Sensitivity of PCA for traffic anomaly detection , 2007, SIGMETRICS '07.

[22]  Susan Hares,et al.  A Border Gateway Protocol 4 (BGP-4) , 1994, RFC.

[23]  Randy H. Katz,et al.  Characterizing the Internet hierarchy from multiple vantage points , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[24]  Mark Crovella,et al.  Graph wavelets for spatial traffic analysis , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[25]  Walter Willinger,et al.  On the self-similar nature of Ethernet traffic , 1993, SIGCOMM '93.

[26]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[27]  A.H. Tewfik,et al.  Correlation structure of the discrete wavelet coefficients of fractional Brownian motion , 1992, IEEE Trans. Inf. Theory.

[28]  A. Barabasi,et al.  Weighted evolving networks. , 2001, Physical review letters.

[29]  Sally Floyd,et al.  Wide area traffic: the failure of Poisson modeling , 1995, TNET.

[30]  Richard Baraniuk,et al.  The Multiscale Nature of Network Traffic: Discovery, Analysis, and Modelling , 2003 .

[31]  R. Wilder,et al.  Wide-area Internet traffic patterns and characteristics , 1997, IEEE Netw..

[32]  Steve Uhlig,et al.  Non-stationarity and high-order scaling in TCP flow arrivals: a methodological analysis , 2004, CCRV.

[33]  Yin Zhang,et al.  BGP routing stability of popular destinations , 2002, IMW '02.

[34]  Yakov Rekhter,et al.  A Border Gateway Protocol 4 (BGP-4) , 1994, RFC.

[35]  Christophe Diot,et al.  Diagnosing network-wide traffic anomalies , 2004, SIGCOMM.

[36]  Walter Willinger,et al.  Long-Range Dependence and Data Network Traffic , 2001 .

[37]  Larry Peterson,et al.  Inter-AS traffic patterns and their implications , 1999, Seamless Interconnection for Universal Services. Global Telecommunications Conference. GLOBECOM'99. (Cat. No.99CH37042).