Detection of traffic changes in large-scale backbone networks: The case of the Spanish academic network

Network management systems produce a huge amount of data in large-scale networks. For example, the Spanish academic network features hundreds of access and backbone links, each of which produces a link utilization time series. For the purpose of detecting relevant changes in traffic load a visual inspection of all such time series is required. As a result, the operational expenditure increases. In this paper, we present an on-line change detection algorithm to identify the relevant change points in link utilization, which are presented to the network manager through a graphical user interface. Consequently, the network manager only inspects those links that show a stationary and statistically significant change in the link load.

[1]  Andrew Odlyzko,et al.  Internet traffic growth: sources and implications , 2003, SPIE ITCom.

[2]  Aiko Pras,et al.  Gaussian traffic everywhere? , 2006, 2006 IEEE International Conference on Communications.

[3]  Michel Mandjes,et al.  QoS-aware bandwidth provisioning for IP network links , 2006, Comput. Networks.

[4]  Paul Barford,et al.  A signal analysis of network traffic anomalies , 2002, IMW '02.

[5]  Tobias Oetiker,et al.  MRTG: The Multi Router Traffic Grapher , 1998, LISA.

[6]  R. Wilder,et al.  Wide-area Internet traffic patterns and characteristics , 1997, IEEE Netw..

[7]  Charles J. Kowalski,et al.  Non-Normal Bivariate Distributions with Normal Marginals , 1973 .

[8]  Jake D. Brutlag,et al.  Aberrant Behavior Detection in Time Series for Network Monitoring , 2000, LISA.

[9]  William Stallings,et al.  SNMP, SNMPv2, SNMPv3, and RMON 1 and 2 , 1999 .

[10]  Ilkka Norros,et al.  On the Use of Fractional Brownian Motion in the Theory of Connectionless Networks , 1995, IEEE J. Sel. Areas Commun..

[11]  Anja Feldmann,et al.  NetScope: traffic engineering for IP networks , 2000, IEEE Netw..

[12]  Yan Chen,et al.  Reversible sketches for efficient and accurate change detection over network data streams , 2004, IMC '04.

[13]  R. L. Pickholtz,et al.  Public key management for network security , 1987, IEEE Network.

[14]  Anja Vogler,et al.  An Introduction to Multivariate Statistical Analysis , 2004 .

[15]  B. L. Welch.  THE SIGNIFICANCE OF THE DIFFERENCE BETWEEN TWO MEANS WHEN THE POPULATION VARIANCES ARE UNEQUAL , 1938 .

[16]  Anja Feldmann,et al.  Deriving traffic demands for operational IP networks: methodology and experience , 2000, SIGCOMM.

[17]  K. Mardia.  Assessment of multinormality and the robustness of Hotelling's T^2 test , 1975 .

[18]  Konstantina Papagiannaki,et al.  Structural analysis of network traffic flows , 2004, SIGMETRICS '04/Performance '04.

[19]  Kai Hwang,et al.  Collaborative Change Detection of DDoS Attacks on Community and ISP Networks , 2006, International Symposium on Collaborative Technologies and Systems (CTS'06).

[20]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[21]  Charles E. Heckler,et al.  Applied Multivariate Statistical Analysis , 2005, Technometrics.

[22]  Anja Feldmann,et al.  Deriving traffic demands for operational IP networks: methodology and experience , 2001, TNET.

[23]  Ilkka Norros,et al.  Testing the Gaussian approximation of aggregate traffic , 2002, IMW '02.

[24]  Jim Euchner.  Design , 2014, Catalysis from A to Z.

[25]  Balachander Krishnamurthy,et al.  Sketch-based change detection: methods, evaluation, and applications , 2003, IMC '03.

[26]  T. W. Anderson,et al.  An Introduction to Multivariate Statistical Analysis , 1959 .

[27]  José Luis García-Dorado,et al.  Automated Detection of Load Changes in Large-Scale Networks , 2009, TMA.

[28]  Peter A. Forsyth,et al.  Managing capacity for telecommunications networks under uncertainty , 2002, TNET.

[29]  Gregory Piatetsky-Shapiro,et al.  High-Dimensional Data Analysis: The Curses and Blessings of Dimensionality , 2000 .

[30]  Javier Aracil,et al.  Characterization of the busy-hour traffic of IP networks based on their intrinsic features , 2011, Comput. Networks.

[31]  Hiroshi Esaki,et al.  The impact of residential broadband traffic on Japanese ISP backbones , 2005, CCRV.

[32]  K. Mardia.  Measures of multivariate skewness and kurtosis with applications , 1970 .

[33]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[34]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .

[35]  Christophe Diot,et al.  Geographical and temporal characteristics of inter-POP flows: View from a single pop , 2002, Eur. Trans. Telecommun..

[36]  Konstantina Papagiannaki,et al.  Long-term forecasting of Internet backbone traffic , 2005, IEEE Transactions on Neural Networks.

[37]  Evangelos P. Markatos,et al.  One-click hosting services: a file-sharing hideout , 2009, IMC '09.

[38]  David G. Stork,et al.  Pattern Classification , 1973 .