Efficient methods for traffic matrix modeling and on-line estimation in large-scale IP networks

Despite a large body of literature and methods devoted to the Traffic Matrix estimation problem, the inference of traffic flows volume from aggregated data represents a key subject facing the evolution of next generation networks. This is a particular problem in large-scale carrier networks, for which efficient, accurate and stable methods for Traffic Matrix modeling and estimation are vital and challenging to conceive. In the short-term, estimation methods must be efficient and stable to allow crucial real-time tasks such as on-line traffic monitoring. In the long-term, methods must provide an accurate picture of the traffic matrix to tackle problems such as network planning, design, and dimensioning. In this paper we present and compare two efficient methods for on-line traffic matrix estimation. Based on an original parsimonious linear model for traffic flows in large-scale networks, we present a simple approach to compute an accurate traffic matrix from easily available link traffic measurements. We further extend the validation of this parsimonious model to three operational backbone networks. We analyze in depth a method to recursively estimate the traffic matrix, studying the drawbacks and omissions of the former algorithm and proposing new extensions to solve these problems. We finally perform a comparative analysis of the performance of both methods in two operational backbone networks, taking into account significant aspects such as accuracy, stability, scalability, and on-line applicability.

[1]  Calyampudi Radhakrishna Rao,et al.  Linear Statistical Inference and its Applications , 1967 .

[2]  N. L. Johnson,et al.  Linear Statistical Inference and Its Applications , 1966 .

[3]  Monson H. Hayes,et al.  Statistical Digital Signal Processing and Modeling , 1996 .

[4]  Kavé Salamatian,et al.  Traffic matrix tracking using Kalman filters , 2005, PERV.

[5]  Konstantina Papagiannaki,et al.  A distributed approach to measure IP traffic matrices , 2004, IMC '04.

[6]  Steven Kay,et al.  Modern Spectral Estimation: Theory and Application , 1988 .

[7]  Calyampudi R. Rao,et al.  Linear Statistical Inference and Its Applications. , 1975 .

[8]  Kavé Salamatian,et al.  Traffic matrix estimation: existing techniques and new directions , 2002, SIGCOMM '02.

[9]  Jacek Kowalski,et al.  Modelling Traffic Demand Between Nodes in a Telecommunications Network , 1995 .

[10]  Konstantina Papagiannaki,et al.  Structural analysis of network traffic flows , 2004, SIGMETRICS '04/Performance '04.

[11]  Albert G. Greenberg,et al.  Fast accurate computation of large-scale IP traffic matrices from link loads , 2003, SIGMETRICS '03.

[12]  Albert G. Greenberg,et al.  Network anomography , 2005, IMC '05.

[13]  Steve Uhlig,et al.  Providing public intradomain traffic matrices to the research community , 2006, CCRV.

[14]  Konstantina Papagiannaki,et al.  Traffic matrices: balancing measurements, inference and modeling , 2005, SIGMETRICS '05.

[15]  Kavé Salamatian,et al.  Combining filtering and statistical methods for anomaly detection , 2005, IMC '05.

[16]  Michael A. West,et al.  Bayesian Inference on Network Traffic Using Link Count Data , 1998 .

[17]  S. Vaton,et al.  Robust and Reactive Traffic Engineering for Dynamic Traffic Demands , 2008, 2008 Next Generation Internet Networks.

[18]  Y. Vardi,et al.  Network Tomography: Estimating Source-Destination Traffic Intensities from Link Data , 1996 .