Traffic matrix estimation based on a square root Kalman filtering algorithm

The traffic matrix (TM) is one of the crucial inputs for many network management and traffic engineering tasks. As it is usually impossible to directly measure traffic matrices, it becomes an important research topic to infer them by modeling incorporating measurable data and additional information. Many estimation methods have been proposed so far, but most of them are not sufficiently accurate or efficient. Researchers are therefore making efforts to seek better estimation methods. Of the proposed methods, the Kalman Filtering method is a very efficient and accurate method. However, the error covariance calculation components of Kalman filtering are difficult to implement in realistic network systems due to the existence of ill-conditioning problems. In this paper, we proposed a square root Kalman filtering traffic matrix estimation (SRKFTME) algorithm based on matrix decomposition to improve the Kalman filtering method. The SRKFTME algorithm makes use of the evolution equations of forecast and analysis error covariance square roots. In this way the SRKFTME algorithm can ensure the positive definiteness of the error covariance matrices, which can solve some ill-conditioning problems. Also, square root Kalman filtering will be less affected by numerical problems. Simulation and actual traffic testing results show superior accuracy and stability of SRKFTME algorithm compared with prior Kalman filtering methods.

[1]  Bin Yu,et al.  A fast lightweight approach to origin-destination IP traffic estimation using partial measurements , 2006, IEEE Transactions on Information Theory.

[2]  Konstantina Papagiannaki,et al.  A distributed approach to measure IP traffic matrices , 2004, IMC '04.

[3]  Bing Yu,et al.  Time-Varying Network Tomography: Router Link Data , 2000 .

[4]  J. Whitaker,et al.  Ensemble Square Root Filters , 2003, Statistical Methods for Climate Scientists.

[5]  Masayuki Murata,et al.  Identification of Attack Nodes from Traffic Matrix Estimation , 2007, IEICE Trans. Commun..

[6]  Anja Feldmann,et al.  Deriving traffic demands for operational IP networks: methodology and experience , 2001, TNET.

[7]  Matthew Roughan,et al.  Computation of IP traffic from link , 2003, SIGMETRICS 2003.

[8]  Christophe Diot,et al.  Taxonomy of IP traffic matrices , 2002, SPIE ITCom.

[9]  G. Bierman Factorization methods for discrete sequential estimation , 1977 .

[10]  Albert G. Greenberg,et al.  OSPF Monitoring: Architecture, Design, and Deployment Experience , 2004, NSDI.

[11]  Kavé Salamatian,et al.  Traffic matrix tracking using Kalman filters , 2005, PERV.

[12]  Sandrine Vaton,et al.  Advanced Methods for the Estimation of the Origin Destination Traffic Matrix , 2005 .

[13]  Carsten Lund,et al.  An information-theoretic approach to traffic matrix estimation , 2003, SIGCOMM '03.

[14]  Attahiru Sule Alfa,et al.  IP Traffic Matrix Estimation Methods: Comparisons and Improvements , 2006, 2006 IEEE International Conference on Communications.

[15]  Albert G. Greenberg,et al.  Fast accurate computation of large-scale IP traffic matrices from link loads , 2003, SIGMETRICS '03.

[16]  Christophe Diot,et al.  Design of IGP link weight changes for estimation of traffic matrices , 2004, IEEE INFOCOM 2004.

[17]  Y. Vardi,et al.  Network Tomography: Estimating Source-Destination Traffic Intensities from Link Data , 1996 .

[18]  Tang Hong,et al.  An Assignment Model on Traffic Matrix Estimation , 2006, ICNC.

[19]  Mikkel Thorup,et al.  Traffic engineering with estimated traffic matrices , 2003, IMC '03.

[20]  Sandrine Vaton,et al.  Network traffic matrix: how can one learn the prior distributions from the link counts only? , 2004, 2004 IEEE International Conference on Communications (IEEE Cat. No.04CH37577).

[21]  Christophe Diot,et al.  Traffic matrix estimation: existing techniques and new directions , 2002, SIGCOMM 2002.

[22]  Konstantina Papagiannaki,et al.  Traffic matrices: balancing measurements, inference and modeling , 2005, SIGMETRICS '05.

[23]  R. Shumway,et al.  AN APPROACH TO TIME SERIES SMOOTHING AND FORECASTING USING THE EM ALGORITHM , 1982 .

[24]  Eiji Oki,et al.  Gradually reconfiguring virtual network topologies based on estimated traffic matrices , 2010 .

[25]  Michael A. West,et al.  Bayesian Inference on Network Traffic Using Link Count Data , 1998 .

[26]  Vijay Erramilli,et al.  An independent-connection model for traffic matrices , 2006, IMC '06.

[27]  Christophe Diot,et al.  A Two-step Statistical Approach for Inferring Network Traffic Demands ∗ , 2004 .

[28]  Changjia Chen,et al.  Routing inference based on pseudo traffic matrix estimation , 2006, 20th International Conference on Advanced Information Networking and Applications - Volume 1 (AINA'06).