How to reconstruct end-to-end traffic based on time-frequency analysis and artificial neural network

Abstract End-to-end traffic, which describes the inherent characteristics and end-to-end behaviors of communication networks, is the crucial input parameter of network management and network traffic engineering. This paper proposes a new reconstruction algorithm to develop the research on reconstruction of end-to-end traffic in large-scale communication networks. We firstly conduct the time-frequency analysis on end-to-end traffic, and then localize its features to gain its time-frequency properties before decomposing it into the low-frequency and high-frequency components. We find that if decomposing appropriately, the low-frequency component of end-to-end traffic can accurately reflect its change trend, while its high-frequency component can well show the burst and fluctuation nature. This motivates us to find a reasonable time-frequency decomposition strategy to extract the low-frequency and high-frequency components of end-to-end traffic. Moreover, this further inspires us to use the regressive model to model the low-frequency part, exploit artificial neural network to characterize the high-frequency component, and then combine these two parts according to the regressive model and artificial neural network to precisely reconstruct end-to-end traffic. Simulation results show that in contrast to previous methods our algorithm is much more effective and promising.

[1]  Maurizio Naldi,et al.  A non linear wavelet based estimator for long memory processes , 2004 .

[2]  H. S. Shahhoseini,et al.  Intelligent IP traffic matrix estimation by neural network and genetic algorithm , 2011, 2011 IEEE 7th International Symposium on Intelligent Signal Processing.

[3]  Dingde Jiang,et al.  Joint time-frequency sparse estimation of large-scale network traffic , 2011, Comput. Networks.

[4]  Tomonori Takeda,et al.  Traffic matrix estimation in large-scale IP networks , 2010, 2010 17th IEEE Workshop on Local & Metropolitan Area Networks (LANMAN).

[5]  Sorin Moga,et al.  Long-range dependence in WiMAX downlink traffic , 2011, ISSCS 2011 - International Symposium on Signals, Circuits and Systems.

[6]  Dingde Jiang,et al.  Energy-efficient cognitive access approach to convergence communications , 2014, Science China Information Sciences.

[7]  Francesco Viti,et al.  A hierarchical approach for dynamic origin-destination matrix estimation on large-scale congested networks , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[8]  Ke Liu,et al.  Combining partial direct measurements with an information-theoretic approach to estimate traffic matrix , 2010, 2010 3rd IEEE International Conference on Broadband Network and Multimedia Technology (IC-BNMT).

[9]  Raimir Holanda Filho,et al.  Network traffic prediction using PCA and K-means , 2010, 2010 IEEE Network Operations and Management Symposium - NOMS 2010.

[10]  Azer Bestavros,et al.  Self-similarity in World Wide Web traffic: evidence and possible causes , 1997, TNET.

[11]  Jian-Bo Yang,et al.  Online Updating With a Probability-Based Prediction Model Using Expectation Maximization Algorithm for Reliability Forecasting , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[12]  Bin Yu,et al.  A fast lightweight approach to origin-destination IP traffic estimation using partial measurements , 2006, IEEE Transactions on Information Theory.

[13]  Peng Zhang,et al.  A transform domain-based anomaly detection approach to network-wide traffic , 2014, J. Netw. Comput. Appl..

[14]  Bing Yu,et al.  Time-Varying Network Tomography: Router Link Data , 2000 .

[15]  Bin Yu,et al.  Pseudo likelihood estimation in network tomography , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[16]  Konstantina Papagiannaki,et al.  A distributed approach to measure IP traffic matrices , 2004, IMC '04.

[17]  Attahiru Sule Alfa,et al.  Hybrid Techniques for Large-Scale IP Traffic Matrix Estimation , 2010, 2010 IEEE International Conference on Communications.

[18]  Konstantina Papagiannaki,et al.  Traffic matrices: balancing measurements, inference and modeling , 2005, SIGMETRICS '05.

[19]  PL Conti,et al.  Estimation of traffic matrices in the presence of long memory traffic , 2012 .

[20]  Ingrid Daubechies,et al.  The wavelet transform, time-frequency localization and signal analysis , 1990, IEEE Trans. Inf. Theory.

[21]  Lei Guo,et al.  An optimization method of large-scale IP traffic matrix estimation , 2010 .

[22]  Balasubramaniam Natarajan,et al.  GARCH — non-linear time series model for traffic modeling and prediction , 2008, NOMS 2008 - 2008 IEEE Network Operations and Management Symposium.

[23]  Dingde Jiang,et al.  Large-Scale IP Traffic Matrix Estimation Based on the Recurrent Multilayer Perceptron Network , 2008, 2008 IEEE International Conference on Communications.

[24]  Albert G. Greenberg,et al.  Fast accurate computation of large-scale IP traffic matrices from link loads , 2003, SIGMETRICS '03.

[25]  Walter Willinger,et al.  Spatio-temporal compressive sensing and internet traffic matrices , 2009, SIGCOMM '09.

[26]  Maurizio Naldi,et al.  Blind Maximum-Likelihood Estimation of Traffic Matrices in Long Range Dependent Traffic , 2009, FITraMEn.

[27]  A. Pascale,et al.  Adaptive Bayesian network for traffic flow prediction , 2011, 2011 IEEE Statistical Signal Processing Workshop (SSP).

[28]  Konstantina Papagiannaki,et al.  Structural analysis of network traffic flows , 2004, SIGMETRICS '04/Performance '04.

[29]  Hong Shen,et al.  New methods for network traffic matrix estimation based on a probability model , 2011, 2011 17th IEEE International Conference on Networks.

[30]  Dingde Jiang,et al.  An approximation method of origin-destination flow traffic from link load counts , 2011, Comput. Electr. Eng..

[31]  George Michailidis,et al.  Structural Models for Dual Modality Data With Application to Network Tomography , 2011, IEEE Transactions on Information Theory.

[32]  Lili Yan,et al.  Research of Traffic Matrix Estimation in IP Networks , 2011, 2011 International Conference on Internet Technology and Applications.

[33]  Hui Zang,et al.  Traffic monitor deployment in IP networks , 2009, Comput. Networks.

[34]  R. Adler,et al.  A practical guide to heavy tails: statistical techniques and applications , 1998 .