Traffic matrix prediction and estimation based on deep learning in large-scale IP backbone networks

Network traffic analysis has been one of the most crucial techniques for preserving a large-scale IP backbone network. Despite its importance, large-scale network traffic monitoring techniques suffer from some technical and mercantile issues to obtain precise network traffic data. Though the network traffic estimation method has been the most prevalent technique for acquiring network traffic, it still has a great number of problems that need solving. With the development of the scale of our networks, the level of the ill-posed property of the network traffic estimation problem is more deteriorated. Besides, the statistical features of network traffic have changed greatly in terms of current network architectures and applications. Motivated by that, in this paper, we propose a network traffic prediction and estimation method respectively. We first use a deep learning architecture to explore the dynamic properties of network traffic, and then propose a novel network traffic prediction approach based on a deep belief network. We further propose a network traffic estimation method utilizing the deep belief network via link counts and routing information. We validate the effectiveness of our methodologies by real data sets from the Abilene and GANT backbone networks.

[1]  Konstantina Papagiannaki,et al.  Traffic matrices: balancing measurements, inference and modeling , 2005, SIGMETRICS '05.

[2]  Wenhao Huang,et al.  Deep Architecture for Traffic Flow Prediction , 2013, ADMA.

[3]  Walter Willinger,et al.  Spatio-Temporal Compressive Sensing and Internet Traffic Matrices (Extended Version) , 2012, IEEE/ACM Transactions on Networking.

[4]  Liansheng Tan,et al.  A PCA based optimization approach for IP traffic matrix estimation , 2015, J. Netw. Comput. Appl..

[5]  Jun Luo,et al.  ATME: Accurate Traffic Matrix Estimation in Both Public and Private Datacenter Networks , 2018, IEEE Transactions on Cloud Computing.

[6]  Morteza Mardani,et al.  Robust network traffic estimation via sparsity and low rank , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[7]  Dong Yu,et al.  Deep Learning: Methods and Applications , 2014, Found. Trends Signal Process..

[8]  Ke Xu,et al.  A Model Approach to the Estimation of Peer-to-Peer Traffic Matrices , 2014, IEEE Transactions on Parallel and Distributed Systems.

[9]  Albert G. Greenberg,et al.  Fast accurate computation of large-scale IP traffic matrices from link loads , 2003, SIGMETRICS '03.

[10]  Wenhao Huang,et al.  Deep Architecture for Traffic Flow Prediction: Deep Belief Networks With Multitask Learning , 2014, IEEE Transactions on Intelligent Transportation Systems.

[11]  Hui Tian,et al.  Study on a New Model for Network Traffic Matrix Estimation , 2014, 2014 Sixth International Symposium on Parallel Architectures, Algorithms and Programming.

[12]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[13]  Kemal Alic,et al.  Network traffic modeling for load prediction: a user-centric approach , 2015, IEEE Network.

[14]  Deniz Kumlu,et al.  Network traffic estimation using Markov chain and Incremental Gaussian Mixture , 2015, 2015 23nd Signal Processing and Communications Applications Conference (SIU).

[15]  Marco Listanti,et al.  Traffic matrix estimation enhanced by SDNs nodes in real network topology , 2015, 2015 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[16]  Geoffrey E. Hinton,et al.  Using Deep Belief Nets to Learn Covariance Kernels for Gaussian Processes , 2007, NIPS.

[17]  Walter Willinger,et al.  Spatio-temporal compressive sensing and internet traffic matrices , 2009, SIGCOMM '09.

[18]  Matthew Roughan,et al.  Computation of IP traffic from link , 2003, SIGMETRICS 2003.

[19]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[20]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[21]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[22]  C. L. Philip Chen,et al.  Fuzzy Restricted Boltzmann Machine for the Enhancement of Deep Learning , 2015, IEEE Transactions on Fuzzy Systems.