Traffic Matrix Prediction and Estimation Based on Deep Learning for Data Center Networks

Network traffic analysis is a crucial technique for systematically operating a data center network. Many network management functions rely on exact network traffic information. Although a great number of works to obtain network traffic have been carried out in traditional ISP networks, they cannot be employed effectively in data center networks. Motivated by that, we focus on the problem of network traffic prediction and estimation in data center networks. We involve deep learning techniques in the network traffic prediction and estimation fields, and propose two deep architectures for network traffic prediction and estimation, respectively. We first use a deep architecture to explore the time-varying property of network traffic in a data center network, and then propose a novel network traffic prediction approach based on a deep belief network and a logistic regression model. Meanwhile, to deal with the highly ill-pose property of network traffic estimation, we further propose a network traffic estimation method using the deep belief network trained by link counts. We validate the effectiveness of our methodologies by real traffic data.

[1]  Anlong Ming,et al.  A Coverage-Enhancing Method for 3D Directional Sensor Networks , 2009, IEEE INFOCOM 2009.

[2]  Mianxiong Dong,et al.  HVSTO: Efficient privacy preserving hybrid storage in cloud data center , 2014, 2014 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[3]  Dingde Jiang,et al.  A novel hybrid prediction algorithm to network traffic , 2015, annals of telecommunications - annales des télécommunications.

[4]  Walter Willinger,et al.  Spatio-Temporal Compressive Sensing and Internet Traffic Matrices (Extended Version) , 2012, IEEE/ACM Transactions on Networking.

[5]  Liansheng Tan,et al.  A PCA based optimization approach for IP traffic matrix estimation , 2015, J. Netw. Comput. Appl..

[6]  Peng Zhang,et al.  A traffic anomaly detection approach in communication networks for applications of multimedia medical devices , 2016, Multimedia Tools and Applications.

[7]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[8]  Cheng Yao,et al.  Multi‐scale anomaly detection for high‐speed network traffic , 2015, Trans. Emerg. Telecommun. Technol..

[9]  C. L. Philip Chen,et al.  Fuzzy Restricted Boltzmann Machine for the Enhancement of Deep Learning , 2015, IEEE Transactions on Fuzzy Systems.

[10]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[11]  Huadong Ma,et al.  On Coverage Problems of Directional Sensor Networks , 2005, MSN.

[12]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[13]  Jun Luo,et al.  Coarse-grained traffic matrix estimation for data center networks , 2015, Comput. Commun..

[14]  Deniz Kumlu,et al.  Network traffic estimation using Markov chain and Incremental Gaussian Mixture , 2015, 2015 23nd Signal Processing and Communications Applications Conference (SIU).

[15]  Feng Xia,et al.  CAIS: A Copy Adjustable Incentive Scheme in Community-Based Socially Aware Networking , 2017, IEEE Transactions on Vehicular Technology.

[16]  Dong Yu,et al.  Deep Learning: Methods and Applications , 2014, Found. Trends Signal Process..

[17]  Ke Xu,et al.  A Model Approach to the Estimation of Peer-to-Peer Traffic Matrices , 2014, IEEE Transactions on Parallel and Distributed Systems.

[18]  David A. Maltz,et al.  Network traffic characteristics of data centers in the wild , 2010, IMC '10.

[19]  WillingerWalter,et al.  Spatio-temporal compressive sensing and internet traffic matrices , 2009 .

[20]  Lei Guo,et al.  Integration of scheduling and network coding in multi-rate wireless mesh networks: Optimization models and algorithms , 2016, Ad Hoc Networks.

[21]  Konstantina Papagiannaki,et al.  Traffic matrices: balancing measurements, inference and modeling , 2005, SIGMETRICS '05.