Traffic Matrix Prediction Based on Deep Learning for Dynamic Traffic Engineering

Traffic matrix (TM) is a critical information for network operation and management, especially for traffic engineering (TE). Due to the technical and mercantile problems, real time measurement for TM is difficult in large scale networks. In this paper, we focus on predicting TM for dynamic traffic engineering. We propose several TM prediction methods based on Neural Networks (NN) and predict TM from three perspectives: predict the overall TM directly, predict each origin-destination (OD) flow separately and predict the overall TM combined with key element correction. In addition to the prediction accuracy, we evaluate different prediction methods through the performance of TE, as well as the prediction time. We test the proposed methods by real world datasets from Abilene, CERNET and GÉANT. The experiment results show that prediction methods based on Recurrent Neural Networks (RNN) can achieve better prediction accuracy than methods leveraging Convolutional Neural Networks (CNN) and Deep Belief Networks (DBN). Predicting each OD flow through RNN models can further improve the prediction accuracy, as well as the performance of TE under the OSPF network scenario, the SDN/OSPF hybrid network scenario and the multi-commodity flow problem scenario. However, it takes longer prediction time for predicting each OD flow sequence. In contrast, predicting the overall TM combined with key element correction can provide a trade-off between the TE results and the prediction overhead, which is more appropriate for dynamic TE in the above three scenarios.

[1]  Konstantina Papagiannaki,et al.  Traffic matrices: balancing measurements, inference and modeling , 2005, SIGMETRICS '05.

[2]  Dafna Shahaf,et al.  Learning to Route , 2017, HotNets.

[3]  Lei Guo,et al.  Traffic Matrix Prediction and Estimation Based on Deep Learning for Data Center Networks , 2016, 2016 IEEE Globecom Workshops (GC Wkshps).

[4]  Hua Qu,et al.  Towards traffic matrix prediction with LSTM recurrent neural networks , 2018 .

[5]  Lei Guo,et al.  Traffic matrix prediction and estimation based on deep learning in large-scale IP backbone networks , 2016, J. Netw. Comput. Appl..

[6]  Jianping Wu,et al.  Traffic Engineering in SDN/OSPF Hybrid Network , 2014, 2014 IEEE 22nd International Conference on Network Protocols.

[7]  Murali S. Kodialam,et al.  Traffic engineering in software defined networks , 2013, 2013 Proceedings IEEE INFOCOM.

[8]  Mikkel Thorup,et al.  Internet traffic engineering by optimizing OSPF weights , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[9]  Trevor Darrell,et al.  Long-term recurrent convolutional networks for visual recognition and description , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Guido Maier,et al.  Deep Learning-Based Traffic Prediction for Network Optimization , 2018, 2018 20th International Conference on Transparent Optical Networks (ICTON).

[11]  Tarun Soni,et al.  Network Traffic Prediction Using Recurrent Neural Networks , 2018, 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA).

[12]  Masayuki Murata,et al.  Traffic prediction for dynamic traffic engineering , 2015, Comput. Networks.

[13]  Adam Meyerson,et al.  Online oblivious routing , 2003, SPAA '03.

[14]  Walter Willinger,et al.  On the Self-Similar Nature of Ethernet Traffic ( extended version ) , 1995 .

[15]  Steve Uhlig,et al.  Providing public intradomain traffic matrices to the research community , 2006, CCRV.

[16]  Vladlen Koltun,et al.  An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling , 2018, ArXiv.

[17]  Kemal Alic,et al.  Network traffic modeling for load prediction: a user-centric approach , 2015, IEEE Network.

[18]  Emilio Leonardi,et al.  How to identify and estimate the largest traffic matrix elements in a dynamic environment , 2004, SIGMETRICS '04/Performance '04.

[19]  Ge Zhang,et al.  Prediction and correction of traffic matrix in an IP backbone network , 2014, 2014 IEEE 33rd International Performance Computing and Communications Conference (IPCCC).

[20]  Jordi Domingo-Pascual,et al.  Evaluation of network traffic prediction based on neural networks with multi-task learning and multiresolution decomposition , 2011, 2011 IEEE 7th International Conference on Intelligent Computer Communication and Processing.

[21]  Guy Pujolle,et al.  NeuTM: A neural network-based framework for traffic matrix prediction in SDN , 2017, NOMS 2018 - 2018 IEEE/IFIP Network Operations and Management Symposium.

[22]  Albert G. Greenberg,et al.  Fast accurate computation of large-scale IP traffic matrices from link loads , 2003, SIGMETRICS '03.