Leveraging Spatial and Temporal Correlations for Network Traffic Compression

—The deployment of modern network applications is increasing the network size and traffic volumes at an unprece-dented pace. Storing network-related information (e.g., traffic traces) is key to enable efficient network management. However, this task is becoming more challenging due to the ever-increasing data transmission rates and traffic volumes. In this paper, we present a novel method for network traffic compression that exploits spatial and temporal patterns naturally present in network traffic. We consider a realistic scenario where traffic measurements are performed at multiple links of a network topology using tools like SNMP or NetFlow. Such measurements can be seen as multiple time series that exhibit spatial and temporal correlations induced by the network topology, routing or user behavior. Our method leverages graph learning methods to effectively exploit both types of correlations for traffic com- pression. The experimental results show that our solution is able to outperform GZIP, the de facto traffic compression method, improving by 50%-65% the compression ratio on three real-world networks.

[1]  Miquel Ferriol Galmés,et al.  Network Digital Twin: Context, Enabling Technologies, and Opportunities , 2022, IEEE Communications Magazine.

[2]  Chang Tang,et al.  A network traffic forecasting method based on SA optimized ARIMA-BP neural network , 2021, Comput. Networks.

[3]  Mallik Tatipamula,et al.  Digital Twin for 5G and Beyond , 2021, IEEE Communications Magazine.

[4]  Yue Gu,et al.  Predicting Traffic Demand Matrix by Considering Inter-flow Correlations , 2020, IEEE INFOCOM 2020 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[5]  Ming Li,et al.  A deep learning method based on an attention mechanism for wireless network traffic prediction , 2020, Ad Hoc Networks.

[6]  Jaime Fern'andez del R'io,et al.  Array programming with NumPy , 2020, Nature.

[7]  Yue Gu,et al.  Incorporating Intra-flow Dependencies and Inter-flow Correlations for Traffic Matrix Prediction , 2020, 2020 IEEE/ACM 28th International Symposium on Quality of Service (IWQoS).

[8]  Francesco Musumeci,et al.  Network Traffic Prediction based on Diffusion Convolutional Recurrent Neural Networks , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[9]  Tarun Soni,et al.  Network Traffic Prediction Using Recurrent Neural Networks , 2018, 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA).

[10]  Tanweer Alam,et al.  A Reliable Communication Framework and its Use in Internet of Things (Iot) , 2018 .

[11]  Zhanxing Zhu,et al.  Spatio-temporal Graph Convolutional Neural Network: A Deep Learning Framework for Traffic Forecasting , 2017, IJCAI.

[12]  K. P. Soman,et al.  Applying deep learning approaches for network traffic prediction , 2017, 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[13]  Samuel S. Schoenholz,et al.  Neural Message Passing for Quantum Chemistry , 2017, ICML.

[14]  Yong Li,et al.  Understanding Mobile Traffic Patterns of Large Scale Cellular Towers in Urban Environment , 2015, Internet Measurement Conference.

[15]  Alex C. Snoeren,et al.  Inside the Social Network's (Datacenter) Network , 2015, Comput. Commun. Rev..

[16]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[17]  Mohsen Sardari,et al.  Packet-Level Network Compression: Realization and Scaling of the Network-Wide Benefits , 2014, IEEE/ACM Transactions on Networking.

[18]  George Varghese,et al.  P4: programming protocol-independent packet processors , 2013, CCRV.

[19]  Matthew Roughan,et al.  The Internet Topology Zoo , 2011, IEEE Journal on Selected Areas in Communications.

[20]  David A. Maltz,et al.  Network traffic characteristics of data centers in the wild , 2010, IMC '10.

[21]  Michail Vlachos,et al.  Net-Fli: On-the-fly Compression, Archiving and Indexing of Streaming Network Traffic , 2010, Proc. VLDB Endow..

[22]  Michal Pióro,et al.  SNDlib 1.0—Survivable Network Design Library , 2010, Networks.

[23]  S.A. Khan,et al.  High Speed Lossless Data Compression Architecture , 2006, 2006 IEEE International Multitopic Conference.

[24]  Kun-Chan Lan,et al.  A measurement study of correlations of Internet flow characteristics , 2006, Comput. Networks.

[25]  Vyas Sekar,et al.  Sparse approximations for high fidelity compression of network traffic data , 2005, IMC '05.

[26]  Mark Crovella,et al.  Diagnosing network-wide traffic anomalies , 2004, SIGCOMM '04.

[27]  Shigeki Goto,et al.  On the characteristics of Internet traffic variability: spikes and elephants , 2004, 2004 International Symposium on Applications and the Internet. Proceedings..

[28]  Jun Zhang,et al.  Wavelength converter placement in least-load-routing-based optical networks using genetic algorithms , 2004 .

[29]  Larry Peterson,et al.  Inter-AS traffic patterns and their implications , 1999, Seamless Interconnection for Universal Services. Global Telecommunications Conference. GLOBECOM'99. (Cat. No.99CH37042).

[30]  Ian H. Witten,et al.  Arithmetic coding for data compression , 1987, CACM.

[31]  W. Fuller,et al.  Distribution of the Estimators for Autoregressive Time Series with a Unit Root , 1979 .

[32]  Abraham Lempel,et al.  A universal algorithm for sequential data compression , 1977, IEEE Trans. Inf. Theory.

[33]  David A. Huffman,et al.  A method for the construction of minimum-redundancy codes , 1952, Proceedings of the IRE.

[34]  Kay Das.  Digital Twin for 5 G and Beyond , 2021 .

[35]  Matthew Roughan,et al.  Internet Traffic Matrices: A Primer , 2013 .

[36]  Skipper Seabold,et al.  Statsmodels: Econometric and Statistical Modeling with Python , 2010, SciPy.

[37]  Aric Hagberg,et al.  Exploring Network Structure, Dynamics, and Function using NetworkX , 2008, Proceedings of the Python in Science Conference.