Deep-Q: Traffic-driven QoS Inference using Deep Generative Network

In today's IP network, it is important to provide the Quality of Service (QoS) guarantee for network services. However, in real networks with highly dynamic traffic demands, it is difficult to build an accurate QoS model even with a high cost of human expert analysis. In this paper, we present Deep-Q, a data-driven system to learn the QoS model directly from traffic data without human analysis. This function is achieved by utilizing the power of state-of-the-art deep generative networks in the deep learning area. Deep-Q provides a novel inference structure of a variational auto-encoder (VAE) enhanced by the long short-term memory (LSTM). A specially-designed module named Cinfer-loss is further applied to improve the QoS inference accuracy. By training with real traffic data, Deep-Q can infer a variety of QoS metrics over different networks given traffic conditions in real-time. We build testbeds for both the data center network and overlay IP network. Extensive experiments with 5.7TB traffic traces demonstrate that Deep-Q can achieve on average 3x higher inference accuracy than traditional queuing-theory-based solution in real networks while keeping inference time within 100ms.

[1]  Marc G. Bellemare,et al.  The Cramer Distance as a Solution to Biased Wasserstein Gradients , 2017, ArXiv.

[2]  Amin Vahdat,et al.  A scalable, commodity data center network architecture , 2008, SIGCOMM '08.

[3]  Marc'Aurelio Ranzato,et al.  Large Scale Distributed Deep Networks , 2012, NIPS.

[4]  Sidath Handurukande,et al.  Magneto approach to QoS monitoring , 2011, 12th IFIP/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops.

[5]  Chi Harold Liu,et al.  Experience-driven Networking: A Deep Reinforcement Learning based Approach , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[6]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[7]  Heiga Zen,et al.  WaveNet: A Generative Model for Raw Audio , 2016, SSW.

[8]  Laurent Vanbever,et al.  Stroboscope: Declarative Network Monitoring on a Budget , 2018, NSDI.

[9]  Brighten Godfrey,et al.  DRILL: Micro Load Balancing for Low-latency Data Center Networks , 2017, SIGCOMM.

[10]  Gang Hua,et al.  CVAE-GAN: Fine-Grained Image Generation through Asymmetric Training , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[11]  Bernt Schiele,et al.  Generative Adversarial Text to Image Synthesis , 2016, ICML.

[12]  Xin Jin,et al.  SketchVisor: Robust Network Measurement for Software Packet Processing , 2017, SIGCOMM.

[13]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Léon Bottou,et al.  Wasserstein GAN , 2017, ArXiv.

[15]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[16]  J. Schmitt,et al.  Perspectives on network calculus: no free lunch, but still good value , 2012, SIGCOMM '12.