DeepTMA: Predicting Effective Contention Models for Network Calculus using Graph Neural Networks

Network calculus computes end-to-end delay bounds for individual data flows in networks of aggregate schedulers. It searches for the best model bounding resource contention between these flows at each scheduler. Analyzing networks, this leads to complex dependency structures and finding the tightest delay bounds becomes a resource intensive task. The exhaustive search for the best combination of contention models is known as Tandem Matching Analysis (TMA). The challenge TMA overcomes is that a contention model in one location of the network can have huge impact on one in another location. These locations can, however, be many analysis steps apart from each other. TMA can derive delay bounds with high degree of tightness but needs several hours of computations to do so. We avoid the effort of exhaustive search altogether by predicting the best contention models for each location in the network. For effective predictions, our main contribution in this paper is a novel framework combining graph-based deep learning and Network Calculus (NC) models. The framework learns from NC, predicts best NC models and feeds them back to NC. Deriving a first heuristic from this framework, called DeepTMA, we achieve provably valid bounds that are very competitive with TMA. We observe a maximum relative error below 6%, while execution times remain nearly constant and outperform TMA in moderately sized networks by several orders of magnitude.

[1]  Wang Yi,et al.  Generalized finitary real-time calculus , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[2]  Lothar Thiele,et al.  Analytic real-time analysis and timed automata: a hybrid method for analyzing embedded real-time systems , 2009, EMSOFT '09.

[3]  Wang Yi,et al.  Revisiting GPC and AND Connector in Real-Time Calculus , 2017, 2017 IEEE Real-Time Systems Symposium (RTSS).

[4]  Jintao Wang,et al.  Analyzing Multimode Wireless Sensor Networks Using the Network Calculus , 2015, J. Sensors.

[5]  Richard S. Zemel,et al.  Gated Graph Sequence Neural Networks , 2015, ICLR.

[6]  Giovanni Stea,et al.  Exact Worst-Case Delay in FIFO-Multiplexing Feed-Forward Networks , 2015, IEEE/ACM Transactions on Networking.

[7]  Moussa Amrani,et al.  ML + FV = $\heartsuit$? A Survey on the Application of Machine Learning to Formal Verification , 2018, 1806.03600.

[8]  Jörg Liebeherr Duality of the Max-Plus and Min-Plus Network Calculus , 2017, Found. Trends Netw..

[9]  Lothar Thiele,et al.  Real-time calculus for scheduling hard real-time systems , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[10]  Wang Yi,et al.  Finitary Real-Time Calculus: Efficient Performance Analysis of Distributed Embedded Systems , 2013, 2013 IEEE 34th Real-Time Systems Symposium.

[11]  Jean-Yves Le Boudec,et al.  Delay Bounds in a Network with Aggregate Scheduling , 2000, QofIS.

[12]  Jens B. Schmitt,et al.  Delay Bounds under Arbitrary Multiplexing: When Network Calculus Leaves You in the Lurch... , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[13]  Alexander Scheffler,et al.  The Deterministic Network Calculus Analysis: Reliability Insights and Performance Improvements , 2018, 2018 IEEE 23rd International Workshop on Computer Aided Modeling and Design of Communication Links and Networks (CAMAD).

[14]  Georg Carle,et al.  The Case for a Network Calculus Heuristic: Using Insights from Data for Tighter Bounds , 2018, 2018 30th International Teletraffic Congress (ITC 30).

[15]  Ah Chung Tsoi,et al.  The Graph Neural Network Model , 2009, IEEE Transactions on Neural Networks.

[16]  Rene L. Cruz,et al.  A calculus for network delay, Part II: Network analysis , 1991, IEEE Trans. Inf. Theory.

[17]  Rene L. Cruz,et al.  A calculus for network delay, Part I: Network elements in isolation , 1991, IEEE Trans. Inf. Theory.

[18]  James F. Kurose,et al.  A network calculus for cache networks , 2013, 2013 Proceedings IEEE INFOCOM.

[19]  Jean-Yves Le Boudec,et al.  Network Calculus: A Theory of Deterministic Queuing Systems for the Internet , 2001 .

[20]  Eric Thierry,et al.  An Algorithmic Toolbox for Network Calculus , 2008, Discret. Event Dyn. Syst..

[21]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[22]  Justine Sherry,et al.  Silo: Predictable Message Latency in the Cloud , 2015, Comput. Commun. Rev..

[23]  Jens B. Schmitt,et al.  Boosting sensor network calculus by thoroughly bounding cross-traffic , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[24]  David L. Dill,et al.  Learning a SAT Solver from Single-Bit Supervision , 2018, ICLR.

[25]  Kyunghyun Cho,et al.  Neural Message Passing for Jet Physics , 2017 .

[26]  Almut Burchard,et al.  A (min, ×) network calculus for multi-hop fading channels , 2013, 2013 Proceedings IEEE INFOCOM.

[27]  Ramin Yahyapour,et al.  An analytical model for software defined networking: A network calculus-based approach , 2013, 2013 IEEE Global Communications Conference (GLOBECOM).

[28]  Eric Thierry,et al.  Tight performance bounds in the worst-case analysis of feed-forward networks , 2016, Discret. Event Dyn. Syst..

[29]  Wolfgang Kellerer,et al.  DetServ: Network Models for Real-Time QoS Provisioning in SDN-Based Industrial Environments , 2017, IEEE Transactions on Network and Service Management.

[30]  Steffen Bondorf Better bounds by worse assumptions — Improving network calculus accuracy by adding pessimism to the network model , 2017, 2017 IEEE International Conference on Communications (ICC).

[31]  Marc Boyer,et al.  Embedding network calculus and event stream theory in a common model , 2016, 2016 IEEE 21st International Conference on Emerging Technologies and Factory Automation (ETFA).

[32]  Mor Harchol-Balter,et al.  PriorityMeister: Tail Latency QoS for Shared Networked Storage , 2014, SoCC.

[33]  Jens B. Schmitt,et al.  Quality and Cost of Deterministic Network Calculus , 2016, Proc. ACM Meas. Anal. Comput. Syst..

[34]  Georg Carle,et al.  Network engineering for real-time networks: comparison of automotive and aeronautic industries approaches , 2016, IEEE Communications Magazine.

[35]  Jens B. Schmitt,et al.  The DiscoDNC v2 - A Comprehensive Tool for Deterministic Network Calculus , 2014, VALUETOOLS.

[36]  Ivan Martinovic,et al.  Improving Performance Bounds in Feed-Forward Networks by Paying Multiplexing Only Once , 2008, MMB.

[37]  Bodo Rosenhahn,et al.  Neural Networks for Measurement-based Bandwidth Estimation , 2018, 2018 IFIP Networking Conference (IFIP Networking) and Workshops.

[38]  Ivan Martinovic,et al.  Pay bursts only once holds for (some) non-FIFO systems , 2011, 2011 Proceedings IEEE INFOCOM.

[39]  Fabien Geyer,et al.  DeepComNet: Performance evaluation of network topologies using graph-based deep learning , 2019, Perform. Evaluation.

[40]  Sebastian Vastag,et al.  Modeling quantitative requirements in SLAs with network calculus , 2011, VALUETOOLS.

[41]  Alán Aspuru-Guzik,et al.  Convolutional Networks on Graphs for Learning Molecular Fingerprints , 2015, NIPS.

[42]  F. Scarselli,et al.  A new model for learning in graph domains , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[43]  Fabien Geyer,et al.  Performance Evaluation of Network Topologies using Graph-Based Deep Learning , 2017, VALUETOOLS.

[44]  Jean-Yves Le Boudec A Theory of Traffic Regulators for Deterministic Networks with Application to Interleaved Regulators , 2018, IEEE/ACM Trans. Netw..

[45]  Samuel S. Schoenholz,et al.  Neural Message Passing for Quantum Chemistry , 2017, ICML.

[46]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.