Continuous Distributed Monitoring in the Evolved Packet Core

For performance analysis, optimization and anomaly detection, there is strong need to monitor industrial systems, which, along modern datacenter infrastructures, feature a high level of decentralization. Continuous Distributed Monitoring (CDM) corresponds to the task of continuously keeping track of statistics from different distributed nodes. We review the feasibility of implementing state-of-the-art CDM algorithms in a large-scale, distributed, performance-critical production system. The study is on the Evolved Packet Core (EPC), an inherently distributed component of the 4G architecture, for processing mobile broadband data. In this work, we propose adjustments to classical models that are needed to account for communication and computation delays and the hierarchical architecture present in production systems. We further demonstrate efficient CDM implementations in the EPC, and analyze trade-offs of accuracy versus savings in communication, as well as availability of the monitoring system.

[1]  Stefan Rommer,et al.  EPC and 4G Packet Networks - Driving the Mobile Broadband Revolution, Second Edition , 2012 .

[2]  Piotr Indyk,et al.  Maintaining Stream Statistics over Sliding Windows , 2002, SIAM J. Comput..

[3]  Marina Papatriantafilou,et al.  DRIVEN: a Framework for Efficient Data Retrieval and Clustering in Vehicular Networks , 2019, 2019 IEEE 35th International Conference on Data Engineering (ICDE).

[4]  Donald Beaver,et al.  Dapper, a Large-Scale Distributed Systems Tracing Infrastructure , 2010 .

[5]  Assaf Schuster,et al.  A Geometric Approach to Monitoring Threshold Functions over Distributed Data Streams , 2010, Ubiquitous Knowledge Discovery.

[6]  David E. Culler,et al.  The ganglia distributed monitoring system: design, implementation, and experience , 2004, Parallel Comput..

[7]  Navrati Saxena,et al.  Next Generation 5G Wireless Networks: A Comprehensive Survey , 2016, IEEE Communications Surveys & Tutorials.

[8]  Jennifer Widom,et al.  Adaptive filters for continuous queries over distributed data streams , 2003, SIGMOD '03.

[9]  Konstantinos Peratinos,et al.  EPGTOP: A tool for continuous monitoring of a distributed system , 2019 .

[10]  Magnus Almgren,et al.  Geometric Monitoring in Action: a Systems Perspective for the Internet of Things , 2018, 2018 IEEE 43rd Conference on Local Computer Networks (LCN).

[11]  Christopher Olston,et al.  Distributed top-k monitoring , 2003, SIGMOD '03.

[12]  Graham Cormode,et al.  Holistic aggregates in a networked world: distributed tracking of approximate quantiles , 2005, SIGMOD '05.

[13]  Lap-Kei Lee,et al.  Continuous Monitoring of Distributed Data Streams over a Time-Based Sliding Window , 2011, Algorithmica.

[14]  Graham Cormode,et al.  The continuous distributed monitoring model , 2013, SGMD.

[15]  Richard Mortier,et al.  Magpie: Online Modelling and Performance-aware Systems , 2003, HotOS.

[16]  Qin Zhang,et al.  Optimal Tracking of Distributed Heavy Hitters and Quantiles , 2011, Algorithmica.

[17]  Feifei Li,et al.  Distributed Online Tracking , 2015, SIGMOD Conference.