Generative Machine Learning for Resource-Aware 5G and IoT Systems

Extrapolations predict that the sheer number of Internet-of-Things (IoT) devices will exceed 40 billion in the next five years. Hand-crafting specialized energy models and monitoring sub-systems for each type of device is error prone, costly, and sometimes infeasible. In order to detect abnormal or faulty behavior as well as inefficient resource usage autonomously, it is of tremendous importance to endow upcoming IoT and 5G devices with sufficient intelligence to deduce an energy model from their own resource usage data. Such models can in-turn be applied to predict upcoming resource consumption and to detect system behavior that deviates from normal states. To this end, we investigate a special class of undirected probabilistic graphical model, the so-called integer Markov random fields (IntMRF). On the one hand, this model learns a full generative probability distribution over all possible states of the system—allowing us to predict system states and to measure the probability of observed states. On the other hand, IntMRFs are themselves designed to consume as less resources as possible—e.g., faithful modelling of systems with an exponentially large number of states, by using only 8-bit unsigned integer arithmetic and less than 16KB memory. We explain how IntMRFs can be applied to model the resource consumption and the system behavior of an IoT device and a 5G core network component, both under various workloads. Our results suggest, that the machine learning model can represent important characteristics of our two test systems and deliver reasonable predictions of the power consumption.

[1]  Rafet Sifa,et al.  Combining Machine Learning and Simulation to a Hybrid Modelling Approach: Current and Future Directions , 2020, IDA.

[2]  Katharina Morik,et al.  Stochastic Discrete Clenshaw-Curtis Quadrature , 2016, ICML.

[3]  Andrew McCallum,et al.  Energy and Policy Considerations for Deep Learning in NLP , 2019, ACL.

[4]  Christian Wietfeld,et al.  LIMITS: Lightweight Machine Learning for IoT Systems with Resource Limitations , 2020, ICC 2020 - 2020 IEEE International Conference on Communications (ICC).

[5]  Nico Piatkowski Exponential families on resource-constrained systems , 2018 .

[6]  C. N. Liu,et al.  Approximating discrete probability distributions with dependence trees , 1968, IEEE Trans. Inf. Theory.

[7]  André Stork,et al.  Analysis of Schedule and Layout Tuning for Sparse Matrices With Compound Entries on GPUs , 2020, Comput. Graph. Forum.

[8]  Matti Järvisalo,et al.  Learning Chordal Markov Networks via Branch and Bound , 2017, NIPS.

[9]  Geoff V. Merrett,et al.  Empirical CPU power modelling and estimation in the gem5 simulator , 2017, 2017 27th International Symposium on Power and Timing Modeling, Optimization and Simulation (PATMOS).

[10]  Jan Bender,et al.  Efficient GPU Data Structures and Methods to Solve Sparse Linear Systems in Dynamics Applications , 2013, Comput. Graph. Forum.

[11]  Tamás Szántai,et al.  On the Approximation of a Discrete Multivariate Probability Distribution Using the New Concept of t -Cherry Junction Tree , 2010 .

[12]  Katharina Morik,et al.  Integer undirected graphical models for resource-constrained systems , 2016, Neurocomputing.

[13]  André Stork,et al.  GPU‐based Polynomial Finite Element Matrix Assembly for Simplex Meshes , 2018, Comput. Graph. Forum.

[14]  Yurii Nesterov,et al.  Smooth minimization of non-smooth functions , 2005, Math. Program..

[15]  Valtteri Niemi,et al.  Distributed Usage Control , 2011, ANT/MobiWIS.

[16]  Y. Nesterov A method for solving the convex programming problem with convergence rate O(1/k^2) , 1983 .

[17]  Stephen P. Boyd,et al.  Proximal Algorithms , 2013, Found. Trends Optim..