RL-NSB: Reinforcement Learning-Based 5G Network Slice Broker

Network slicing is considered one of the main pillars of the upcoming 5G networks. Indeed, the ability to slice a mobile network and tailor each slice to the needs of the corresponding tenant is envisioned as a key enabler for the design of future networks. However, this novel paradigm opens up to new challenges, such as isolation between network slices, the allocation of resources across them, and the admission of resource requests by network slice tenants. In this paper, we address this problem by designing the following building blocks for supporting network slicing: i) traffic and user mobility analysis, ii) a learning and forecasting scheme per slice, iii) optimal admission control decisions based on spatial and traffic information, and iv) a reinforcement process to drive the system towards optimal states. In our framework, namely RL-NSB, infrastructure providers perform admission control considering the service level agreements (SLA) of the different tenants as well as their traffic usage and user distribution, and enhance the overall process by the means of learning and the reinforcement techniques that consider heterogeneous mobility and traffic models among diverse slices. Our results show that by relying on appropriately tuned forecasting schemes, our approach provides very substantial potential gains in terms of system utilization while meeting the tenants’ SLAs.

[1]  Injong Rhee,et al.  SLAW: Self-Similar Least-Action Human Walk , 2012, IEEE/ACM Transactions on Networking.

[2]  Roy D. Yates,et al.  Mobile Network Resource Sharing Options: Performance Comparisons , 2013, IEEE Transactions on Wireless Communications.

[3]  Yoji Kajitani,et al.  VLSI module placement based on rectangle-packing by the sequence-pair , 1996, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[4]  Samir Khuller,et al.  Geometric knapsack problems , 1991, Algorithmica.

[5]  Engin Zeydan,et al.  Prediction of active UE number with Bayesian neural networks for self-organizing LTE networks , 2017, 2017 8th International Conference on the Network of the Future (NOF).

[6]  Jonathan Loo,et al.  Dynamic Network Slicing for Multitenant Heterogeneous Cloud Radio Access Networks , 2018, IEEE Transactions on Wireless Communications.

[7]  Vincenzo Sciancalepore,et al.  From network sharing to multi-tenancy: The 5G network slice broker , 2016, IEEE Communications Magazine.

[8]  Christos V. Verikoukis,et al.  A capacity broker architecture and framework for multi-tenant support in LTE-A networks , 2016, 2016 IEEE International Conference on Communications (ICC).

[9]  Sampath Rangarajan,et al.  NVS: A Substrate for Virtualizing Wireless Resources in Cellular Networks , 2012, IEEE/ACM Transactions on Networking.

[10]  Marco Gramaglia,et al.  Mobile traffic forecasting for maximizing 5G network slicing resource utilization , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[11]  Bartlomiej Blaszczyszyn,et al.  How user throughput depends on the traffic demand in large cellular networks , 2013, 2014 12th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt).

[12]  G. Ash Traffic Engineering and QoS Optimization of Integrated Voice & Data Networks , 2006 .

[13]  Christophe Croux,et al.  Robust Forecasting with Exponential and Holt-Winters Smoothing , 2007 .

[14]  Suzhen Wang,et al.  Improved Simulated Annealing Algorithm Solving for 0/1 Knapsack Problem , 2006, Sixth International Conference on Intelligent Systems Design and Applications.

[15]  Wei Song,et al.  AppRAN: Application-oriented radio access network sharing in mobile networks , 2015, 2015 IEEE International Conference on Communications (ICC).

[16]  Hans Kellerer,et al.  A New Fully Polynomial Time Approximation Scheme for the Knapsack Problem , 1999, J. Comb. Optim..

[17]  Di Feng,et al.  A Utility-Driven Multi-Queue Admission Control Solution for Network Slicing , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[18]  Christophe Biernacki,et al.  Choosing starting values for the EM algorithm for getting the highest likelihood in multivariate Gaussian mixture models , 2003, Comput. Stat. Data Anal..

[19]  Sampath Rangarajan,et al.  Radio access network virtualization for future mobile carrier networks , 2013, IEEE Communications Magazine.

[20]  Guidelines for evaluation of radio interface technologies for IMT-Advanced , 2008 .

[21]  Anne B. Koehler,et al.  Forecasting models and prediction intervals for the multiplicative Holt-Winters method , 2001 .

[22]  Andres Garcia-Saavedra,et al.  Overbooking network slices through yield-driven end-to-end orchestration , 2018, CoNEXT.

[23]  Thomas Hofmann,et al.  Unsupervised Learning by Probabilistic Latent Semantic Analysis , 2004, Machine Learning.

[24]  Poonam N. Railkar,et al.  Long-Term and Short-Term Traffic Forecasting Using Holt-Winters Method: A Comparability Approach with Comparable Data in Multiple Seasons , 2017, Int. J. Synth. Emot..

[25]  Sampath Rangarajan,et al.  Radio Access Network sharing in cellular networks , 2013, 2013 21st IEEE International Conference on Network Protocols (ICNP).

[26]  Klaus Jansen,et al.  Maximizing the Total Profit of Rectangles Packed into a Rectangle , 2007, Algorithmica.

[27]  Gustavo de Veciana,et al.  Multi-Tenant Radio Access Network Slicing: Statistical Multiplexing of Spatial Loads , 2016, IEEE/ACM Transactions on Networking.