Joint Optimization of Resource Allocation and Service Performance in vEPC Using Reinforcement Learning

Network Function Virtualization (NFV) is the transition from proprietary hardware functions to virtualized counterparts of them within the telecommunication industry. With the aim of quality of service guarantee and energy saving, telco operates need to decided when and how to scale the virtual resource with the traffic processing demand. In this paper, we proposed an auto-scaling mechanism based on reinforcement learning. First, we establish a system model for vEPC (virtualized Evolved Packed Core) to gather the state information. Second, auto-scaling mechanism based on reinforcement learning can treat procedure of scaling decision as Markov Decision Process. By simulation, our mechanism outperforms threshold based policy, and realizes the joint optimization of resource allocation and service performance in vEPC.

[1]  K. Chandra Sekaran,et al.  An Approach for Dynamic Scaling of Resources in Enterprise Cloud , 2013, 2013 IEEE 5th International Conference on Cloud Computing Technology and Science.

[2]  Rajkumar Buyya,et al.  Adaptive threshold-based approach for energy-efficient consolidation of virtual machines in cloud data centers , 2010, MGC '10.

[3]  H. A. Sanjay,et al.  Threshold Based Auto Scaling of Virtual Machines in Cloud Environment , 2014, NPC.

[4]  Rittwik Jana,et al.  Understanding the bottlenecks in virtualizing cellular core network functions , 2015, The 21st IEEE International Workshop on Local and Metropolitan Area Networks.

[5]  Fei Li,et al.  Efficient Auto-Scaling Approach in the Telco Cloud Using Self-Learning Algorithm , 2014, 2015 IEEE Global Communications Conference (GLOBECOM).

[6]  David K. Chiabi European Telecommunications Standards Institute , 2015 .

[7]  Xing Zhang,et al.  An Approach for Spatial-Temporal Traffic Modeling in Mobile Cellular Networks , 2015, 2015 27th International Teletraffic Congress.

[8]  Fulvio Risso,et al.  An adaptive scaling mechanism for managing performance variations in network functions virtualization: A case study in an NFV-based EPC , 2017, 2017 13th International Conference on Network and Service Management (CNSM).

[9]  Pilar Andres-Maldonado,et al.  Modeling and Dimensioning of a Virtualized MME for 5G Mobile Networks , 2017, IEEE Transactions on Vehicular Technology.

[10]  Johan Tordsson,et al.  Efficient provisioning of bursty scientific workloads on the cloud using adaptive elasticity control , 2012, ScienceCloud '12.