Deep Reinforcement Learning Based Computation Offloading for Not Only Stack Architecture

New technologies emerge with regard to computation offloading, allocating parts of applications to powerful servers to meet demands for the massive traffic of mobile devices. In this paper, we study an offloading framework enabled by Not Only Stack (NO Stack). NO Stack, a promising architecture adopts the virtualization technology, guarantees the implementation of machine learning. A deep reinforcement algorithm triggers energy-efficient strategies with handover control when a mobile device moves among cells. Offloading decisions are formulated by an agent with the feedback from the complex environment. Simulation results demonstrate that our proposed offloading system based on NO Stack reduces the energy consumption and cuts down handover rates for mobile devices, compared with the conventional system when executing a service workflow.

[1]  Albert Y. Zomaya,et al.  Computation Offloading for Service Workflow in Mobile Cloud Computing , 2015, IEEE Transactions on Parallel and Distributed Systems.

[2]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[3]  John J. Prevost,et al.  A machine learning based approach to mobile cloud offloading , 2017, 2017 Computing Conference.

[4]  Xin Wang,et al.  Computation offloading for mobile edge computing: A deep learning approach , 2017, 2017 IEEE 28th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC).

[5]  Jing Wang,et al.  An Innovative EPC with Not Only Stack for beyond 5G Mobile Networks , 2018, 2018 IEEE 87th Vehicular Technology Conference (VTC Spring).

[6]  Xin Su,et al.  NO stack: A software-defined framework for 5G mobile network , 2016, 2016 23rd International Conference on Telecommunications (ICT).

[7]  岩井 孝法,et al.  Mobile Edge Computingの動向とNECにおける取り組み , 2016 .

[8]  Yoshiaki Tanaka,et al.  A reinforcement learning approach for cost- and energy-aware mobile data offloading , 2016, 2016 18th Asia-Pacific Network Operations and Management Symposium (APNOMS).

[9]  Jing Wang,et al.  5G virtualized radio access network approach based on NO Stack framework , 2017, 2017 IEEE International Conference on Communications (ICC).

[10]  Richard Demo Souza,et al.  A Survey of Machine Learning Techniques Applied to Self-Organizing Cellular Networks , 2017, IEEE Communications Surveys & Tutorials.

[11]  Hui Tian,et al.  Fine-granularity based application offloading policy in cloud-enhanced small cell networks , 2016, 2016 IEEE International Conference on Communications Workshops (ICC).

[12]  Refonaa Rayan,et al.  A survey on secure data offloading using auction based mechanism , 2017, 2017 International Conference on Computation of Power, Energy Information and Commuincation (ICCPEIC).

[13]  Khaled Ben Letaief,et al.  Dynamic Computation Offloading for Mobile-Edge Computing With Energy Harvesting Devices , 2016, IEEE Journal on Selected Areas in Communications.