Ultra-Low Latency Multi-Task Offloading in Mobile Edge Computing

With the development of computer technology, computational-intensive and delay-sensitive applications are emerging endlessly, and they are limited by the computing power and battery life of Smart Mobile Devices (SMDs). Mobile edge computing (MEC) is a computation model with great potential to meet application requirements and alleviate burdens on SMDs through computation offloading. However, device mobility and server status variability in the multi-server and multi-task scenario bring challenges to the computation offloading. To cope with these challenges, we first propose a parallel task offloading model and a small area-based edge offloading scheme in MEC. Then, we formulate the optimization problem to minimize the completion time of all tasks, and transform the problem into a deep reinforcement learning-based offloading scheme by Markov decision approach. Furthermore, we present a deep deterministic policy gradient (DDPG) approach for obtaining the offloading strategy. Experimental results demonstrate that the DDPG- based offloading approach improves long-term performance by at least 19% in ultra-low latency, efficient usage of servers, and frequent mobility of SMDs over traditional strategies.

[1]  Liang Xiao,et al.  Reinforcement Learning-Based Mobile Offloading for Edge Computing Against Jamming and Interference , 2020, IEEE Transactions on Communications.

[2]  Ying Jun Zhang,et al.  Computation Rate Maximization for Wireless Powered Mobile-Edge Computing With Binary Computation Offloading , 2017, IEEE Transactions on Wireless Communications.

[3]  Hyundong Shin,et al.  Learning for Computation Offloading in Mobile Edge Computing , 2018, IEEE Transactions on Communications.

[4]  Kamran Arshad,et al.  Interference Management in Femtocells , 2013, IEEE Communications Surveys & Tutorials.

[5]  Jiandong Li,et al.  Energy-Efficient Multiuser Partial Computation Offloading With Collaboration of Terminals, Radio Access Network, and Edge Server , 2020, IEEE Transactions on Communications.

[6]  Laizhong Cui,et al.  Joint Optimization of Energy Consumption and Latency in Mobile Edge Computing for Internet of Things , 2019, IEEE Internet of Things Journal.

[7]  Jun Li,et al.  A Super Base Station Architecture for Future Ultra-Dense Cellular Networks: Toward Low Latency and High Energy Efficiency , 2018, IEEE Communications Magazine.

[8]  Ke Zhang,et al.  Edge Intelligence for Energy-Efficient Computation Offloading and Resource Allocation in 5G Beyond , 2020, IEEE Transactions on Vehicular Technology.

[9]  K. B. Letaief,et al.  A Survey on Mobile Edge Computing: The Communication Perspective , 2017, IEEE Communications Surveys & Tutorials.

[10]  Wenzhong Li,et al.  Efficient Multi-User Computation Offloading for Mobile-Edge Cloud Computing , 2015, IEEE/ACM Transactions on Networking.

[11]  Shaojie Tang,et al.  A Framework for Partitioning and Execution of Data Stream Applications in Mobile Cloud Computing , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[12]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[13]  Hancheng Lu,et al.  Power control based time-domain inter-cell interference coordination scheme in DSCNs , 2016, 2016 IEEE International Conference on Communications (ICC).

[14]  Kaibin Huang,et al.  Energy-Efficient Resource Allocation for Mobile-Edge Computation Offloading , 2016, IEEE Transactions on Wireless Communications.

[15]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[16]  Khaled Ben Letaief,et al.  Dynamic Computation Offloading for Mobile-Edge Computing With Energy Harvesting Devices , 2016, IEEE Journal on Selected Areas in Communications.

[17]  Shihao Yan,et al.  Computation Offloading With Instantaneous Load Billing for Mobile Edge Computing , 2022, IEEE Transactions on Services Computing.

[18]  Victor C. M. Leung,et al.  An Efficient Computation Offloading Management Scheme in the Densely Deployed Small Cell Networks With Mobile Edge Computing , 2018, IEEE/ACM Transactions on Networking.

[19]  Ke Zhang,et al.  Energy-Efficient Offloading for Mobile Edge Computing in 5G Heterogeneous Networks , 2016, IEEE Access.

[20]  Jonathan Rodriguez,et al.  Robust Mobile Crowd Sensing: When Deep Learning Meets Edge Computing , 2018, IEEE Network.

[21]  Daniele Tarchi,et al.  Multi-Objective Computation Sharing in Energy and Delay Constrained Mobile Edge Computing Environments , 2021, IEEE Transactions on Mobile Computing.

[22]  Yung-Hsiang Lu,et al.  Cloud Computing for Mobile Users: Can Offloading Computation Save Energy? , 2010, Computer.

[23]  Min Sheng,et al.  Mobile-Edge Computing: Partial Computation Offloading Using Dynamic Voltage Scaling , 2016, IEEE Transactions on Communications.

[24]  Xing Xie,et al.  GeoLife: A Collaborative Social Networking Service among User, Location and Trajectory , 2010, IEEE Data Eng. Bull..

[25]  Jun Zhang,et al.  Stochastic Joint Radio and Computational Resource Management for Multi-User Mobile-Edge Computing Systems , 2017, IEEE Transactions on Wireless Communications.

[26]  Wei-Ying Ma,et al.  Understanding mobility based on GPS data , 2008, UbiComp.

[27]  Jie Xu,et al.  Real-Time Resource Allocation for Wireless Powered Multiuser Mobile Edge Computing With Energy and Task Causality , 2020, IEEE Transactions on Communications.

[28]  Giancarlo Fortino,et al.  Task Offloading and Resource Allocation for Mobile Edge Computing by Deep Reinforcement Learning Based on SARSA , 2020, IEEE Access.

[29]  Weiwei Hu,et al.  Multiagent Actor-Critic Network-Based Incentive Mechanism for Mobile Crowdsensing in Industrial Systems , 2021, IEEE Transactions on Industrial Informatics.

[30]  Xing Xie,et al.  Mining interesting locations and travel sequences from GPS trajectories , 2009, WWW '09.

[31]  Yan Zhang,et al.  Joint Computation Offloading and User Association in Multi-Task Mobile Edge Computing , 2018, IEEE Transactions on Vehicular Technology.

[32]  Dario Pompili,et al.  Joint Task Offloading and Resource Allocation for Multi-Server Mobile-Edge Computing Networks , 2017, IEEE Transactions on Vehicular Technology.

[33]  Hui Tian,et al.  Adaptive sequential offloading game for multi-cell Mobile Edge Computing , 2016, 2016 23rd International Conference on Telecommunications (ICT).

[34]  Yan Zhang,et al.  Deep Reinforcement Learning for Stochastic Computation Offloading in Digital Twin Networks , 2020, IEEE Transactions on Industrial Informatics.

[35]  Keqin Li,et al.  Multi-User Multi-Task Computation Offloading in Green Mobile Edge Cloud Computing , 2019, IEEE Transactions on Services Computing.

[36]  Yueming Cai,et al.  Dynamic Computation Offloading for Mobile Cloud Computing: A Stochastic Game-Theoretic Approach , 2019, IEEE Transactions on Mobile Computing.