Contextual User-Centric Task Offloading for Mobile Edge Computing in Ultra-Dense Network

Integrating mobile edge computing (MEC) in ultra-dense network (UDN) is a key enabler to meet the service demand by allowing smart devices to perform uninterrupted task offloading via densely deployed MEC servers. In most cases, the smart devices randomly move around the whole network. Consequently, the popular “MEC-centralized decision” offloading approach could be inapplicable, as joint decision-making among multiple MEC servers becomes difficult due to time synchronization and information exchange overhead. In this paper, we take a user-centric approach to minimize a long-term delay for a given task duration under a price budget constraint. To address this problem, we develop a novel contextual sleeping bandit learning (CSBL) algorithm, which integrates contextual information and sleeping characteristic to accelerate the learning convergence and leverage Lyapunov optimization to deal with the price budget constraint. Furthermore, we extend to a multiple offloading scenario where multiple MEC servers can be selected in each offloading round and propose a CSBL-multiple (CSBL-M) algorithm to address the exponential increase of the offloading selections. For both CSBL and CSBL-M, we derive the upper bounds of learning regret and provide rigorous proofs that they asymptotically approach the Oracle algorithm within bounded deviations for finite task duration. Simulation results illustrate that our proposed algorithms significantly outperform existing algorithms in both single offloading and multiple offloading scenario.

[1]  B. Vucetic,et al.  Calibrated Bandit Learning for Decentralized Task Offloading in Ultra-Dense Networks , 2022, IEEE Transactions on Communications.

[2]  B. Vucetic,et al.  User-Oriented Task Offloading for Mobile Edge Computing in Ultra-Dense Networks , 2021, 2021 IEEE Global Communications Conference (GLOBECOM).

[3]  Bo Yang,et al.  Computation Offloading in Multi-Access Edge Computing: A Multi-Task Learning Approach , 2021, IEEE Transactions on Mobile Computing.

[4]  Zhi Zhou,et al.  Adaptive User-Managed Service Placement for Mobile Edge Computing via Contextual Multi-Armed Bandit Learning , 2021, IEEE Transactions on Mobile Computing.

[5]  Ehab Mahmoud Mohamed,et al.  Two-Hop Relay Probing in WiGig Device-to-Device Networks Using Sleeping Contextual Bandits , 2021, IEEE Wireless Communications Letters.

[6]  Jiayu Cao,et al.  Adaptive Digital Twin and Multiagent Deep Reinforcement Learning for Vehicular Edge Computing and Networks , 2021, IEEE Transactions on Industrial Informatics.

[7]  Marimuthu Palaniswami,et al.  An Application Placement Technique for Concurrent IoT Applications in Edge and Fog Computing Environments , 2021, IEEE Transactions on Mobile Computing.

[8]  Branka Vucetic,et al.  Constrained Reinforcement Learning for Resource Allocation in Network Slicing , 2021, IEEE Communications Letters.

[9]  Zhibin Gao,et al.  Joint Task Offloading and Resource Allocation for Mobile Edge Computing in Ultra-Dense Network , 2020, GLOBECOM 2020 - 2020 IEEE Global Communications Conference.

[10]  Miao Pan,et al.  Mean Field Game Guided Deep Reinforcement Learning for Task Placement in Cooperative Multiaccess Edge Computing , 2020, IEEE Internet of Things Journal.

[11]  Junjie Yan,et al.  User-Centric Edge Sharing Mechanism in Software-Defined Ultra-Dense Networks , 2020, IEEE Journal on Selected Areas in Communications.

[12]  Zhuo Chen,et al.  Online Learning Enabled Task Offloading for Vehicular Edge Computing , 2020, IEEE Wireless Communications Letters.

[13]  Geyong Min,et al.  Mobility-Aware Multi-User Offloading Optimization for Mobile Edge Computing , 2020, IEEE Transactions on Vehicular Technology.

[14]  Mohammad S. Obaidat,et al.  Mobi-Flow: Mobility-Aware Adaptive Flow-Rule Placement in Software-Defined Access Network , 2019, IEEE Transactions on Mobile Computing.

[15]  Cheng Zhang,et al.  A Mobility-Aware Cross-Edge Computation Offloading Framework for Partitionable Applications , 2019, 2019 IEEE International Conference on Web Services (ICWS).

[16]  Catherine Rosenberg,et al.  Simple and efficient network-aware user association rules for heterogeneous networks , 2019, Comput. Networks.

[17]  Jun Li,et al.  Contract-Based Small-Cell Caching for Data Disseminations in Ultra-Dense Cellular Networks , 2019, IEEE Transactions on Mobile Computing.

[18]  Geoffrey Ye Li,et al.  Collaborative Cloud and Edge Computing for Latency Minimization , 2019, IEEE Transactions on Vehicular Technology.

[19]  Liang Chen,et al.  Mobile Social Data Learning for User-Centric Location Prediction With Application in Mobile Edge Service Migration , 2019, IEEE Internet of Things Journal.

[20]  Zhetao Li,et al.  Energy-Efficient Dynamic Computation Offloading and Cooperative Task Scheduling in Mobile Cloud Computing , 2019, IEEE Transactions on Mobile Computing.

[21]  Xin Liu,et al.  Adaptive Learning-Based Task Offloading for Vehicular Edge Computing Systems , 2019, IEEE Transactions on Vehicular Technology.

[22]  Geoffrey Ye Li,et al.  Ultra-Dense LEO: Integrating Terrestrial-Satellite Networks Into 5G and Beyond for Data Offloading , 2018, IEEE Transactions on Wireless Communications.

[23]  R. M. A. P. Rajatheva,et al.  Sleeping Multi-Armed Bandit Learning for Fast Uplink Grant Allocation in Machine Type Communications , 2018, IEEE Transactions on Communications.

[24]  Shaolei Ren,et al.  Spatio–Temporal Edge Service Placement: A Bandit Learning Approach , 2018, IEEE Transactions on Wireless Communications.

[25]  Xu Chen,et al.  Follow Me at the Edge: Mobility-Aware Dynamic Service Placement for Mobile Edge Computing , 2018, 2018 IEEE/ACM 26th International Symposium on Quality of Service (IWQoS).

[26]  Xuemin Shen,et al.  Cooperative Edge Caching in User-Centric Clustered Mobile Networks , 2017, IEEE Transactions on Mobile Computing.

[27]  Jie Xu,et al.  EMM: Energy-Aware Mobility Management for Mobile Edge Computing in Ultra Dense Networks , 2017, IEEE Journal on Selected Areas in Communications.

[28]  Rose Qingyang Hu,et al.  Fast and Efficient Radio Resource Allocation in Dynamic Ultra-Dense Heterogeneous Networks , 2017, IEEE Access.

[29]  K. B. Letaief,et al.  A Survey on Mobile Edge Computing: The Communication Perspective , 2017, IEEE Communications Surveys & Tutorials.

[30]  Amr M. Youssef,et al.  Ultra-Dense Networks: A Survey , 2016, IEEE Communications Surveys & Tutorials.

[31]  Min Sheng,et al.  Mobile-Edge Computing: Partial Computation Offloading Using Dynamic Voltage Scaling , 2016, IEEE Transactions on Communications.

[32]  Anja Klein,et al.  Context-Aware Proactive Content Caching With Service Differentiation in Wireless Networks , 2016, IEEE Transactions on Wireless Communications.

[33]  Min Dong,et al.  Joint offloading decision and resource allocation for multi-user multi-task mobile cloud , 2016, 2016 IEEE International Conference on Communications (ICC).

[34]  Bo Hu,et al.  User-centric ultra-dense networks for 5G: challenges, methodologies, and directions , 2016, IEEE Wireless Communications.

[35]  Xiqi Gao,et al.  Cellular architecture and key technologies for 5G wireless communication networks , 2014, IEEE Communications Magazine.

[36]  Robert D. Kleinberg,et al.  Regret bounds for sleeping experts and bandits , 2010, Machine Learning.

[37]  Mei Han,et al.  Efficient hierarchical graph-based video segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[38]  Martin Pál,et al.  Contextual Multi-Armed Bandits , 2010, AISTATS.

[39]  Peter Auer,et al.  Finite-time Analysis of the Multiarmed Bandit Problem , 2002, Machine Learning.

[40]  Ian F. Akyildiz,et al.  A new random walk model for PCS networks , 2000, IEEE Journal on Selected Areas in Communications.

[41]  Victor C. M. Leung,et al.  Resource Allocation for Ultra-Dense Networks: A Survey, Some Research Issues and Challenges , 2019, IEEE Communications Surveys & Tutorials.

[42]  B. Krishnamachari,et al.  Combinatorial Network Optimization With Unknown Variables : Multi-Armed Bandits With Linear Rewards and Individual Observations , 2012 .

[43]  N. Fisher,et al.  Probability Inequalities for Sums of Bounded Random Variables , 1994 .