Task Migration Based on Reinforcement Learning in Vehicular Edge Computing

Multiaccess edge computing (MEC) has emerged as a promising technology for time-sensitive and computation-intensive tasks. With the high mobility of users, especially in a vehicular environment, computational task migration between vehicular edge computing servers (VECSs) has become one of the most critical challenges in guaranteeing quality of service (QoS) requirements. If the vehicle’s tasks unequally migrate to specific VECSs, the performance can degrade in terms of latency and quality of service. Therefore, in this study, we define a computational task migration problem for balancing the loads of VECSs and minimizing migration costs. To solve this problem, we adopt a reinforcement learning algorithm in a cooperative VECS group environment that can collaborate with VECSs in the group. The objective of this study is to optimize load balancing and migration cost while satisfying the delay constraints of the computation task of vehicles. Simulations are performed to evaluate the performance of the proposed algorithm. The results show that compared to other algorithms, the proposed algorithm achieves approximately 20–40% better load balancing and approximately 13–28% higher task completion rate within the delay constraints.

[1]  Kin K. Leung,et al.  Dynamic Service Migration in Mobile Edge Computing Based on Markov Decision Process , 2019, IEEE/ACM Transactions on Networking.

[2]  Qian Wang,et al.  Deep Reinforcement Learning Based Service Migration Strategy for Edge Computing , 2019, 2019 IEEE International Conference on Service-Oriented System Engineering (SOSE).

[3]  Ning Zhang,et al.  A Survey on Service Migration in Mobile Edge Computing , 2018, IEEE Access.

[4]  Du Xu,et al.  Joint Load Balancing and Offloading in Vehicular Edge Computing and Networks , 2019, IEEE Internet of Things Journal.

[5]  Xuemin Shen,et al.  Reinforcement Learning Based Computation Migration for Vehicular Cloud Computing , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[6]  Chao Yang,et al.  Efficient Mobility-Aware Task Offloading for Vehicular Edge Computing Networks , 2019, IEEE Access.

[7]  Xuejing Li,et al.  A Compute-intensive Service Migration Strategy Based on Deep Reinforcement Learning Algorithm , 2020, 2020 IEEE 4th Information Technology, Networking, Electronic and Automation Control Conference (ITNEC).

[8]  Song Guo,et al.  Resource Management at the Network Edge: A Deep Reinforcement Learning Approach , 2019, IEEE Network.

[9]  Kenli Li,et al.  Distributed Task Migration Optimization in MEC by Extending Multi-Agent Deep Reinforcement Learning Approach , 2021, IEEE Transactions on Parallel and Distributed Systems.

[10]  Zoubeir Mlika,et al.  Preemptive SDN Load Balancing With Machine Learning for Delay Sensitive Applications , 2020, IEEE Transactions on Vehicular Technology.

[11]  Yanning Zhang,et al.  Task Offloading in Vehicular Edge Computing Networks: A Load-Balancing Solution , 2020, IEEE Transactions on Vehicular Technology.

[12]  Shaohua Wan,et al.  Edge Computing-Enabled Resource Provisioning for Video Surveillance in Internet of Vehicles , 2019, iSCI.

[13]  K. B. Letaief,et al.  A Survey on Mobile Edge Computing: The Communication Perspective , 2017, IEEE Communications Surveys & Tutorials.

[14]  Tao Lin,et al.  A Joint Service Migration and Mobility Optimization Approach for Vehicular Edge Computing , 2020, IEEE Transactions on Vehicular Technology.

[15]  Gang Liu,et al.  Computation Migration and Resource Allocation in Heterogeneous Vehicular Networks: A Deep Reinforcement Learning Approach , 2020, IEEE Access.

[16]  Shang Gao,et al.  An End-to-End Load Balancer Based on Deep Learning for Vehicular Network Traffic Control , 2019, IEEE Internet of Things Journal.

[17]  Yan Zhang,et al.  Joint Computation Offloading and User Association in Multi-Task Mobile Edge Computing , 2018, IEEE Transactions on Vehicular Technology.

[18]  Sangheon Pack,et al.  Trajectory-Aware Edge Node Clustering in Vehicular Edge Clouds , 2019, 2019 16th IEEE Annual Consumer Communications & Networking Conference (CCNC).

[19]  Haoran Cui,et al.  Reinforcement learning-based joint task offloading and migration schemes optimization in mobility-aware MEC network , 2020, China Communications.