Reinforcement Learning Based Task Offloading and Take-Back in Vehicle Platoon Networks

In this paper, a platoon-assisted vehicular edge computing (PVEC) system is proposed to enhance the efficiency and success of offloading, in which task flows can be migrated to the platoon members. Due to the speed change of Intelligent Connected Vehicles (ICVs) in the platoon, a task offloading and take-back scheme is proposed which can avoid task processing failures by resulting in link disconnection. Considering the multitask offloading system, a multi-leader multi-follower Stackelberg game (MLMF-SG) is formulated to analyse the incentives for task flows and resource allocation for platoon members. In MLMF-SG, task flows as the offloading service consumers are the leaders and the offloading ICVs as the offloading service providers are followers. Specially, we propose an optimization scheme based on Reinforcement Learning (RL) to tackle the price strategies of task flows, which maximizes the player revenues by jointly optimizing the price decision and computing resource allocation. Simulation results verify the relationships among offloading service consumers and providers and demonstrate the excellent adaptability of RL algorithm.

[1]  Anja Klein,et al.  Distributed algorithm for energy efficient multi-hop computation offloading , 2016, 2016 IEEE International Conference on Communications (ICC).

[2]  Lin Gui,et al.  Cooperative Task Scheduling for Computation Offloading in Vehicular Cloud , 2018, IEEE Transactions on Vehicular Technology.

[3]  Yan Zhang,et al.  Optimal delay constrained offloading for vehicular edge computing networks , 2017, 2017 IEEE International Conference on Communications (ICC).

[4]  Ke Zhang,et al.  Mobile-Edge Computing for Vehicular Networks: A Promising Network Paradigm with Predictive Off-Loading , 2017, IEEE Veh. Technol. Mag..

[5]  Robert Schober,et al.  Pricing Mobile Data Offloading: A Distributed Market Framework , 2014, IEEE Transactions on Wireless Communications.

[6]  Depeng Jin,et al.  Vehicular Fog Computing: A Viewpoint of Vehicles as the Infrastructures , 2016, IEEE Transactions on Vehicular Technology.

[7]  Xin Liu,et al.  Learning-Based Task Offloading for Vehicular Cloud Computing Systems , 2018, 2018 IEEE International Conference on Communications (ICC).

[8]  Yu Yao,et al.  Fault-Tolerant Topology Control Towards ${K}$ -Channel-Connectivity in Cognitive Radio Networks , 2018, IEEE Access.

[9]  Lin Tian,et al.  Mobile Edge Computing-Assisted Admission Control in Vehicular Networks: The Convergence of Communication and Computation , 2019, IEEE Vehicular Technology Magazine.

[10]  Yijie Wang,et al.  Key Technologies of MEC Towards 5G-Enabled Vehicular Networks , 2017, QSHINE.

[11]  Xin Liu,et al.  Collaborative Energy and Information Transfer in Green Wireless Sensor Networks for Smart Cities , 2018, IEEE Transactions on Industrial Informatics.

[12]  Mario Gerla,et al.  Vehicular cloud networking: architecture and design principles , 2014, IEEE Communications Magazine.

[13]  Yunyi Liu,et al.  A Dual-Link Soft Handover Scheme for C/U Plane Split Network in High-Speed Railway , 2018, IEEE Access.

[14]  Sangheon Pack,et al.  The Software-Defined Vehicular Cloud: A New Level of Sharing the Road , 2017, IEEE Vehicular Technology Magazine.

[15]  Uri Yechiali,et al.  Queues with slow servers and impatient customers , 2010, Eur. J. Oper. Res..

[16]  Weihua Zhuang,et al.  Traffic Offloading for Online Video Service in Vehicular Networks: A Cooperative Approach , 2018, IEEE Transactions on Vehicular Technology.

[17]  Xiang Cheng,et al.  5G-Enabled Cooperative Intelligent Vehicular (5GenCIV) Framework: When Benz Meets Marconi , 2017, IEEE Intelligent Systems.