NOMA-based energy-efficient task scheduling in vehicular edge computing networks: A self-imitation learning-based approach

Mobile Edge Computing (MEC) is promising to alleviate the computation and storage burdens for terminals in wireless networks. The huge energy consumption of MEC servers challenges the establishment of smart cities and their service time powered by rechargeable batteries. In addition, Orthogonal Multiple Access (OMA) technique cannot utilize limited spectrum resources fully and efficiently. Therefore, Non-Orthogonal Multiple Access (NOMA)-based energy-efficient task scheduling among MEC servers for delay-constraint mobile applications is important, especially in highly-dynamic vehicular edge computing networks. The various movement patterns of vehicles lead to unbalanced offloading requirements and different load pressure for MEC servers. Self-Imitation Learning (SIL)-based Deep Reinforcement Learning (DRL) has emerged as a promising machine learning technique to break through obstacles in various research fields, especially in time-varying networks. In this paper, we first introduce related MEC technologies in vehicular networks. Then, we propose an energy-efficient approach for task scheduling in vehicular edge computing networks based on DRL, with the purpose of both guaranteeing the task latency requirement for multiple users and minimizing total energy consumption of MEC servers. Numerical results demonstrate that the proposed algorithm outperforms other methods.

[1]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[2]  Nan Zhao,et al.  Integrated Networking, Caching, and Computing for Connected Vehicles: A Deep Reinforcement Learning Approach , 2018, IEEE Transactions on Vehicular Technology.

[3]  Lei Wang,et al.  Offloading in Internet of Vehicles: A Fog-Enabled Real-Time Traffic Management System , 2018, IEEE Transactions on Industrial Informatics.

[4]  Yan Shi,et al.  A Vision of C-V2X: Technologies, Field Testing, and Challenges With Chinese Development , 2020, IEEE Internet of Things Journal.

[5]  Bin Hu,et al.  Joint Computing and Caching in 5G-Envisioned Internet of Vehicles: A Deep Reinforcement Learning-Based Traffic Control System , 2020, IEEE Transactions on Intelligent Transportation Systems.

[6]  Zhaolong Ning,et al.  Imitation Learning Enabled Task Scheduling for Online Vehicular Edge Computing , 2022, IEEE Transactions on Mobile Computing.

[7]  Chadi Assi,et al.  Energy harvesting in vehicular networks: a contemporary survey , 2016, IEEE Wireless Communications.

[8]  Depeng Jin,et al.  Vehicular Fog Computing: A Viewpoint of Vehicles as the Infrastructures , 2016, IEEE Transactions on Vehicular Technology.

[9]  Shahid Mumtaz,et al.  Energy-Efficient Vehicular Heterogeneous Networks for Green Cities , 2018, IEEE Transactions on Industrial Informatics.

[10]  Tie Qiu,et al.  Mobile Edge Computing Enabled 5G Health Monitoring for Internet of Medical Things: A Decentralized Game Theoretic Approach , 2021, IEEE Journal on Selected Areas in Communications.

[11]  Shanzhi Chen,et al.  A trajectory prediction based intelligent handover control method in UAV cellular networks , 2019, China Communications.

[12]  Victor C. M. Leung,et al.  Partial Computation Offloading and Adaptive Task Scheduling for 5G-Enabled Vehicular Networks , 2022, IEEE Transactions on Mobile Computing.

[13]  Terence D. Todd,et al.  Downlink Traffic Scheduling in Green Vehicular Roadside Infrastructure , 2013, IEEE Transactions on Vehicular Technology.

[14]  Ke Zhang,et al.  Mobile-Edge Computing for Vehicular Networks: A Promising Network Paradigm with Predictive Off-Loading , 2017, IEEE Veh. Technol. Mag..

[15]  Jianping Pan,et al.  Delay Minimization for Data Dissemination in Large-Scale VANETs with Buses and Taxis , 2016, IEEE Transactions on Mobile Computing.

[16]  Zhaolong Ning,et al.  Multi-Agent Imitation Learning for Pervasive Edge Computing: A Decentralized Computation Offloading Algorithm , 2021, IEEE Transactions on Parallel and Distributed Systems.

[17]  Jun Huang,et al.  Intelligent Edge Computing in Internet of Vehicles: A Joint Computation Offloading and Caching Solution , 2021, IEEE Transactions on Intelligent Transportation Systems.

[18]  K. B. Letaief,et al.  A Survey on Mobile Edge Computing: The Communication Perspective , 2017, IEEE Communications Surveys & Tutorials.