Adaptive Computing Scheduling for Edge-Assisted Autonomous Driving

This paper investigates computing resource scheduling for real-time applications in autonomous driving, such as localization and obstacle avoidance. In our considered scenario, autonomous vehicles periodically sense the environment, offload sensor data to an edge server for processing, and receive computing results from the server. Due to mobility and computing latency, a vehicle travels some distance in the duration between the instant of offloading its sensor data and the instant of receiving the computing result. Our objective is finding a scheduling scheme for the edge sever to minimize the above traveled distance of vehicles. The approach is to determine the processing order according to individual vehicle mobility and computing capability of the edge server. We formulate a restless multi-arm bandit (RMAB) problem, design a Whittle index based stochastic scheduling scheme, and determine the index using a deep reinforcement learning (DRL) method. The proposed scheduling scheme avoids the time-consuming policy exploration common in DRL scheduling approaches and makes effectual decisions with low complexity. Extensive simulation results demonstrate that the proposed indexed-based scheme can deliver computing results to the vehicles promptly while adapting to time-variant vehicle mobility.

[1]  Xianfu Chen,et al.  Age of Information Aware Radio Resource Management in Vehicular Networks: A Proactive Deep Reinforcement Learning Perspective , 2019, IEEE Transactions on Wireless Communications.

[2]  Daxin Tian,et al.  Reliability-Optimal Cooperative Communication and Computing in Connected Vehicle Systems , 2020, IEEE Transactions on Mobile Computing.

[3]  Roy D. Yates,et al.  The Age of Information: Real-Time Status Updating by Multiple Sources , 2016, IEEE Transactions on Information Theory.

[4]  Weisong Shi,et al.  Edge Computing for Autonomous Driving: Opportunities and Challenges , 2019, Proceedings of the IEEE.

[5]  Bhaskar Krishnamachari,et al.  Restless Poachers: Handling Exploration-Exploitation Tradeoffs in Security Domains , 2016, AAMAS.

[6]  Qinglin Zhao,et al.  Dependency-Aware Task Scheduling in Vehicular Edge Computing , 2020, IEEE Internet of Things Journal.

[7]  Xinping Guan,et al.  Age-of-Information Aware Scheduling for Edge-Assisted Industrial Wireless Networks , 2021, IEEE Transactions on Industrial Informatics.

[8]  Qing Zhao,et al.  Indexability of Restless Bandit Problems and Optimality of Whittle Index for Dynamic Multichannel Access , 2008, IEEE Transactions on Information Theory.

[9]  Lian Zhao,et al.  An SMDP-Based Prioritized Channel Allocation Scheme in Cognitive Enabled Vehicular Ad Hoc Networks , 2017, IEEE Transactions on Vehicular Technology.

[10]  Yunzhou Li,et al.  A Novel Mobile Edge Computing-Based Architecture for Future Cellular Vehicular Networks , 2017, 2017 IEEE Wireless Communications and Networking Conference (WCNC).

[11]  Daniele Munaretto,et al.  Multi-Access Edge Computing: The Driver Behind the Wheel of 5G-Connected Cars , 2018, IEEE Communications Standards Magazine.

[12]  Weihua Zhuang,et al.  SDN/NFV-Empowered Future IoV With Enhanced Communication, Computing, and Caching , 2020, Proceedings of the IEEE.

[13]  Sebastien Glaser,et al.  Simultaneous Localization and Mapping: A Survey of Current Trends in Autonomous Driving , 2017, IEEE Transactions on Intelligent Vehicles.

[14]  K. B. Letaief,et al.  Mobile Edge Intelligence and Computing for the Internet of Vehicles , 2019, Proceedings of the IEEE.

[15]  Ju Ren,et al.  A Survey on End-Edge-Cloud Orchestrated Network Computing Paradigms , 2019, ACM Comput. Surv..

[16]  X. Shen,et al.  Deep Reinforcement Learning Based Resource Management for Multi-Access Edge Computing in Vehicular Networks , 2020, IEEE Transactions on Network Science and Engineering.

[17]  Yusheng Ji,et al.  AVE: Autonomous Vehicular Edge Computing Framework with ACO-Based Scheduling , 2017, IEEE Transactions on Vehicular Technology.

[18]  Xuemin Shen,et al.  Deep Reinforcement Learning for Collaborative Edge Computing in Vehicular Networks , 2020, IEEE Transactions on Cognitive Communications and Networking.

[19]  Xuemin Shen,et al.  Low-Latency and Fresh Content Provision in Information-Centric Vehicular Networks , 2020, IEEE Transactions on Mobile Computing.

[20]  Minglu Li,et al.  LeaD: Large-Scale Edge Cache Deployment Based on Spatio-Temporal WiFi Traffic Statistics , 2021, IEEE Transactions on Mobile Computing.

[21]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[22]  Lei Wang,et al.  Offloading in Internet of Vehicles: A Fog-Enabled Real-Time Traffic Management System , 2018, IEEE Transactions on Industrial Informatics.

[23]  Eytan Modiano,et al.  Scheduling Policies for Minimizing Age of Information in Broadcast Wireless Networks , 2018, IEEE/ACM Transactions on Networking.

[24]  Vaneet Aggarwal,et al.  Joint Information Freshness and Completion Time Optimization for Vehicular Networks , 2018, IEEE Transactions on Services Computing.

[25]  Rose Qingyang Hu,et al.  Mobility-Aware Edge Caching and Computing in Vehicle Networks: A Deep Reinforcement Learning , 2018, IEEE Transactions on Vehicular Technology.

[26]  Yongmin Zhang,et al.  Efficient Computing Resource Sharing for Mobile Edge-Cloud Computing Networks , 2020, IEEE/ACM Transactions on Networking.

[27]  Jin Cao,et al.  Revisiting Computation Partitioning in Future 5G-Based Edge Computing Environments , 2019, IEEE Internet of Things Journal.

[28]  Dipankar Raychaudhuri,et al.  Scalability and Performance Evaluation of Edge Cloud Systems for Latency Constrained Applications , 2018, 2018 IEEE/ACM Symposium on Edge Computing (SEC).

[29]  Yu Cheng,et al.  Only Those Requested Count: Proactive Scheduling Policies for Minimizing Effective Age-of-Information , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[30]  Feng Lyu,et al.  Vehicular Communication Networks in the Automated Driving Era , 2018, IEEE Communications Magazine.

[31]  Yiwei Thomas Hou,et al.  A General Model for Minimizing Age of Information at Network Edge , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[32]  Eui-Nam Huh,et al.  Modeling Data Redundancy and Cost-Aware Task Allocation in MEC-Enabled Internet-of-Vehicles Applications , 2021, IEEE Internet of Things Journal.

[33]  Xuemin Shen,et al.  Energy-Efficient UAV-Assisted Mobile Edge Computing: Resource Allocation and Trajectory Optimization , 2020, IEEE Transactions on Vehicular Technology.

[34]  Ke Zhang,et al.  Mobile-Edge Computing for Vehicular Networks: A Promising Network Paradigm with Predictive Off-Loading , 2017, IEEE Veh. Technol. Mag..

[35]  Qiang Li,et al.  Minimizing Age-of-Information for Fog Computing-supported Vehicular Networks with Deep Q-learning , 2020, ICC 2020 - 2020 IEEE International Conference on Communications (ICC).

[36]  Xin Liu,et al.  Adaptive Learning-Based Task Offloading for Vehicular Edge Computing Systems , 2019, IEEE Transactions on Vehicular Technology.

[37]  P. Whittle Restless Bandits: Activity Allocation in a Changing World , 1988 .

[38]  Sanjit Krishnan Kaul,et al.  Minimizing age of information in vehicular networks , 2011, 2011 8th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks.