Collaborative Learning of Communication Routes in Edge-Enabled Multi-Access Vehicular Environment

Some vehicular Internet-of-Things (IoT) applications have a strict requirement on the end-to-end delay where edge computing can be used to provide a short delay for end-users by conducing efficient caching and computing at the edge nodes. However, a fast and efficient communication route creation in multi-access vehicular environment is an underexplored research problem. In this paper, we propose a collaborative learning-based routing scheme for multi-access vehicular edge computing environment. The proposed scheme employs a reinforcement learning algorithm based on end-edge-cloud collaboration to find routes in a proactive manner with a low communication overhead. The routes are also preemptively changed based on the learned information. By integrating the ``proactive'' and ``preemptive'' approach, the proposed scheme can achieve a better forwarding of packets as compared with existing alternatives. We conduct extensive and realistic computer simulations to show the performance advantage of the proposed scheme over existing baselines.

[1]  Celimuge Wu,et al.  VANET Broadcast Protocol Based on Fuzzy Logic and Lightweight Retransmission Mechanism , 2012, IEICE Trans. Commun..

[2]  Celimuge Wu,et al.  Flexible, Portable, and Practicable Solution for Routing in VANETs: A Fuzzy Constraint Q-Learning Approach , 2013, IEEE Transactions on Vehicular Technology.

[3]  Sherali Zeadally,et al.  QoS-Aware Hierarchical Web Caching Scheme for Online Video Streaming Applications in Internet-Based Vehicular Ad Hoc Networks , 2015, IEEE Transactions on Industrial Electronics.

[4]  Yusheng Ji,et al.  AVE: Autonomous Vehicular Edge Computing Framework with ACO-Based Scheduling , 2017, IEEE Transactions on Vehicular Technology.

[5]  Rose Qingyang Hu,et al.  Mobility-Aware Edge Caching and Computing in Vehicle Networks: A Deep Reinforcement Learning , 2018, IEEE Transactions on Vehicular Technology.

[6]  Zhou Su,et al.  An Edge Caching Scheme to Distribute Content in Vehicular Networks , 2018, IEEE Transactions on Vehicular Technology.

[7]  Yusheng Ji,et al.  Spatial Intelligence toward Trustworthy Vehicular IoT , 2018, IEEE Communications Magazine.

[8]  Song Guo,et al.  Traffic and Computation Co-Offloading With Reinforcement Learning in Fog Computing for Industrial Applications , 2019, IEEE Transactions on Industrial Informatics.

[9]  Yusheng Ji,et al.  Integrating Licensed and Unlicensed Spectrum in the Internet of Vehicles with Mobile Edge Computing , 2019, IEEE Network.

[10]  Kok-Lim Alvin Yau,et al.  Edge Computing in 5G: A Review , 2019, IEEE Access.

[11]  Yusheng Ji,et al.  Mobile Edge Computing for the Internet of Vehicles: Offloading Framework and Job Scheduling , 2019, IEEE Vehicular Technology Magazine.

[12]  Victor C. M. Leung,et al.  Energy-Efficient Subchannel Matching and Power Allocation in NOMA Autonomous Driving Vehicular Networks , 2019, IEEE Wireless Communications.

[13]  Ning Zhang,et al.  Online Proactive Caching in Mobile Edge Computing Using Bidirectional Deep Recurrent Neural Network , 2019, IEEE Internet of Things Journal.

[14]  Syed Hassan Ahmed,et al.  MobQoS: Mobility-Aware and QoS-Driven SDN Framework for Autonomous Vehicles , 2019, IEEE Wireless Communications.

[15]  Jian Liu,et al.  A Novel QoS-Awared Grid Routing Protocol in the Sensing Layer of Internet of Vehicles Based on Reinforcement Learning , 2019, IEEE Access.

[16]  Mehdi Bennis,et al.  Optimized Computation Offloading Performance in Virtual Edge Computing Systems Via Deep Reinforcement Learning , 2018, IEEE Internet of Things Journal.

[17]  Fan Li,et al.  Hierarchical Routing for Vehicular Ad Hoc Networks via Reinforcement Learning , 2019, IEEE Transactions on Vehicular Technology.

[18]  Wenyao Xu,et al.  QoE-Driven Content-Centric Caching With Deep Reinforcement Learning in Edge-Enabled IoT , 2019, IEEE Computational Intelligence Magazine.

[19]  Qiang Ye,et al.  Spectrum Management for Multi-Access Edge Computing in Autonomous Vehicular Networks , 2019, IEEE Transactions on Intelligent Transportation Systems.

[20]  Nan Cheng,et al.  Deep-Learning-Based Joint Optimization of Renewable Energy Storage and Routing in Vehicular Energy Network , 2020, IEEE Internet of Things Journal.

[21]  Azzedine Boukerche,et al.  DACON: A Novel Traffic Prediction and Data-Highway-Assisted Content Delivery Protocol for Intelligent Vehicular Networks , 2020, IEEE Transactions on Sustainable Computing.

[22]  Lajos Hanzo,et al.  Twin-Timescale Radio Resource Management for Ultra-Reliable and Low-Latency Vehicular Networks , 2019, IEEE Transactions on Vehicular Technology.

[23]  Song Guo,et al.  Green Resource Allocation Based on Deep Reinforcement Learning in Content-Centric IoT , 2018, IEEE Transactions on Emerging Topics in Computing.

[24]  Jianshan Zhou,et al.  A Game-Based Computation Offloading Method in Vehicular Multiaccess Edge Computing Networks , 2020, IEEE Internet of Things Journal.

[25]  Jun Zheng,et al.  Modeling and Analysis of the Uplink Local Delay in MEC-Based VANETs , 2020, IEEE Transactions on Vehicular Technology.

[26]  Qimei Cui,et al.  MDP-Based Task Offloading for Vehicular Edge Computing Under Certain and Uncertain Transition Probabilities , 2020, IEEE Transactions on Vehicular Technology.

[27]  Gerhard Fettweis,et al.  Evaluation of Congestion-Enabled Forwarding With Mixed Data Traffic in Vehicular Communications , 2020, IEEE Transactions on Intelligent Transportation Systems.

[28]  Qinglin Zhao,et al.  Dependency-Aware Task Scheduling in Vehicular Edge Computing , 2020, IEEE Internet of Things Journal.

[29]  Yan Zhang,et al.  Deep Reinforcement Learning for Cooperative Content Caching in Vehicular Edge Computing and Networks , 2020, IEEE Internet of Things Journal.

[30]  Lionel Nkenyereye,et al.  Software Defined Network-Based Multi-Access Edge Framework for Vehicular Networks , 2020, IEEE Access.

[31]  Xuemin Shen,et al.  Hierarchical Soft Slicing to Meet Multi-Dimensional QoS Demand in Cache-Enabled Vehicular Networks , 2019, IEEE Transactions on Wireless Communications.

[32]  Ran He,et al.  Kalman Prediction-Based Neighbor Discovery and Its Effect on Routing Protocol in Vehicular Ad Hoc Networks , 2020, IEEE Transactions on Intelligent Transportation Systems.

[33]  Bin Hu,et al.  Joint Computing and Caching in 5G-Envisioned Internet of Vehicles: A Deep Reinforcement Learning-Based Traffic Control System , 2020, IEEE Transactions on Intelligent Transportation Systems.

[34]  Tingting Fu,et al.  Optimal ThrowBoxes assignment for big data multicast in VDTNs , 2019, Wirel. Networks.