Routing using reinforcement learning in vehicular ad hoc networks

In vehicular ad hoc networks (VANETs), the frequent change in vehicle mobility creates dynamic changes in communication link and topology of the network. Hence, the key challenge is to address and resolve longer transmission delays and reduced transmission stability. During the establishment of routing path, the focus of entire research is on traffic detection and road selection with high traffic density for increased packet transmission. This reduces the transmission delays and avoids carry‐and‐forward scenarios; however, these techniques fail in obtaining accurate traffic density in real‐time scenario due to rapid change in traffic density. Thus, it is necessary to create a model that efficiently monitors the traffic density and assist VANETs in route selection in an automated way with increased accuracy. In this article, a novel machine learning architecture using deep reinforcement learning (DRL) model is proposed to monitor and estimate the data essential for the routing protocol. In this model, the roadside unit maintains the traffic information on roads using DRL. The DRL predicts the movement of the vehicle and makes a suitable routing path for transmitting the packets with improved transmission capacity. It further uses predicted transmission delays and the destination location to choose the forwarding directions between two road safety units (RSUs). The application of DRL over VANETs yields increased network performance, which provides on‐demand routing information. The simulation results show that the DRL‐based routing is effective in routing the data packets between the source and destination vehicles than other existing method.

[1]  Wei Kuang Lai,et al.  A Machine Learning System for Routing Decision-Making in Urban Vehicular Ad Hoc Networks , 2015, Int. J. Distributed Sens. Networks.

[2]  Joilson AlvesźJunior,et al.  P-AOMDV: An improved routing protocol for V2V communication based on public transport backbones , 2016 .

[3]  Parthasarathy Panchatcharam,et al.  Internet of Things (IOT) in Healthcare - Smart Health and Surveillance, Architectures, Security Analysis and Data Transfer: A Review , 2019, Int. J. Softw. Innov..

[4]  P. Venkata Krishna,et al.  Learning automata based optimized multipath routingusing leapfrog algorithm for VANETs , 2017, 2017 IEEE International Conference on Communications (ICC).

[5]  Gunasekaran Manogaran,et al.  A novel Gini index decision tree data mining method with neural network classifiers for prediction of heart disease , 2018, Des. Autom. Embed. Syst..

[6]  Ozan K. Tonguz,et al.  MoZo: A Moving Zone Based Routing Protocol Using Pure V2V Communication in VANETs , 2017, IEEE Transactions on Mobile Computing.

[7]  José López Vicario,et al.  VAIMA: A V2V based intersection traffic management algorithm , 2018, 2018 14th Annual Conference on Wireless On-demand Network Systems and Services (WONS).

[8]  R. Varadharajan,et al.  A new approach for prediction of lung carcinoma using back propogation neural network with decision tree classifiers , 2018 .

[9]  Azzedine Boukerche,et al.  V2V protocols for traffic congestion discovery along routes of interest in VANETs: a quantitative study , 2016, Wirel. Commun. Mob. Comput..

[10]  Fan Wu,et al.  A Generalized Multi-Stage P-Persistent MAC Protocol for V2V Communications , 2018, 2018 IEEE 18th International Conference on Communication Technology (ICCT).

[11]  T. Jarin,et al.  Segmentation by Fractional Order Darwinian Particle Swarm Optimization Based Multilevel Thresholding and Improved Lossless Prediction Based Compression Algorithm for Medical Images , 2019, IEEE Access.

[12]  E. J. Thomson Fredrik,et al.  QOS enabled data dissemination in hierarchical VANET using machine learning approach , 2017 .

[13]  Ahmed Yasser,et al.  VANET routing protocol for V2V implementation: A suitable solution for developing countries , 2017 .

[14]  Jie Wu,et al.  Exploiting opportunities in V2V transmissions with RSU-assisted backward delivery , 2017, 2017 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[15]  Mohammad S. Obaidat,et al.  Collaborative Learning Automata-Based Routing for Rescue Operations in Dense Urban Regions Using Vehicular Sensor Networks , 2015, IEEE Systems Journal.

[16]  S. Vivekanandan,et al.  A typical IoT architecture-based regular monitoring of arthritis disease using time wrapping algorithm , 2020 .

[17]  Mashrur Chowdhury,et al.  Vehicle-to-vehicle (V2V) and vehicle-to-infrastructure (V2I) communication in a heterogeneous wireless network – Performance evaluation , 2016 .

[18]  Xiaojiang Du,et al.  Intersection Fog-Based Distributed Routing for V2V Communication in Urban Vehicular Ad Hoc Networks , 2020, IEEE Transactions on Intelligent Transportation Systems.

[19]  Pingzhi Fan,et al.  A Novel Low-Latency V2V Resource Allocation Scheme Based on Cellular V2X Communications , 2019, IEEE Transactions on Intelligent Transportation Systems.

[20]  R. Varatharajan,et al.  Cloud and IoT based disease prediction and diagnosis system for healthcare using Fuzzy neural classifier , 2018, Future Gener. Comput. Syst..

[21]  Jaime Lloret Mauri,et al.  Performance analysis of V2V dynamic anchor position-based routing protocols , 2015, Wirel. Networks.

[22]  Emílio Carlos Gomes Wille,et al.  P‐AOMDV: An improved routing protocol for V2V communication based on public transport backbones , 2016, Trans. Emerg. Telecommun. Technol..

[23]  P. Parthasarathy,et al.  A numerical modelling of an amperometric-enzymatic based uric acid biosensor for GOUT arthritis diseases , 2018 .

[24]  I. Yeom,et al.  Analysis of V2V communication for ADAS , 2017, 2017 Ninth International Conference on Ubiquitous and Future Networks (ICUFN).

[26]  Ting Zhang,et al.  Novel self-adaptive routing service algorithm for application in VANET , 2018, Applied Intelligence.

[27]  Mahamod Ismail,et al.  Vehicular communication ad hoc routing protocols: A survey , 2014, J. Netw. Comput. Appl..

[28]  Juan-Carlos Cano,et al.  Sensing Traffic Density Combining V2V and V2I Wireless Communications , 2015, Sensors.

[29]  Samuel Pierre,et al.  Centralized and Localized Data Congestion Control Strategy for Vehicular Ad Hoc Networks Using a Machine Learning Clustering Algorithm , 2016, IEEE Transactions on Intelligent Transportation Systems.

[30]  Fan Li,et al.  Hierarchical Routing for Vehicular Ad Hoc Networks via Reinforcement Learning , 2019, IEEE Transactions on Vehicular Technology.

[31]  Azzedine Boukerche,et al.  Peer-to-Peer Protocol for Allocated Resources in Vehicular Cloud Based on V2V Communication , 2017, 2017 IEEE Wireless Communications and Networking Conference (WCNC).

[32]  Demin Li,et al.  A Vehicular Collision Avoidance Routing Algorithm based on V2V , 2018, CSoNet.

[33]  N. Yuvaraj,et al.  Analysis on Improving the Response Time with PIDSARSA-RAL in ClowdFlows Mining Platform , 2018, EAI Endorsed Trans. Energy Web.