A Machine Learning Approach for Software-Defined Vehicular Ad Hoc Networks with Trust Management

Vehicular ad hoc networks (VANETs) have become a promising technology in smart transportation systems with rising interest of expedient, safe, and high- efficient transportation. Dynamicity and infrastructure-less of VANETs make it vulnerable to malicious nodes and result in performance degradation. In this paper, we propose a software- defined trust based deep reinforcement learning framework (TDRL-RP), deploying a deep Q-learning algorithm into a logically centralized controller of software-defined networking (SDN). Specifically, the SDN controller is used as an agent to learn the highest routing path trust value of a VANET environment by convolution neural network, where the trust model is designed to evaluate neighbors' behaviour of forwarding packets. Simulation results are presented to show the effectiveness of the proposed TDRL-RP framework.

[1]  F. Richard Yu,et al.  Software-Defined Networking (SDN) and Distributed Denial of Service (DDoS) Attacks in Cloud Computing Environments: A Survey, Some Research Issues, and Challenges , 2016, IEEE Communications Surveys & Tutorials.

[2]  Zhiping Jia,et al.  Trust-based on-demand multipath routing in mobile ad hoc networks , 2010, IET Inf. Secur..

[3]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[4]  Kalyani Handal,et al.  Security Enhancements for Mobile Ad Hoc Networks with Trust Management Using Uncertain Reasoning , 2018 .

[5]  Charles E. Perkins,et al.  Ad hoc On-Demand Distance Vector (AODV) Routing , 2001, RFC.

[6]  Azzedine Boukerche,et al.  Security and quality of service (QoS) co-design using game theory in cooperative wireless ad hoc networks , 2012, DIVANet '12.

[7]  Gautam M. Borkar,et al.  A secure and trust based on-demand multipath routing scheme for self-organized mobile ad-hoc networks , 2017, Wirel. Networks.

[8]  Salim Chikhi,et al.  Dynamic fuzzy logic and reinforcement learning for adaptive energy efficient routing in mobile ad-hoc networks , 2016, Appl. Soft Comput..

[9]  Yonggang Wen,et al.  “ A Survey of Software Defined Networking , 2020 .

[10]  Azzedine Boukerche,et al.  Cooperative Spectrum Sensing with Trust Assistance for Cognitive Radio Vehicular Ad hoc Networks , 2015, DIVANet@MSWiM.

[11]  Azzedine Boukerche,et al.  Securing vehicular ad hoc networks with mean field game theory , 2013, DIVANet '13.

[12]  J. J. Magdum,et al.  Trust-based security for Ad-Hoc network , 2014 .

[13]  F. Richard Yu Connected Vehicles for Intelligent Transportation Systems [Guest editorial] , 2016, IEEE Trans. Veh. Technol..

[14]  Jim Esch,et al.  Software-Defined Networking: A Comprehensive Survey , 2015, Proc. IEEE.

[15]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[16]  Deepak Dembla,et al.  Investigating the security threats in Vehicular ad hoc Networks (VANETs): Towards security engineering for safer on-road transportation , 2014, 2014 International Conference on Advances in Computing, Communications and Informatics (ICACCI).