Joint Optimization of Spectrum and Energy Efficiency Considering the C-V2X Security: A Deep Reinforcement Learning Approach

Cellular vehicle-to-everything (C-V2X) communication, as a part of 5G wireless communication, has been considered one of the most significant techniques for Smart City. Vehicles platooning is an application of Smart City that improves traffic capacity and safety by C-V2X. However, different from vehicles platooning travelling on highways, C-V2X could be more easily eavesdropped and the spectrum resource could be limited when they converge at an intersection. Satisfying the secrecy rate of C-V2X, how to increase the spectrum efficiency (SE) and energy efficiency (EE) in the platooning network is a big challenge. In this paper, to solve this problem, we propose a Security-Aware Approach to Enhancing SE and EE Based on Deep Reinforcement Learning, named SEED. The SEED formulates an objective optimization function considering both SE and EE, and the secrecy rate of C-V2X is treated as a critical constraint of this function. The optimization problem is transformed into the spectrum and transmission power selections of V2V and V2I links using deep Q network (DQN). The heuristic result of SE and EE is obtained by the DQN policy based on rewards. Finally, we simulate the traffic and communication environments using Python. The evaluation results demonstrate that the SEED outperforms the DQN-wopa algorithm and the baseline algorithm by 31.83 % and 68.40 % in efficiency. Source code for the SEED is available at this https URL.

[1]  Xuanli Wu,et al.  Joint Optimization of EE and SE Considering Interference Threshold in Ultra-Dense Networks , 2019, 2019 15th International Wireless Communications & Mobile Computing Conference (IWCMC).

[2]  Xin Chen,et al.  Deep Reinforcement Learning Based Dynamic Resource Allocation in 5G Ultra-Dense Networks , 2019, 2019 IEEE International Conference on Smart Internet of Things (SmartIoT).

[3]  Azhar Hussain,et al.  Artificial Intelligence for Vehicle-to-Everything: A Survey , 2019, IEEE Access.

[4]  Xuemin Shen,et al.  Security-Aware Resource Sharing for D2D Enabled Multiplatooning Vehicular Communications , 2019, 2019 IEEE 90th Vehicular Technology Conference (VTC2019-Fall).

[5]  Pengfei Wang,et al.  Platoon Cooperation in Cellular V2X Networks for 5G and Beyond , 2019, IEEE Transactions on Wireless Communications.

[6]  Geoffrey Ye Li,et al.  Deep Reinforcement Learning Based Resource Allocation for V2V Communications , 2018, IEEE Transactions on Vehicular Technology.

[7]  Gang Cao,et al.  AIF: An Artificial Intelligence Framework for Smart Wireless Network Management , 2018, IEEE Communications Letters.

[8]  Bin-Jie Hu,et al.  Outage-Constrained Device-to-Device Links Reuse Maximization and Its Application in Platooning , 2019, IEEE Wireless Communications Letters.

[9]  Giovanni Stea,et al.  Cellular-V2X Communications for Platooning: Design and Evaluation , 2018, Sensors.

[10]  Yang Yang,et al.  Optimal power control for energy efficiency of device-to-device communication underlaying cellular networks , 2016, 2016 IEEE 14th International Conference on Industrial Informatics (INDIN).

[11]  Wei Ni,et al.  Uncoordinated Pseudonym Changes for Privacy Preserving in Distributed Networks , 2020, IEEE Transactions on Mobile Computing.