Intelligent Physical Layer Secure Relay Selection for Wireless Cooperative Networks with Multiple Eavesdroppers

The modern and emerging wireless communication technologies are benefiting from relaying techniques, which is already adopted in long term evolution (LTE) Release 10. The relay technology has great potential to improve the communication distance and system capabilities. However, due to the use of short-range frequencies for communication and increasing user density, relay technology requires the integration of machine learning and physical layer security (PLS) to attain its full potential. Therefore, this paper presents the machine learning (ML) algorithms for relay selection (RS) to improve the physical layer security of a dual-hop non-regenerative wireless cooperative network. The secure RS is converted into a prediction and decision-making problem. To the best of our knowledge, this is the first attempt to study the secured RS as a prediction and decision-making problem. We propose two reinforcement-learning techniques, namely the physical layer secured Q-learning algorithm for RS (PQL-RS) and the modified physical layer secured Q-learning algorithm for RS (MPQL-RS) for different scenarios. Markov decision process (MDP) is used with the introduced algorithms to select a single relay from a group of relays and multiple eavesdroppers. RS without requiring the prior data and network model knowledge are the unique advantages of the proposed algorithms. The introduced algorithms are compared to the different RS schemes and simulation results show that the MPQL-RS can deliver the best performance and save the convergence time. Moreover, the secrecy performance of different modulation techniques is also analyzed for the proposed algorithms. It is shown that the secrecy of the system improves by 7% on average for every double in modulation order.

[1]  Junqing Zhang,et al.  Key Generation From Wireless Channels: A Review , 2016, IEEE Access.

[2]  Hyoung-Kyu Song,et al.  A Novel Relay Selection Scheme Based on Q-Learning in Multi-Hop Wireless Networks , 2020 .

[3]  Mérouane Debbah,et al.  Relay Selection Schemes for Dual-Hop Networks under Security Constraints with Multiple Eavesdroppers , 2013, IEEE Transactions on Wireless Communications.

[4]  Nanning Zheng,et al.  Guest Editorial Special Issue on IoT on the Move: Enabling Technologies and Driving Applications for Internet of Intelligent Vehicles (IoIV) , 2019, IEEE Internet Things J..

[5]  Murat Uysal,et al.  On relay selection for decode-and-forward relaying , 2009, IEEE Transactions on Wireless Communications.

[6]  Norman C. Beaulieu,et al.  Exact Analysis of Dual-Hop AF Maximum End-to-End SNR Relay Selection , 2012, IEEE Transactions on Communications.

[7]  Derrick Wing Kwan Ng,et al.  Two-Way Hybrid Terrestrial-Satellite Relaying Systems: Performance Analysis and Relay Selection , 2019, IEEE Transactions on Vehicular Technology.

[8]  Lajos Hanzo,et al.  Joint Relay and Jammer Selection Improves the Physical Layer Security in the Face of CSI Feedback Delays , 2015, IEEE Transactions on Vehicular Technology.

[9]  Xiaowei Wang Decision-Tree-Based Relay Selection in Dualhop Wireless Communications , 2019, IEEE Transactions on Vehicular Technology.

[10]  A. D. Wyner,et al.  The wire-tap channel , 1975, The Bell System Technical Journal.

[11]  Athina P. Petropulu,et al.  Q-Learning Based Predictive Relay Selection for Optimal Relay Beamforming , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Sunghwan Kim,et al.  Relay selection Algorithm for wireless cooperative networks: a learning-based approach , 2017, IET Commun..

[13]  Ning Zhang,et al.  RAV: Relay Aided Vectorized Secure Transmission in Physical Layer Security for Internet of Things Under Active Attacks , 2019, IEEE Internet of Things Journal.

[14]  Claude E. Shannon,et al.  Communication theory of secrecy systems , 1949, Bell Syst. Tech. J..

[15]  Sina Sheikholeslami,et al.  Ablation Programming for Machine Learning , 2019 .

[16]  Jong Wook Kim,et al.  Q-Learning Algorithms: A Comprehensive Classification and Applications , 2019, IEEE Access.

[17]  Poonam Jindal,et al.  Cooperative Communication in Physical Layer Security: Technologies and Challenges , 2019, Wirel. Pers. Commun..

[18]  John S. Thompson,et al.  Relay Selection Issues for Amplify-and-Forward Cooperative Systems with Interference , 2009, 2009 IEEE Wireless Communications and Networking Conference.

[19]  Yu Zhang,et al.  Secure mmWave Communication Using UAV-Enabled Relay and Cooperative Jammer , 2019, IEEE Access.

[20]  Li Sun,et al.  Physical layer security with its applications in 5G networks: A review , 2017, China Communications.

[21]  Dan Wang,et al.  From IoT to 5G I-IoT: The Next Generation IoT-Based Intelligent Algorithms and 5G Technologies , 2018, IEEE Communications Magazine.

[22]  Xiaojiang Du,et al.  Cooperative Communications With Relay Selection Based on Deep Reinforcement Learning in Wireless Sensor Networks , 2019, IEEE Sensors Journal.

[23]  Hien Quoc Ngo,et al.  Secure 5G Wireless Communications: A Joint Relay Selection and Wireless Power Transfer Approach , 2016, IEEE Access.

[24]  B. Sundar Rajan,et al.  Secrecy Capacity of the Gaussian Wire-Tap Channel with Finite Complex Constellation Input , 2010, ArXiv.

[25]  Dong Wang,et al.  A Survey of Optimization Approaches for Wireless Physical Layer Security , 2019, IEEE Communications Surveys & Tutorials.

[26]  Yao Xu,et al.  Relay Selection for Improved Physical Layer Security in Cognitive Relay Networks Using Artificial Noise , 2018, IEEE Access.

[27]  Yuzhe Liu,et al.  Overlapping Community Deep Exploring-Based Relay Selection Method Toward Multi-Hop D2D Communication , 2019, IEEE Wireless Communications Letters.

[28]  Victor C. M. Leung,et al.  Self-Organized Relay Selection for Cooperative Transmission in Vehicular Ad-Hoc Networks , 2017, IEEE Transactions on Vehicular Technology.

[29]  Masoud Ardakani,et al.  Output-Threshold Multiple-Relay-Selection Scheme for Cooperative Wireless Networks , 2010, IEEE Transactions on Vehicular Technology.

[30]  Xiang Zhang,et al.  Partner Selection and Incentive Mechanism for Physical Layer Security , 2015, IEEE Transactions on Wireless Communications.

[31]  Wansu Lim,et al.  Machine Learning for 5G/B5G Mobile and Wireless Communications: Potential, Limitations, and Future Directions , 2019, IEEE Access.

[32]  John S. Thompson,et al.  Comment on "Relay Selection for Secure Cooperative Networks with Jamming" , 2012, IEEE Transactions on Wireless Communications.

[33]  A. J. Han Vinck,et al.  On the Binary Input Gaussian Wiretap Channel with/without Output Quantization , 2017, Entropy.

[34]  Ning Wang,et al.  Physical-Layer Security of 5G Wireless Networks for IoT: Challenges and Opportunities , 2019, IEEE Internet of Things Journal.

[35]  Hai Jiang,et al.  Optimal Relay Selection for Secure Cooperative Communications With an Adaptive Eavesdropper , 2017, IEEE Transactions on Wireless Communications.

[36]  Furqan Jameel,et al.  A Comprehensive Survey on Cooperative Relaying and Jamming Strategies for Physical Layer Security , 2019, IEEE Communications Surveys & Tutorials.

[37]  Caijun Zhong,et al.  Opportunistic Relay Selection for Secrecy Enhancement in Cooperative Networks , 2015, IEEE Transactions on Communications.

[38]  Haji M. Furqan,et al.  Classifications and Applications of Physical Layer Security Techniques for Confidentiality: A Comprehensive Survey , 2019, IEEE Communications Surveys & Tutorials.

[39]  Bernardo Spagnolo,et al.  Nonlinear Relaxation Phenomena in Metastable Condensed Matter Systems , 2016, Entropy.

[40]  Xiaowei Wang,et al.  Data-Driven Relay Selection for Physical-Layer Security: A Decision Tree Approach , 2020, IEEE Access.

[41]  Muhammad R. A. Khandaker,et al.  Truth-Telling Mechanism for Two-Way Relay Selection for Secrecy Communications With Energy-Harvesting Revenue , 2017, IEEE Transactions on Wireless Communications.

[42]  Yong-Hwa Kim,et al.  Machine Learning-Based Relay Selection for Secure Transmission in Multi-Hop DF Relay Networks , 2019, Electronics.