Distributed cooperative spectrum sensing based on reinforcement learning in cognitive radio networks

Abstract Spectrum sensing is an initial task for the successful operation of cognitive radio networks (CRN). During cooperative spectrum sensing, malicious secondary user (SU) may report false sensing data which would degrade the final aggregated sensing outcome. In this paper, we propose a distributed cooperative spectrum sensing (CSS) method based on reinforcement learning (RL) to remove data fusion between users with different reputations in CRN. This method regards each SU as an agent, which is selected from the adjacent nodes of CRN participating in CSS. The reputation value is used as reward to ensure that the agent tends to merge with high reputation nodes. The conformance fusion is adopted to promote consensus of the whole network, while it’s also compared with the decision threshold to complete CSS. Simulation results show that the proposed method can identify malicious users effectively. As a result, the whole CRN based on RL is more intelligent and stable.

[1]  Di Chen,et al.  A new joint eigenvalue distribution of finite random matrix for cognitive radio networks , 2016, IET Commun..

[2]  Liang Fangwei,et al.  Reputation-based secure spectrum situation fusion in distributed cognitive radio networks , 2015 .

[3]  Brahmjit Singh,et al.  Overcoming sensing failure problem in double threshold based cooperative spectrum sensing , 2016 .

[4]  Kyung Sup Kwak,et al.  Overlapping coalition formation games based interference coordination for D2D underlaying LTE-A networks , 2016 .

[5]  Zhu Han,et al.  Coalitional game theory for communication networks , 2009, IEEE Signal Processing Magazine.

[6]  Rajoo Pandey,et al.  Eigenvalue based double threshold spectrum sensing under noise uncertainty for cognitive radio , 2016 .

[7]  Qiang Ni,et al.  Application of reinforcement learning for security enhancement in cognitive radio networks , 2015, Appl. Soft Comput..

[8]  Jie Li,et al.  A Trust-Based Cooperative Spectrum Sensing Scheme against SSDF Attack in CRNs , 2016, 2016 IEEE Trustcom/BigDataSE/ISPA.

[9]  Qihui Wu,et al.  A stochastic game framework for joint frequency and power allocation in dynamic decentralized cognitive radio networks , 2013 .

[10]  Ji Wang,et al.  Trust-based cooperative spectrum sensing against SSDF attacks in distributed cognitive radio networks , 2016, 2016 IEEE International Workshop Technical Committee on Communications Quality and Reliability (CQR 2016).

[11]  Hüseyin Arslan,et al.  A survey of spectrum sensing algorithms for cognitive radio applications , 2009, IEEE Communications Surveys & Tutorials.

[12]  Petros Maragos,et al.  Online Wideband Spectrum Sensing Using Sparsity , 2017, IEEE Journal of Selected Topics in Signal Processing.

[13]  Jia Liu,et al.  Sensing performance of efficient cyclostationary detector with multiple antennas in multipath fading and lognormal shadowing environments , 2014, Journal of Communications and Networks.

[14]  Zhu Han,et al.  Game Theory in Wireless and Communication Networks: Theory, Models, and Applications , 2011 .

[15]  Qihui Wu,et al.  Robust Spectrum Sensing With Crowd Sensors , 2014, IEEE Trans. Commun..

[16]  Hanna Bogucka,et al.  Energy-Efficient Cooperative Spectrum Sensing: A Survey , 2016, IEEE Communications Surveys & Tutorials.

[17]  Iti Saha Misra,et al.  Implementation of relay based collaborative spectrum sensing using coalitional games in wireless cognitive radio networks , 2015, Comput. Electr. Eng..

[18]  Zhimin Zeng,et al.  A Low Computational Complexity Algorithm for Compressive Wideband Spectrum Sensing , 2017, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[19]  Qihui Wu,et al.  Spectrum Sensing in Opportunity-Heterogeneous Cognitive Sensor Networks: How to Cooperate? , 2013, IEEE Sensors Journal.

[20]  Zhu Han,et al.  Byzantine Attack and Defense in Cognitive Radio Networks: A Survey , 2015, IEEE Communications Surveys & Tutorials.

[21]  Robert C. Qiu,et al.  Cooperative spectrum sensing using Q-learning with experimental validation , 2011, 2011 Proceedings of IEEE Southeastcon.

[22]  Saleem Ahmed,et al.  Efficient SIC-MMSE MIMO detection with three iterative loops , 2017 .

[23]  Seyed Mohammad Sajad Sadough,et al.  Optimal soft combination for multiple antenna energy detection under primary user emulation attacks , 2015 .

[24]  Mikko Valkama,et al.  Energy Detection under IQ Imbalance with Single- and Multi-Channel Direct-Conversion Receiver: Analysis and Mitigation , 2014, IEEE Journal on Selected Areas in Communications.

[25]  Sanjay Dhar Roy,et al.  Cooperative Spectrum Sensing with Double Threshold and Censoring in Rayleigh Faded Cognitive Radio Network , 2015, Wirel. Pers. Commun..

[26]  Ian F. Akyildiz,et al.  Cooperative spectrum sensing in cognitive radio networks: A survey , 2011, Phys. Commun..

[27]  Jalel Ben-Othman,et al.  Coalitional game-based behavior analysis for spectrum access in cognitive radios , 2016, Wirel. Commun. Mob. Comput..

[28]  Mee Hong Ling,et al.  Reinforcement learning-based trust and reputation model for cluster head selection in cognitive radio networks , 2014, The 9th International Conference for Internet Technology and Secured Transactions (ICITST-2014).