An intelligent cognitive MAC-based sensing protocol with pseudo-deterministic convergence bounds

The most challenging aspect of Cognitive Radio Networks (CRNs) is designing a sensing policy which guarantees minimal interference to licensed users and as well as maximal discovery of spectral resources. The statistics of channel activity of licensed users may be unknown and/or time-variant. This requires the sensing policy to be able to adapt to these changes as needed. In this paper, we propose a learning based MAC-layer sensing protocol which acts on sensing results in the form of binary streams which are made available by the physical layer abstraction. The protocol makes use the learning algorithm we designed to learn and estimate parameters of the statistical distribution of licensed users' activities on various channels, and this in turn allows the sensing parameters to be adapted accordingly. We also use the inherent design heuristics to approximate the convergence speed of the algorithm on the estimation of utilization of licensed channels. Our simulation results reveal that the convergence of the algorithm can be predicted reasonably well if the sensing period is smaller than both the average busy and idle durations of channel dynamics. The proposed design discovers, on average, 94 percent of idle channels. Moreover, the predetermined convergence bound is more accurate as the difference between number of users in a CRN and the total number of primary channels is reduced.

[1]  Ian F. Akyildiz,et al.  Optimal spectrum sensing framework for cognitive radio networks , 2008, IEEE Transactions on Wireless Communications.

[2]  Liljana Gavrilovska,et al.  Learning and Reasoning in Cognitive Radio Networks , 2013, IEEE Communications Surveys & Tutorials.

[3]  Jing Zhang,et al.  Two novel learning algorithms to solve the spectrum sharing problem in cognitive radio networks , 2012, 2012 International Conference on Systems and Informatics (ICSAI2012).

[4]  José Ferreira de Rezende,et al.  Channel sensing order for cognitive radio networks using reinforcement learning , 2011, 2011 IEEE 36th Conference on Local Computer Networks.

[5]  Chun-Ting Chou,et al.  Quiet Period (QP) Scheduling Across Heterogeneous Dynamic Spectrum Access (DSA)-Based Systems , 2012, IEEE Transactions on Wireless Communications.

[6]  Zhongding Lei,et al.  IEEE 802.22: The first cognitive radio wireless regional area network standard , 2009, IEEE Communications Magazine.

[7]  Bechir Hamdaoui,et al.  Cooperative Q-learning for multiple secondary users in dynamic spectrum access , 2011, 2011 7th International Wireless Communications and Mobile Computing Conference.

[8]  H. Vincent Poor,et al.  Reinforcement learning based distributed multiagent sensing policy for cognitive radio networks , 2011, 2011 IEEE International Symposium on Dynamic Spectrum Access Networks (DySPAN).

[9]  Kang G. Shin,et al.  Efficient Discovery of Spectrum Opportunities with MAC-Layer Sensing in Cognitive Radio Networks , 2008, IEEE Transactions on Mobile Computing.

[10]  Maria-Gabriella Di Benedetto,et al.  A Survey on MAC Strategies for Cognitive Radio Networks , 2012, IEEE Communications Surveys & Tutorials.

[11]  Leslie Pack Kaelbling,et al.  Learning Policies for Partially Observable Environments: Scaling Up , 1997, ICML.

[12]  Ananthram Swami,et al.  Decentralized cognitive MAC for opportunistic spectrum access in ad hoc networks: A POMDP framework , 2007, IEEE Journal on Selected Areas in Communications.