Optimal action decision of secondary users in light-handed cognitive radio networks

In traditional cognitive radio (CR) network, secondary users (SUs) are always assumed to obey the rule of “introducing no interference to the primary users (PUs)”. However, this assumption may be not realistic as the CR devices becoming more and more intelligent nowadays. Light-handed CR is proposed to deal with this problem by introducing “punishment” to illegal CR transmissions. In this network framework, the action decisions of SUs are modeled as a partially observable Markov decision process (POMDP), and are optimized with the objective of maximizing their reward. Furthermore, extensive simulation results show that the proposed scheme improves the SUs' reward significantly compared to the existing scheme.

[1]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over a Finite Horizon , 1973, Oper. Res..

[2]  George Atia,et al.  A technical framework for light- handed regulation of cognitive radios , 2009, IEEE Communications Magazine.

[3]  Victor C. M. Leung,et al.  Optimal Cooperative Internetwork Spectrum Sharing for Cognitive Radio Systems With Spectrum Pooling , 2010, IEEE Transactions on Vehicular Technology.

[4]  Joseph Mitola,et al.  Cognitive radio: making software radios more personal , 1999, IEEE Wirel. Commun..

[5]  A. Sahai,et al.  Spectrum Enforcement and Liability Assignment in Cognitive Radio Systems , 2008, 2008 3rd IEEE Symposium on New Frontiers in Dynamic Spectrum Access Networks.

[6]  Husheng Li,et al.  Learning the Spectrum via Collaborative Filtering in Cognitive Radio Networks , 2010, 2010 IEEE Symposium on New Frontiers in Dynamic Spectrum (DySPAN).

[7]  Dusit Niyato,et al.  Cognitive radio for next-generation wireless networks: an approach to opportunistic channel selection in ieee 802.11-based wireless mesh , 2009, IEEE Wireless Communications.

[8]  Yunlong Zhu,et al.  Spectrum Allocation in Cognitive Radio Networks Using Swarm Intelligence , 2010, 2010 Second International Conference on Communication Software and Networks.

[9]  Simon Haykin,et al.  Cognitive radio: brain-empowered wireless communications , 2005, IEEE Journal on Selected Areas in Communications.

[10]  A. Sahai,et al.  Crime and Punishment for Cognitive Radios , 2008, 2008 46th Annual Allerton Conference on Communication, Control, and Computing.

[11]  V. Tarokh,et al.  Cognitive radio networks , 2008, IEEE Signal Processing Magazine.

[12]  George E. Monahan,et al.  A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms , 2007 .

[13]  G. Monahan.  State of the Art—A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms , 1982 .

[14]  Ju Bin Song,et al.  Performance analysis of distributed cooperative spectrum sensing for underlay cognitive radio , 2009, 2009 11th International Conference on Advanced Communication Technology.

[15]  Carlos Mosquera,et al.  A Game-Theoretic Framework for Dynamic Spectrum Leasing (DSL) in Cognitive Radios , 2009, 2009 IEEE Globecom Workshops.