Two-dimensional distributed spectrum reusing in cognitive radio network: Based on game theory

We investigate the global throughput maximization of distributed spectrum reusing (DSR) in cognitive radio (CR) network, which reaches the two-dimensional spectrum multiplexing. Most previous works only consider the temporal-domain accessing, which greatly underutilize the spectrum resources. In this paper, we propose a new temporal-spatial spectrum reusing scheme by fully exploiting the location information of devices, where multiple users can access one channel simultaneously. In distributed applications, the global information will be unavailable, and therefore a non-cooperative game is formulated. It is proved as an exact potential game (EPG), which has at least one pure strategy Nash equilibrium (NE). Then, an improved decentralized reinforcement learning (RL) algorithm is developed to achieve the NE points. The network performance is evaluated by computer simulations.

[1]  Lin Zhang,et al.  Self-organized spectrum access in small cell networks: A noncooperation interference minimization game solution , 2015, 2015 International Conference on Wireless Communications & Signal Processing (WCSP).

[2]  Pekka Pirinen,et al.  A brief overview of 5G research activities , 2014, 1st International Conference on 5G for Ubiquitous Connectivity.

[3]  Ana Galindo-Serrano,et al.  Distributed Q-Learning for Aggregated Interference Control in Cognitive Radio Networks , 2010, IEEE Transactions on Vehicular Technology.

[4]  Meryem Simsek,et al.  Improved decentralized Q-learning algorithm for interference reduction in LTE-femtocells , 2011, 2011 Wireless Advanced.

[5]  Arumugam Nallanathan,et al.  Deep Sensing for Next-Generation Dynamic Spectrum Sharing: More Than Detecting the Occupancy State of Primary Spectrum , 2015, IEEE Transactions on Communications.

[6]  Yang Yang,et al.  Reinforcement learning based spectrum-aware routing in multi-hop cognitive radio networks , 2009, 2009 4th International Conference on Cognitive Radio Oriented Wireless Networks and Communications.

[7]  Arumugam Nallanathan,et al.  Spectrum Sensing for Cognitive Radios in Time-Variant Flat-Fading Channels: A Joint Estimation Approach , 2014, IEEE Transactions on Communications.

[8]  Di Su,et al.  SINR Estimation in Limited Feedback Coordinated Multipoint Systems , 2015, IEEE Transactions on Vehicular Technology.

[9]  Walid Saad,et al.  Game Theory for Networks: A tutorial on game-theoretic tools for emerging signal processing applications , 2016, IEEE Signal Processing Magazine.

[10]  Dusit Niyato,et al.  Competitive spectrum sharing in cognitive radio networks: a dynamic game approach , 2008, IEEE Transactions on Wireless Communications.

[11]  Husheng Li,et al.  Multi-Agent Q-Learning for Competitive Spectrum Access in Cognitive Radio Systems , 2010, 2010 Fifth IEEE Workshop on Networking Technologies for Software Defined Radio Networks (SDR).

[12]  Bin Li,et al.  On the Efficient Beam-Forming Training for 60GHz Wireless Personal Area Networks , 2013, IEEE Trans. Wirel. Commun..

[13]  Arumugam Nallanathan,et al.  Deep Sensing for Future Spectrum and Location Awareness 5G Communications , 2015, IEEE Journal on Selected Areas in Communications.

[14]  Alagan Anpalagan,et al.  Opportunistic Spectrum Access in Cognitive Radio Networks: Global Optimization Using Local Interaction Games , 2012, IEEE Journal of Selected Topics in Signal Processing.

[15]  Sanghoon Lee,et al.  MIMO Broadcast Channels Based on SINR Feedback using a Non-Orthogonal Beamforming Matrix , 2012, IEEE Transactions on Communications.

[16]  K. J. Ray Liu,et al.  Joint Design of Spectrum Sensing and Channel Access in Cognitive Radio Networks , 2011, IEEE Transactions on Wireless Communications.

[17]  Alagan Anpalagan,et al.  Opportunistic Spectrum Access in Unknown Dynamic Environment: A Game-Theoretic Stochastic Learning Solution , 2012, IEEE Transactions on Wireless Communications.

[18]  Dirk T. M. Slock,et al.  An optimized unitary beamforming technique for MIMO broadcast channels , 2010, IEEE Transactions on Wireless Communications.

[19]  Simon Haykin,et al.  Cognitive Radio Networks: The Spectrum Supply Chain Paradigm , 2015, IEEE Transactions on Cognitive Communications and Networking.

[20]  Mahendra Kumar Murmu,et al.  Design Issues of Leader Election Protocol in Cognitive Radio Ad-Hoc Networks , 2015, 2015 Fifth International Conference on Communication Systems and Network Technologies.

[21]  H. Vincent Poor,et al.  Distributed Algorithms for Sharing Spectrum Sensing Information in Cognitive Radio Networks , 2015, IEEE Transactions on Wireless Communications.

[22]  Mance E. Harmon,et al.  Reinforcement Learning: A Tutorial. , 1997 .

[23]  Jin Wang,et al.  Ultra-dense small cell planning using cognitive radio network toward 5G , 2015, IEEE Wireless Communications.

[24]  Yong H. Lee,et al.  Limited channel feedback for coordinated beamforming under SINR requirements , 2013, 2013 IEEE International Conference on Communications Workshops (ICC).