A Non-cooperative hierarchical Opportunistic Spectrum Access for cognitive radio networks

We consider a non-cooperative Opportunistic Spectrum Access (OSA) where Secondary Users (SUs) access opportunistically the spectrum licensed for Primary Users (PUs) in TV white spaces (TVWS). As sensing licensed channels is time and energy consuming, we consider a hierarchical Cognitive Radio (CR) architecture, where CR base stations sense a subset of the spectrum in order to locate some free frequencies. Thereafter, a SU that needs to communicate through TVWS sends a request to a CR base station for a free channel. We model the problem using a Partially Observable Stochastic Game (POSG), and we take into consideration the energy consumption of CR base stations and the Quality of Services (QoS) of SUs. Since solving POSG optimally may require a significant amount of time and computational complexity, we model the OSA problem using a game theoretical approach, and we propose a symmetric Nash equilibrium solution concept. Finally, we provide some simulations that validate our theoretical findings.

[1]  Makoto Yokoo,et al.  Taming Decentralized POMDPs: Towards Efficient Policy Computation for Multiagent Settings , 2003, IJCAI.

[2]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over a Finite Horizon , 1973, Oper. Res..

[3]  Srivaramangai Ramanujam,et al.  Assessment of Cognitive Level for Alzheimer's Using Neural Networks , 2011, 2011 Second International Conference on Intelligent Systems, Modelling and Simulation.

[4]  Eytan Modiano,et al.  Non-Cooperative Spectrum Access — The Dedicated vs. Free Spectrum Choice , 2011, IEEE Journal on Selected Areas in Communications.

[5]  Zhi Ding,et al.  Opportunistic spectrum access in cognitive radio networks , 2008, IJCNN.

[6]  Shlomo Zilberstein,et al.  Dynamic Programming for Partially Observable Stochastic Games , 2004, AAAI.

[7]  Ekram Hossain,et al.  Dynamic Spectrum Access and Management in Cognitive Radio Networks: Introduction , 2009 .

[8]  Piotr J. Gmytrasiewicz,et al.  Formalizing multi-agent POMDP's in the context of network routing , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[9]  A. Cassandra,et al.  Exact and approximate algorithms for partially observable markov decision processes , 1998 .

[10]  Ananthram Swami,et al.  Decentralized cognitive MAC for opportunistic spectrum access in ad hoc networks: A POMDP framework , 2007, IEEE Journal on Selected Areas in Communications.

[11]  Ekram Hossain,et al.  Dynamic Spectrum Access and Management in Cognitive Radio Networks , 2009 .

[12]  Simon Haykin,et al.  Cognitive radio: brain-empowered wireless communications , 2005, IEEE Journal on Selected Areas in Communications.

[13]  Hyoil Kim Adaptive MAC-layer Sensing of Spectrum Availability in Cognitive Radio Networks , 2006 .

[14]  Joseph Mitola,et al.  Cognitive radio: making software radios more personal , 1999, IEEE Wirel. Commun..

[15]  Eytan Modiano,et al.  Non-Cooperative Spectrum Access - The Dedicated vs. Free Spectrum Choice , 2012, IEEE J. Sel. Areas Commun..

[16]  Ryan W. Thomas,et al.  Cognitive networks , 2005, First IEEE International Symposium on New Frontiers in Dynamic Spectrum Access Networks, 2005. DySPAN 2005..

[17]  Chien-Chung Shen,et al.  On Random Dynamic Spectrum Access for Cognitive Radio Networks , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[18]  E. Altman,et al.  Markov decision problems and state-action frequencies , 1991 .

[19]  Ananthram Swami,et al.  Distributed Spectrum Sensing and Access in Cognitive Radio Networks With Energy Constraint , 2009, IEEE Transactions on Signal Processing.

[20]  Rachid El Azouzi,et al.  Distributed energy-delay framework for opportunistic spectrum access , 2011, 2011 IFIP Wireless Days (WD).

[21]  Lang Tong,et al.  On the performance of cognitive access with periodic spectrum sensing , 2009, CoRoNet '09.

[22]  Jeff G. Schneider,et al.  Approximate solutions for partially observable stochastic games with common payoffs , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..