Optimal energy-delay tradeoff for opportunistic spectrum access in cognitive radio networks

Cognitive radio (CR) has been considered as a promising technology to enhance spectrum efficiency via opportunistic transmission at link level. Basic CR features allow secondary users (SUs) to transmit only when the licensed channel is not occupied by primary users (PUs). However, waiting for an idle time slot may lead to large packet delays and high energy consumption. We further consider that the SU may decide, at any moment, to use another dedicated way of communication (4G) in order to transmit his packets. Thus, we consider an Opportunistic Spectrum Access (OSA) mechanism that takes into account packet delay and energy consumption. We formulate the OSA problem as a Partially Observable Markov Decision Process (POMDP) by explicitly considering the energy consumption as well as packets’ delay, which are often ignored in existing OSA solutions. Specifically, we consider a POMDP with an average reward criterion. We derive structural properties of the value function and we show the existence of optimal strategies in the class of the threshold strategies. For implementation purposes, we propose online learning mechanisms that estimate the PU activity and determine the appropriate threshold strategy on the fly. In particular, numerical illustrations validate our theoretical findings.

[1]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[2]  Fabrizio Granelli,et al.  Towards energy-efficient cooperative spectrum sensing for cognitive radio networks: an overview , 2015, Telecommun. Syst..

[3]  Chau Yuen,et al.  Energy Efficiency Tradeoff Mechanism Towards Wireless Green Communication: A Survey , 2016, IEEE Communications Surveys & Tutorials.

[4]  Bhaskar Krishnamachari,et al.  The Tradeoff between Energy Efficiency and User State Estimation Accuracy in Mobile Sensing , 2009, MobiCASE.

[5]  Eytan Modiano,et al.  Non-Cooperative Spectrum Access — The Dedicated vs. Free Spectrum Choice , 2011, IEEE Journal on Selected Areas in Communications.

[6]  Octavia A. Dobre,et al.  Radio Resource Allocation Techniques for Efficient Spectrum Access in Cognitive Radio Networks , 2016, IEEE Communications Surveys & Tutorials.

[7]  Ananthram Swami,et al.  Decentralized cognitive MAC for opportunistic spectrum access in ad hoc networks: A POMDP framework , 2007, IEEE Journal on Selected Areas in Communications.

[8]  William S. Lovejoy,et al.  Some Monotonicity Results for Partially Observed Markov Decision Processes , 1987, Oper. Res..

[9]  Yonghong Zeng,et al.  Opportunistic spectrum access for energy-constrained cognitive radios , 2008, IEEE Transactions on Wireless Communications.

[10]  Cheng-Xiang Wang,et al.  Wideband spectrum sensing for cognitive radio networks: a survey , 2013, IEEE Wireless Communications.

[11]  Joseph Mitola,et al.  Cognitive Radio An Integrated Agent Architecture for Software Defined Radio , 2000 .

[12]  Kang G. Shin,et al.  Opportunistic spectrum access for mobile cognitive radios , 2011, 2011 Proceedings IEEE INFOCOM.

[13]  Q. Zhao,et al.  Decentralized cognitive mac for dynamic spectrum access , 2005, First IEEE International Symposium on New Frontiers in Dynamic Spectrum Access Networks, 2005. DySPAN 2005..

[14]  Andres Garcia-Saavedra,et al.  Energy-Efficient Optimization for Distributed Opportunistic Scheduling , 2014, IEEE Communications Letters.

[15]  Ian F. Akyildiz,et al.  NeXt generation/dynamic spectrum access/cognitive radio wireless networks: A survey , 2006, Comput. Networks.

[16]  Yezekael Hayel,et al.  Optimal sensing strategy for opportunistic secondary users in a cognitive radio network , 2010, MSWIM '10.

[17]  Haitao Zheng,et al.  Collaboration and fairness in opportunistic spectrum access , 2005, IEEE International Conference on Communications, 2005. ICC 2005. 2005.

[18]  Sami Akin,et al.  Effective Capacity Analysis of Cognitive Radio Channels for Quality of Service Provisioning , 2009, IEEE Transactions on Wireless Communications.

[19]  Hang Su,et al.  Cognitive Radio Based Multi-Channel MAC Protocols for Wireless Ad Hoc Networks , 2007, IEEE GLOBECOM 2007 - IEEE Global Telecommunications Conference.

[20]  Yiyang Pei,et al.  Energy-Efficient Design of Sequential Channel Sensing in Cognitive Radio Networks: Optimal Sensing Strategy, Power Allocation, and Sensing Order , 2011, IEEE Journal on Selected Areas in Communications.

[21]  Rachid El Azouzi,et al.  A Stackelberg Model for Opportunistic Sensing in Cognitive Radio Networks , 2013, IEEE Transactions on Wireless Communications.

[22]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[23]  Hang Su,et al.  Cross-Layer Based Opportunistic MAC Protocols for QoS Provisionings Over Cognitive Radio Wireless Networks , 2008, IEEE Journal on Selected Areas in Communications.

[24]  Lang Tong,et al.  Delay Analysis for Cognitive Radio Networks with Random Access: A Fluid Queue View , 2010, 2010 Proceedings IEEE INFOCOM.

[25]  Cong Xiong,et al.  Energy-Efficient Spectrum Access in Cognitive Radios , 2014, IEEE Journal on Selected Areas in Communications.

[26]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over a Finite Horizon , 1973, Oper. Res..

[27]  Eytan Modiano,et al.  Non-Cooperative Spectrum Access - The Dedicated vs. Free Spectrum Choice , 2012, IEEE J. Sel. Areas Commun..

[28]  Ahmed Sultan Sensing and Transmit Energy Optimization for an Energy Harvesting Cognitive Radio , 2012, IEEE Wireless Communications Letters.

[29]  Ian F. Akyildiz,et al.  A survey on spectrum management in cognitive radio networks , 2008, IEEE Communications Magazine.

[30]  Hua Liu,et al.  Cooperation and Learning in Multiuser Opportunistic Spectrum Access , 2008, ICC Workshops - 2008 IEEE International Conference on Communications Workshops.

[31]  Vincent K. N. Lau,et al.  Energy-Efficient Delay-Constrained Transmission and Sensing for Cognitive Radio Systems , 2012, IEEE Transactions on Vehicular Technology.

[32]  Yiwei Thomas Hou,et al.  Distributed Cross-Layer Optimization for Cognitive Radio Networks , 2010, IEEE Transactions on Vehicular Technology.

[33]  Zhi Ding,et al.  Opportunistic spectrum access in cognitive radio networks , 2008, IJCNN.

[34]  Carlos de M. Cordeiro,et al.  Evolution of spectrum-agile cognitive radios: first wireless internet standard and beyond , 2006, WICON '06.

[35]  Ahmed K. Sadek,et al.  Technical challenges for cognitive radio in the TV white space spectrum , 2009, 2009 Information Theory and Applications Workshop.

[36]  E. J. Sondik,et al.  The Optimal Control of Partially Observable Markov Decision Processes. , 1971 .

[37]  Ekram Hossain,et al.  Dynamic Spectrum Access and Management in Cognitive Radio Networks: Introduction , 2009 .

[38]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[39]  Ekram Hossain,et al.  Dynamic Spectrum Access and Management in Cognitive Radio Networks , 2009 .

[40]  Chengshu Li,et al.  Opportunistic spectrum access in cognitive radio networks , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[41]  Bhaskar Krishnamachari,et al.  On myopic sensing for multi-channel opportunistic access: structure, optimality, and performance , 2007, IEEE Transactions on Wireless Communications.

[42]  Ananthram Swami,et al.  Distributed Spectrum Sensing and Access in Cognitive Radio Networks With Energy Constraint , 2009, IEEE Transactions on Signal Processing.

[43]  Lang Tong,et al.  On the performance of cognitive access with periodic spectrum sensing , 2009, CoRoNet '09.