Optimal energy tradeoff for active sensing in cognitive radio networks

We consider a wideband cognitive radio network, where the channel is modeled by doubly block fading in time and frequency. With a frame energy constraint, we propose a joint sensing and probing strategy, called active sensing, to access the best channel for secondary data transmission. By employing the multi-armed bandit problem, we establish the fundamental tradeoff between sensing, probing, and transmitting energies for an average throughput of the secondary user and proactively design the optimal cardinalities of sensing and probing sets of channels. Our design methodology provides a framework to determine the optimal energy tradeoff between exploration and exploitation in wideband cognitive radio networks.

[1]  Hyundong Shin,et al.  Optimal Sensing Cardinality for Cognitive Radios , 2011, IEEE Communications Letters.

[2]  Hai Jiang,et al.  Channel Sensing-Order Setting in Cognitive Radio Networks: A Two-User Case , 2009, IEEE Transactions on Vehicular Technology.

[3]  Shie Mannor,et al.  Action Elimination and Stopping Conditions for Reinforcement Learning , 2003, ICML.

[4]  Kevin D. Glazebrook,et al.  Multi-Armed Bandit Allocation Indices: Gittins/Multi-Armed Bandit Allocation Indices , 2011 .

[5]  H. Vincent Poor,et al.  Cognitive Medium Access: Exploration, Exploitation, and Competition , 2007, IEEE Transactions on Mobile Computing.

[6]  John N. Tsitsiklis,et al.  The Sample Complexity of Exploration in the Multi-Armed Bandit Problem , 2004, J. Mach. Learn. Res..

[7]  Amir Ghasemi,et al.  Spectrum sensing in cognitive radio networks: requirements, challenges and design trade-offs , 2008, IEEE Communications Magazine.

[8]  Brian L. Mark,et al.  A Framework for Cognitive WiMAX With Frequency Agility , 2009, Proceedings of the IEEE.

[9]  P. W. Jones,et al.  Bandit Problems, Sequential Allocation of Experiments , 1987 .

[10]  Simon Haykin,et al.  Cognitive radio: brain-empowered wireless communications , 2005, IEEE Journal on Selected Areas in Communications.

[11]  H. Vincent Poor,et al.  Optimal selection of channel sensing order in cognitive radio , 2009, IEEE Transactions on Wireless Communications.

[12]  J. Bather,et al.  Multi‐Armed Bandit Allocation Indices , 1990 .