Opportunistic Channel Access and RF Energy Harvesting in Cognitive Radio Networks

Radio frequency (RF) energy harvesting is a promising technique to sustain operations of wireless networks. In a cognitive radio network, a secondary user can be equipped with RF energy harvesting capability. In this paper, we consider such a network where the secondary user can perform channel access to transmit a packet or to harvest RF energy when the selected channel is idle or occupied by the primary user, respectively. We present an optimization formulation to obtain the channel access policy for the secondary user to maximize its throughput. Both the case that the secondary user knows the current state of the channels and the case that the secondary knows the idle channel probabilities of channels in advance are considered. However, the optimization requires model parameters (e.g., the probability of successful packet transmission, the probability of successful RF energy harvesting, and the probability of channel to be idle) to obtain the policy. To obviate such a requirement, we apply an online learning algorithm that can observe the environment and adapt the channel access action accordingly without any a prior knowledge about the model parameters. We evaluate both the efficiency and convergence of the learning algorithm. The numerical results show that the policy obtained from the learning algorithm can achieve the performance in terms of throughput close to that obtained from the optimization.

[1]  Jaeho Kim,et al.  Energy adaptive MAC protocol for wireless sensor networks with RF energy transfer , 2011, 2011 Third International Conference on Ubiquitous and Future Networks (ICUFN).

[2]  Jing Yang,et al.  Two-way and multiple-access energy harvesting systems with energy cooperation , 2012, 2012 Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[3]  Kaibin Huang,et al.  Opportunistic Wireless Energy Harvesting in Cognitive Radio Networks , 2013, IEEE Transactions on Wireless Communications.

[4]  Sungsoo Park,et al.  Optimal Spectrum Access for Energy Harvesting Cognitive Radio Networks , 2013, IEEE Transactions on Wireless Communications.

[5]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[6]  Jiaru Lin,et al.  An online energy allocation strategy for energy harvesting cognitive radio systems , 2013, 2013 International Conference on Wireless Communications and Signal Processing.

[7]  Sungsoo Park,et al.  Optimal mode selection for cognitive radio sensor networks with RF energy harvesting , 2012, 2012 IEEE 23rd International Symposium on Personal, Indoor and Mobile Radio Communications - (PIMRC).

[8]  John N. Tsitsiklis,et al.  Simulation-based optimization of Markov reward processes , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[9]  John N. Tsitsiklis,et al.  Gradient Convergence in Gradient methods with Errors , 1999, SIAM J. Optim..

[10]  Ke Li,et al.  Qi-ferry: Energy-constrained wireless charging in wireless sensor networks , 2012, 2012 IEEE Wireless Communications and Networking Conference (WCNC).

[11]  Xiaodong Lin,et al.  On exploiting polarization for energy-harvesting enabled cooperative cognitive radio networking , 2013, IEEE Wireless Communications.

[12]  Peter L. Bartlett,et al.  Experiments with Infinite-Horizon, Policy-Gradient Estimation , 2001, J. Artif. Intell. Res..

[13]  Fernando J. Velez,et al.  Electromagnetic Energy Harvesting for Wireless Body Area Networks with Cognitive Radio Capabilities , 2012 .

[14]  Ahmed Sultan Sensing and Transmit Energy Optimization for an Energy Harvesting Cognitive Radio , 2012, IEEE Wireless Communications Letters.

[15]  Shigenobu Sasaki,et al.  RF Energy Transfer for Cooperative Networks: Data Relaying or Energy Harvesting? , 2012, IEEE Communications Letters.

[16]  Vijay K. Bhargava,et al.  Green Cellular Networks: A Survey, Some Research Issues and Challenges , 2011, IEEE Communications Surveys & Tutorials.

[17]  Sungsoo Park,et al.  Cognitive Radio Networks with Energy Harvesting , 2013, IEEE Transactions on Wireless Communications.

[18]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[19]  Derrick Wing Kwan Ng,et al.  Energy-efficient resource allocation in multiuser OFDM systems with wireless information and power transfer , 2012, 2013 IEEE Wireless Communications and Networking Conference (WCNC).

[20]  Hubregt J. Visser,et al.  RF Energy Harvesting and Transport for Wireless Sensor Network Applications: Principles and Requirements , 2013, Proceedings of the IEEE.

[21]  Sugata Sanyal,et al.  Impact of mobile transmitter sources on radio frequency wireless energy harvesting , 2013, 2013 International Conference on Computing, Networking and Communications (ICNC).

[22]  Hiroyuki Arai,et al.  DTV band micropower RF energy-harvesting circuit architecture and performance analysis , 2011, 2011 IEEE International Conference on RFID-Technologies and Applications.

[23]  Mohamed K. Watfa,et al.  Multi-Hop Wireless Energy Transfer in WSNs , 2011, IEEE Communications Letters.

[24]  Dong In Kim,et al.  Channel selection in cognitive radio networks with opportunistic RF energy harvesting , 2014, 2014 IEEE International Conference on Communications (ICC).

[25]  Deniz Gündüz,et al.  A Learning Theoretic Approach to Energy Harvesting Communication System Optimization , 2012, IEEE Transactions on Wireless Communications.