Outage Analysis in Cognitive Radio Networks With Energy Harvesting and Q-Routing

The present work explores mitigation in end-to-end outage probability in an energy harvesting (EH) enabled cognitive radio networks (CRNs) through reinforcement learning (RL) based multi-hop Q-routing. The operation of CRN follows a frame structure that includes cooperative spectrum sensing (CSS), based on the decision of which, secondary transmit nodes either do EH from the primary user (PU) signal or make an opportunistic data transmission. In either operation, both PU reappearance and disappearance probabilities are considered in mathematical analysis. An optimization problem is formulated that minimizes the outage probability in the CRN under the constraints of primary user interference protection, individual secondary link throughput, and energy causality in EH. The closed-form expressions are derived to find the optimal values of sensing duration, secondary power allocation fraction on SS and data transmission. The present multi-hop CRN studies RL-based Q-routing in different network topologies and analyzes the worst-case runtime complexities. It is observed that the tree structure based network reduces the complexity of Q-routing over the other topologies and provides a significant gain on the outage. The present work improves the CRN outage performance by $11.01$% and $39.89$% over the existing techniques.

[1]  Feilong Tang,et al.  Joint Topology Control and Stable Routing Based on PU Prediction for Multihop Mobile Cognitive Networks , 2018, IEEE Transactions on Wireless Communications.

[2]  Guan Gui,et al.  Deep Learning-Inspired Message Passing Algorithm for Efficient Resource Allocation in Cognitive Radio Networks , 2019, IEEE Transactions on Vehicular Technology.

[3]  Yuguang Fang,et al.  Spectrum-Aware Anypath Routing in Multi-Hop Cognitive Radio Networks , 2017, IEEE Transactions on Mobile Computing.

[4]  Feilong Tang,et al.  Joint Rate Adaptation, Channel Assignment and Routing to Maximize Social Welfare in Multi-Hop Cognitive Radio Networks , 2017, IEEE Transactions on Wireless Communications.

[5]  Wei Liang,et al.  End-to-End Throughput Maximization for Underlay Multi-Hop Cognitive Radio Networks With RF Energy Harvesting , 2017, IEEE Transactions on Wireless Communications.

[6]  Wenjie Zhang,et al.  TV white space and its applications in future wireless networks and communications: a survey , 2018, IET Commun..

[7]  Zhu Han,et al.  Learning for Robust Routing Based on Stochastic Game in Cognitive Radio Networks , 2016, IEEE Transactions on Communications.

[8]  Zhigang Chen,et al.  Energy-Harvesting-Aided Spectrum Sensing and Data Transmission in Heterogeneous Cognitive Radio Sensor Network , 2016, IEEE Transactions on Vehicular Technology.

[9]  Woongsup Lee,et al.  Deep Cooperative Sensing: Cooperative Spectrum Sensing Based on Convolutional Neural Networks , 2019, IEEE Transactions on Vehicular Technology.

[10]  Xing Zhang,et al.  Outage Performance Analysis of Wireless Energy Harvesting Relay-Assisted Random Underlay Cognitive Networks , 2018, IEEE Internet of Things Journal.

[11]  Mohamed Ibnkahla,et al.  Energy and Spectral Efficient Cognitive Radio Sensor Networks for Internet of Things , 2018, IEEE Internet of Things Journal.

[12]  Santi P. Maity,et al.  On Throughput Maximization in Cooperative Cognitive Radio Networks With Eavesdropping , 2019, IEEE Communications Letters.

[13]  Yu Song,et al.  Routing Selection With Reinforcement Learning for Energy Harvesting Multi-Hop CRN , 2019, IEEE Access.

[14]  Zhixiang Deng,et al.  Cognitive Radio Network With Energy-Harvesting Based on Primary and Secondary User Signals , 2018, IEEE Access.

[15]  Kisong Lee,et al.  Joint Optimization of Spectrum Sensing and Transmit Power in Energy Harvesting-Based Cognitive Radio Networks , 2018, IEEE Access.

[16]  Yasir Saleem,et al.  Clustering and Reinforcement-Learning-Based Routing for Cognitive Radio Networks , 2017, IEEE Wireless Communications.

[17]  Shengwu Xiong,et al.  Geographic Segmented Opportunistic Routing in Cognitive Radio Ad Hoc Networks Using Network Coding , 2018, IEEE Access.

[18]  Nei Kato,et al.  State-of-the-Art Deep Learning: Evolving Machine Intelligence Toward Tomorrow’s Intelligent Network Traffic Control Systems , 2017, IEEE Communications Surveys & Tutorials.

[19]  Jang-Ping Sheu,et al.  Dynamic Spectrum Allocation Algorithms for Industrial Cognitive Radio Networks , 2018, IEEE Transactions on Industrial Informatics.

[20]  Theodoros A. Tsiftsis,et al.  A New Interweave Cognitive Radio Scheme for Out-Band Energy Harvesting Systems , 2018, IEEE Access.

[21]  Muhammad Faheem,et al.  Spectrum-aware bio-inspired routing in cognitive radio sensor networks for smart grid applications , 2017, Comput. Commun..

[22]  Nei Kato,et al.  Value Iteration Architecture Based Deep Learning for Intelligent Routing Exploiting Heterogeneous Computing Platforms , 2019, IEEE Transactions on Computers.

[23]  Derrick Wing Kwan Ng,et al.  Practical Non-Linear Energy Harvesting Model and Resource Allocation for SWIPT Systems , 2015, IEEE Communications Letters.

[24]  Nei Kato,et al.  Routing or Computing? The Paradigm Shift Towards Intelligent Computer Network Packet Transmission Based on Deep Learning , 2017, IEEE Transactions on Computers.

[25]  Wei Liang,et al.  Harvesting-Throughput Tradeoff for CDMA-Based Underlay Cognitive Radio Networks With Wireless Energy Harvesting , 2018, IEEE Systems Journal.

[26]  Haris Gacanin,et al.  An Overview of Machine Learning Approaches in Wireless Mesh Networks , 2018, IEEE Communications Magazine.

[27]  Santi P. Maity,et al.  Energy Efficiency in Cooperative Cognitive Radio Network in the Presence of Malicious Users , 2018, IEEE Systems Journal.

[28]  Shiwen Mao,et al.  Wireless Multimedia Cognitive Radio Networks: A Comprehensive Survey , 2018, IEEE Communications Surveys & Tutorials.