Clustering and Reinforcement-Learning-Based Routing for Cognitive Radio Networks

The CRN is a future generation wireless communication system that allows SUs to use the underutilized or unused spectrum, known as white spaces, in licensed spectrum with minimum interference to PUs. However, the dynamic conditions of CRNs (e.g., PUs' activities and channel availability) make routing more challenging compared to traditional wireless networks. In this tutorial, we focus on solving the routing problem in CRNs with the help of a clustering mechanism. Cluster-based routing in CRNs enhances network scalability by reducing the flooding of routing overheads, as well as network stability by reducing the effects of dynamicity of channel availability. Additionally, RL, an artificial intelligence approach, is applied as a tool to further enhance network performance. We present SMART, which is a cluster-based routing scheme designed for the CRN, and evaluate its performance via simulations in order to show the effectiveness of cluster- based routing in CRNs using RL.

[1]  Sang-Jo Yoo,et al.  Distributed Coordination Protocol for Common Control Channel Selection in Multichannel Ad-Hoc Cognitive Radio Networks , 2009, 2009 IEEE International Conference on Wireless and Mobile Computing, Networking and Communications.

[2]  Tao Chen,et al.  CogMesh: A Cluster-Based Cognitive Radio Network , 2007, 2007 2nd IEEE International Symposium on New Frontiers in Dynamic Spectrum Access Networks.

[3]  Wahidah Hashim,et al.  Clustering algorithms for Cognitive Radio networks: A survey , 2014, J. Netw. Comput. Appl..

[4]  Kang G. Shin,et al.  Efficient Discovery of Spectrum Opportunities with MAC-Layer Sensing in Cognitive Radio Networks , 2008, IEEE Transactions on Mobile Computing.

[5]  Athanasios V. Vasilakos,et al.  Routing Metrics of Cognitive Radio Networks: A Survey , 2014, IEEE Communications Surveys & Tutorials.

[6]  D. Turgay Altilar,et al.  Self adaptive routing for dynamic spectrum access in cognitive radio networks , 2013, J. Netw. Comput. Appl..

[7]  D. Turgay Altilar,et al.  United nodes: cluster-based routing protocol for mobile cognitive radio networks , 2011, IET Commun..

[8]  P.H.J. Chong,et al.  A survey of clustering schemes for mobile ad hoc networks , 2005, IEEE Communications Surveys & Tutorials.

[9]  Wenjie Zhang,et al.  Cluster-based adaptive multispectrum sensing and access in cognitive radio networks , 2015, Wirel. Commun. Mob. Comput..

[10]  Michael L. Littman,et al.  Packet Routing in Dynamically Changing Networks: A Reinforcement Learning Approach , 1993, NIPS.

[11]  Mario Gerla,et al.  CoRoute: a new cognitive anypath vehicular routing protocol , 2011, Wirel. Commun. Mob. Comput..

[12]  Gang Wang,et al.  Stability-Capacity-Adaptive Routing for High-Mobility Multihop Cognitive Radio Networks , 2011, IEEE Transactions on Vehicular Technology.

[13]  George Mastorakis,et al.  A resource intensive traffic-aware scheme using energy-aware routing in cognitive radio networks , 2014, Future Gener. Comput. Syst..

[14]  Loukas Lazos,et al.  Graph-based criteria for spectrum-aware clustering in cognitive radio networks , 2012, Ad hoc networks.

[15]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .