Distributed Algorithm for Dynamic Cognitive Ad-hoc Networks

Cognitive ad-hoc networks allow users to access an unlicensed/shared spectrum without the need for any coordination via a central controller and are being envisioned for futuristic ultra-dense wireless networks. The ad-hoc nature of networks require each user to learn and regularly update various network parameters such as channel quality and the number of users, and use learned information to improve the spectrum utilization and minimize collisions. For such a learning and coordination task, we propose a distributed algorithm based on a multi-player multi-armed bandit approach and novel signaling scheme. The proposed algorithm does not need prior knowledge of network parameters (users, channels) and its ability to detect as well as adapt to the changes in the network parameters thereby making it suitable for static as well as dynamic networks. The theoretical analysis and extensive simulation results validate the superiority of the proposed algorithm over existing state-of-the-art algorithms.

[1]  Ananthram Swami,et al.  Distributed Algorithms for Learning and Cognitive Medium Access with Logarithmic Regret , 2010, IEEE Journal on Selected Areas in Communications.

[2]  Amir Leshem,et al.  Distributed Multi-Player Bandits - a Game of Thrones Approach , 2018, NeurIPS.

[3]  Ohad Shamir,et al.  Multi-player bandits: a musical chairs approach , 2016, ICML 2016.

[4]  Min Dong,et al.  Distributed Stochastic Learning and Adaptation to Primary Traffic for Dynamic Spectrum Access , 2016, IEEE Transactions on Wireless Communications.

[5]  Özgür B. Akan,et al.  Clustering in Multi-Channel Cognitive Radio Ad Hoc and Sensor Networks , 2018, IEEE Communications Magazine.

[6]  Rohit Kumar,et al.  Distributed Learning and Coordination in Cognitive Infrastructureless Networks of Unknown Size , 2020, IEEE Systems Journal.

[7]  Kyung Sup Kwak,et al.  Channel Clustering and QoS Level Identification Scheme for Multi-Channel Cognitive Radio Networks , 2018, IEEE Communications Magazine.

[8]  Sumit J Darak,et al.  Multi-Player Multi-Armed Bandits for Stable Allocation in Heterogeneous Ad-Hoc Networks , 2018, IEEE Journal on Selected Areas in Communications.

[9]  Himani Joshi,et al.  Distributed algorithm for dynamic spectrum access in infrastructure-less cognitive radio network , 2018, 2018 IEEE Wireless Communications and Networking Conference (WCNC).

[10]  Lilian Besson,et al.  Multi-Player Bandits Models Revisited , 2017, ArXiv.

[11]  Visa Koivunen,et al.  Learning spectrum opportunities in non-stationary radio environments , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Yi Gai,et al.  Distributed Stochastic Online Learning Policies for Opportunistic Spectrum Access , 2014, IEEE Transactions on Signal Processing.

[13]  Yu-Dong Yao,et al.  Design and Analysis of Distributed Hopping-Based Channel Access in Multi-Channel Cognitive Radio Systems with Delay Constraints , 2014, IEEE Journal on Selected Areas in Communications.