Distributed Multichannel Access in High-Frequency Diversity Networks: A Multi-Agent Learning Approach With Correlated Equilibrium

This paper investigates the problem of multi-user multichannel access in distributed high-frequency (HF) diversity communication networks using a game-theoretic learning algorithm which is based on correlation equilibrium (CE). We formulate the channel access problem in the HF networks as a non-cooperative game. In the access game, each user equipment (UE) optimizes its access strategy without the information about other UEs, which makes the channel access problem challenging. It is proved that there is at least one CE point that makes all UEs’ access strategy efficient and fair. We propose a distributed learning algorithm based on CE to achieve multi-user access with low cost and fairly in the distributed HF networks. We use coordination signals to help each UE learn the access strategy by themselves. When each UE receives and recognizes the right coordination signals, UEs will learn to transmit data on right channels without further collisions after the learning phase. The simulation results show that the proposed learning algorithm can not only completely avoid interference and get optimal throughput but also guarantee fairness among all UEs.

[1]  Xin Liu,et al.  A heterogeneous information fusion deep reinforcement learning for intelligent frequency selection of HF communication , 2018, China Communications.

[2]  Jun-Bae Seo,et al.  Two-User NOMA Uplink Random Access Games , 2018, IEEE Communications Letters.

[3]  Hailin Zhang,et al.  Full-Duplex for Multi-Channel Cognitive Radio Ad Hoc Networks , 2019, IEEE Network.

[4]  Amir Leshem,et al.  Game Theoretic Dynamic Channel Allocation for Frequency-Selective Interference Channels , 2017, IEEE Transactions on Information Theory.

[5]  R. Aumann Subjectivity and Correlation in Randomized Strategies , 1974 .

[6]  J. B. Scholz,et al.  “LongFish”-a HF radio network testbed , 1997 .

[7]  Zhiqiang Qin,et al.  Multiple armed bandits based opportunistic channel access with switching cost in block fading channel , 2015, 2015 International Conference on Wireless Communications & Signal Processing (WCSP).

[8]  Wei Yuan,et al.  Variable-Width Channel Allocation for Access Points: A Game-Theoretic Perspective , 2013, IEEE Transactions on Mobile Computing.

[9]  Yu-Dong Yao,et al.  Link Quality Analysis Based Channel Selection in High-Frequency Asynchronous Automatic Link Establishment: A Matrix Completion Approach , 2018, IEEE Systems Journal.

[10]  Alagan Anpalagan,et al.  Game-Theoretic Multi-Channel Multi-Access in Energy Harvesting Wireless Sensor Networks , 2016, IEEE Sensors Journal.

[11]  Lu Wang,et al.  Attachment-Learning for Multi-Channel Allocation in Distributed OFDMA-Based Networks , 2013, IEEE Transactions on Wireless Communications.

[12]  John W. Nieto Spatial diversity and high data rate waveforms-is it worth doing? , 2000, MILCOM 2000 Proceedings. 21st Century Military Communications. Architectures and Technologies for Information Superiority (Cat. No.00CH37155).

[13]  Boi Faltings,et al.  Reaching correlated equilibria through multi-agent learning , 2011, AAMAS.

[14]  Jin Chen,et al.  Deep spectrum prediction in high frequency communication based on temporal-spectral residual network , 2018, China Communications.

[15]  Changbin Yu,et al.  Dual time synchronisation method for wireless sensor networks , 2015 .

[16]  Jinlong Wang,et al.  HF communications: Past, present, and future , 2018, China Communications.

[17]  Santiago Zazo,et al.  Upper Confidence Bound learning approach for real HF measurements , 2015, 2015 IEEE International Conference on Communication Workshop (ICCW).

[18]  Keqin Li,et al.  Spectrum Resource Sharing in Heterogeneous Vehicular Networks: A Noncooperative Game-Theoretic Approach With Correlated Equilibrium , 2018, IEEE Transactions on Vehicular Technology.

[19]  Xu Chen,et al.  Database-Assisted Distributed Spectrum Sharing , 2013, IEEE Journal on Selected Areas in Communications.

[20]  Xiao Li,et al.  High frequency communication network with diversity: System structure and key enabling techniques , 2018, China Communications.

[21]  Dong In Kim,et al.  Game Theoretic Approaches for Multiple Access in Wireless Networks: A Survey , 2011, IEEE Communications Surveys & Tutorials.

[22]  William N. Furman,et al.  Next generation ALE concepts , 2009 .

[23]  Raj Jain,et al.  A Quantitative Measure Of Fairness And Discrimination For Resource Allocation In Shared Computer Systems , 1998, ArXiv.

[24]  Zhu Han,et al.  Distributive Opportunistic Spectrum Access for Cognitive Radio using Correlated Equilibrium and No-Regret Learning , 2007, 2007 IEEE Wireless Communications and Networking Conference.

[25]  William N. Furman,et al.  Applying cognitive radio concepts to HF communications , 2009 .

[26]  Dominique Lemur,et al.  Test of HF (3-30 MHz) MIMO communication system based on polarisation diversity , 2012 .

[27]  Wen Li,et al.  Exploring channel diversity in HF communication systems: A matching-potential game approach , 2018, China Communications.

[28]  S. Hart,et al.  A simple adaptive procedure leading to correlated equilibrium , 2000 .

[29]  Harri Saarnisaari,et al.  Cognitive HF — New perspectives to use the high frequency band , 2014, 2014 9th International Conference on Cognitive Radio Oriented Wireless Networks and Communications (CROWNCOM).

[30]  Zhongming Zheng,et al.  Cooperative Strategies for Energy-Aware Ad Hoc Networks: A Correlated-Equilibrium Game-Theoretical Approach , 2013, IEEE Transactions on Vehicular Technology.

[31]  Vikram Krishnamurthy,et al.  Cognitive Base Stations in LTE/3GPP Femtocells: A Correlated Equilibrium Game-Theoretic Approach , 2011, IEEE Transactions on Communications.

[32]  Hyoung-Kyu Song A frequency synchronization for TDMA system , 1999, IEEE Commun. Lett..

[33]  Alagan Anpalagan,et al.  Opportunistic Spectrum Access in Cognitive Radio Networks: Global Optimization Using Local Interaction Games , 2012, IEEE Journal of Selected Topics in Signal Processing.

[34]  Xi Zhang,et al.  Optimal Power Allocation With Statistical QoS Provisioning for D2D and Cellular Communications Over Underlaying Wireless Networks , 2016, IEEE Journal on Selected Areas in Communications.

[35]  Santiago Zazo,et al.  Hybrid UCB-HMM: A Machine Learning Strategy for Cognitive Radio in HF Band , 2015, IEEE Transactions on Cognitive Communications and Networking.

[36]  Mihaela van der Schaar,et al.  On the Correlated Equilibrium Selection for Two-User Channel Access Games , 2009, IEEE Signal Processing Letters.

[37]  Jin Chen,et al.  Opportunistic channel access with repetition time diversity and switching cost: a block multi-armed bandit approach , 2018, Wirel. Networks.