Fair Coexistence of Heterogeneous Networks: A Novel Probabilistic Multi-Armed Bandit Approach

—The licensed spectrum of cellular networks has become increasingly crowded, leading to the standardization of LTE licensed assisted access (LTE-LAA) and 5G NR-U for deployment in unlicensed bands such as 5 GHz. To coexist har-moniously with other unlicensed wireless technologies like WiFi, LAA and 5G NR-U enforce listen-before-talk (LBT) protocol. This paper proposes methods to enhance the overall spectrum efficiency and fairness of each coexisting heterogeneous link. To improve the overall spectrum efficiency, we propose enabling concurrent transmissions of multiple links. Motivated by the need for fair coexistence of heterogeneous networks with concurrent transmissions, we formulate a variant of the multi-armed bandit (MAB) problem that finds a probabilistic transmission strategy to maximize the minimum link throughput. We propose the Fair Probabilistic Explore-Then-Commit (FP-ETC) algorithm, which achieves the expected regret of O (cid:0) T 23 ( K log T ) 13 (cid:17) . We compare FP-ETC with existing MAB algorithms via extensive simulations, and the results show that FP-ETC significantly outperforms the baseline algorithms.

[1]  Joumana Farah,et al.  Resource Allocation in NOMA-Based Self-Organizing Networks Using Stochastic Multi-Armed Bandits , 2021, IEEE Transactions on Communications.

[2]  Arun Verma,et al.  Learning and Fairness in Energy Harvesting: A Maximin Multi-Armed Bandits Approach , 2020, 2020 International Conference on Signal Processing and Communications (SPCOM).

[3]  Sumit Roy,et al.  Achieving Proportional Fairness for LTE-LAA and Wi-Fi Coexistence in Unlicensed Spectrum , 2020, IEEE Transactions on Wireless Communications.

[4]  Zhiwu Guo,et al.  Enhancing LAA/Wi-Fi Coexistence via Concurrent Transmissions and Interference Cancellation , 2019, 2019 IEEE International Symposium on Dynamic Spectrum Access Networks (DySPAN).

[5]  Y. Narahari,et al.  Achieving Fairness in the Stochastic Multi-armed Bandit Problem , 2019, AAAI.

[6]  Aleksandrs Slivkins,et al.  Introduction to Multi-Armed Bandits , 2019, Found. Trends Mach. Learn..

[7]  Jia Liu,et al.  Combinatorial Sleeping Bandits with Fairness Constraints , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[8]  Morteza Mehrnoush,et al.  Analytical Modeling of Wi-Fi and LTE-LAA Coexistence: Throughput and Impact of Energy Detection Threshold , 2018, IEEE/ACM Transactions on Networking.

[9]  Xiaoli Chu,et al.  Performance Analysis of LAA and WiFi Coexistence in Unlicensed Spectrum Based on Markov Chain , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[10]  Aaron Roth,et al.  Fairness in Learning: Classic and Contextual Bandits , 2016, NIPS.

[11]  Xiang-Yang Li,et al.  WizBee: Wise ZigBee Coexistence via Interference Cancellation with Single Antenna , 2015, IEEE Transactions on Mobile Computing.

[12]  Sangki Yun,et al.  Supporting WiFi and LTE co-existence , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[13]  Derrick Wing Kwan Ng,et al.  Max-min fair wireless energy transfer for secure multiuser communication systems , 2014, 2014 IEEE Information Theory Workshop (ITW 2014).

[14]  Halim Yanikomeroglu,et al.  Optimal Tradeoff Between Sum-Rate Efficiency and Jain's Fairness Index in Resource Allocation , 2013, IEEE Transactions on Wireless Communications.

[15]  Wei Chen,et al.  Combinatorial Multi-Armed Bandit: General Framework and Applications , 2013, ICML.

[16]  Ananthram Swami,et al.  Distributed Algorithms for Learning and Cognitive Medium Access with Logarithmic Regret , 2010, IEEE Journal on Selected Areas in Communications.

[17]  Jeongkeun Lee,et al.  An experimental study on the capture effect in 802.11a networks , 2007, WinTECH '07.

[18]  Yuan Li,et al.  Energy and latency control in low duty cycle MAC protocols , 2005, IEEE Wireless Communications and Networking Conference, 2005.

[19]  Leandros Tassiulas,et al.  Maxmin fair scheduling in wireless networks , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[20]  Ming Li,et al.  Exploiting Successive Interference Cancellation for Spectrum Sharing over Unlicensed Bands , 2023, IEEE Transactions on Mobile Computing.

[21]  A. Girotra,et al.  Performance Analysis of the IEEE 802 . 11 Distributed Coordination Function , 2005 .

[22]  A. M. Murray.  Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications , 1999 .

[23]  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE/ACM TRANSACTIONS ON NETWORKING 1 Combinatorial Network Optimization With Unknown Variables: Multi-Armed B , 2022 .