Enhanced LBT Mechanism for LTE-Unlicensed Using Reinforcement Learning

The amount of connected devices has been growing tremendously over the past decade. These connected devices range from the traditional smart phones to electrical appliances, solar panels, converters, electric vehicles and wearables. Satisfying their connectivity demand is adding pressure to the wireless networks which are already pressed with serving their bandwidth-hungry mobile users. LTE Unlicensed (LTE-U) aims to exploit the unlicensed spectrum to offload mobile user (LTE users) traffic, increase capacity, and hence improve the us $e$ r/device experience in an era of inflated demand. Meanwhile, WiFi is the dominant technology operating at the unlicensed spectrum. Therefore, LTE-U needs to ensure the performance of WiFi users do not degrade as LTE users offload their traffic. In this paper, we propose a Q-learning based medium access approach to enhance the Listen Before Talk (LBT) mechanism of LTE-U. Q-learning based LBT helps with the co-existence issue by enhancing the performance of WiFi users at times when LTE-U users try to access the unlicensed bands. Our results show that the proposed Q-learning based LBT reduces the end-to-end delay of WiFi users in the order of several tens of seconds in comparison to the standard LBT implementation. It also increases the delivery success rate of WiFi traffic by up to 71%.

[1]  Sang-Jo Yoo,et al.  Dynamic resource allocation using reinforcement learning for LTE-U and WiFi in the unlicensed spectrum , 2017, 2017 Ninth International Conference on Ubiquitous and Future Networks (ICUFN).

[2]  Jonathan Ling,et al.  Practical LTE and WiFi Coexistence Techniques Beyond LBT , 2017, IEEE Communications Magazine.

[3]  Fotis Foukalas,et al.  Efficient Coexistence of LTE With WiFi in the Licensed and Unlicensed Spectrum Aggregation , 2016, IEEE Transactions on Cognitive Communications and Networking.

[4]  Sergey Andreev,et al.  Delivering Fairness and QoS Guarantees for LTE/Wi-Fi Coexistence Under LAA Operation , 2018, IEEE Access.

[5]  Satoshi Nagata,et al.  Licensed-Assisted Access to Unlicensed Spectrum in LTE Release 13 , 2016, IEEE Communications Magazine.

[6]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[7]  Yang Yang,et al.  Fair Downlink Traffic Management for Hybrid LAA-LTE/Wi-Fi Networks , 2017, IEEE Access.

[8]  Ismail Güvenç,et al.  Reinforcement learning for licensed-assisted access of LTE in the unlicensed spectrum , 2015, 2015 IEEE Wireless Communications and Networking Conference (WCNC).