Deep Reinforcement Learning for the Coexistence of LAA-LTE and WiFi Systems

As a promising technique to handle the conflict between the explosive mobile traffic and scare spectrum resource, license-assisted access (LAA) has been proposed to operate the LTE network on the unlicensed band. This paper considers the LAA-LTE system coexisting with an unsaturated WiFi system. Specifically, deep reinforcement learning (DRL) is adopted to enable the LAA-LTE system to learn the traffic pattern of the WiFi system and adaptively optimize its transmission time in each frame. Different from conventional coexistence schemes, which require massive signaling exchanges between the two systems to achieve fairness, the proposed DRL-based algorithm can maximize the spectrum usage while protecting the WiFi system without such signaling requirements. Simulation results demonstrate that the proposed scheme can achieve almost the same LAA-LTE throughput and protection to the WiFi system of the genie-aided exhaustive search algorithm, which has high complexity and requires to know the WiFi information perfectly.

[1]  Ming Xiao,et al.  Spectrum Sharing for Internet of Things: A Survey , 2018, IEEE Wireless Communications.

[2]  A. Girotra,et al.  Performance Analysis of the IEEE 802 . 11 Distributed Coordination Function , 2005 .

[3]  Ying-Chang Liang,et al.  Cooperative Ambient Backscatter Communications for Green Internet-of-Things , 2018, IEEE Internet of Things Journal.

[4]  Geoffrey Ye Li,et al.  Energy Efficiency Optimization in Licensed-Assisted Access , 2016, IEEE Journal on Selected Areas in Communications.

[5]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[6]  Ming Xiao,et al.  A Survey of Advanced Techniques for Spectrum Sharing in 5G Networks , 2017, IEEE Wireless Communications.

[7]  Soung Chang Liew,et al.  Deep-Reinforcement Learning Multiple Access for Heterogeneous Wireless Networks , 2019, IEEE J. Sel. Areas Commun..

[8]  Soung Chang Liew,et al.  Carrier-Sense Multiple Access for Heterogeneous Wireless Networks Using Deep Reinforcement Learning , 2019, 2019 IEEE Wireless Communications and Networking Conference Workshop (WCNCW).

[9]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[10]  Ying-Chang Liang,et al.  Licensed-Assisted Access for LTE in Unlicensed Spectrum: A MAC Protocol Design , 2016, IEEE Journal on Selected Areas in Communications.

[11]  Ismail Güvenç,et al.  Reinforcement learning for licensed-assisted access of LTE in the unlicensed spectrum , 2015, 2015 IEEE Wireless Communications and Networking Conference (WCNC).

[12]  Yiyang Pei,et al.  Modulation in the Air: Backscatter Communication Over Ambient OFDM Carrier , 2017, IEEE Transactions on Communications.

[13]  Ying-Chang Liang,et al.  A Learning-Based Coexistence Mechanism for LAA-LTE Based HetNets , 2018, 2018 IEEE International Conference on Communications (ICC).

[14]  Geoffrey Ye Li,et al.  LBT-Based Adaptive Channel Access for LTE-U Systems , 2016, IEEE Transactions on Wireless Communications.

[15]  Lin Zhang,et al.  Backscatter-NOMA: A Symbiotic System of Cellular and Internet-of-Things Networks , 2019, IEEE Access.

[16]  Ying-Chang Liang,et al.  Riding on the Primary: A New Spectrum Sharing Paradigm for Wireless-Powered IoT Devices , 2018, IEEE Transactions on Wireless Communications.

[17]  Xiaojun Yuan,et al.  Constellation Learning-Based Signal Detection for Ambient Backscatter Communication Systems , 2019, IEEE Journal on Selected Areas in Communications.