Decentralized and Dynamic Band Selection in Uplink Enhanced Licensed-Assisted Access: Deep Reinforcement Learning Approach

Enhanced licensed-assisted access (eLAA) is an operational mode that allows the use of unlicensed band to support long-term evolution (LTE) service via carrier aggregation technology. The extension of additional bandwidth is beneficial to meet the demands of the growing mobile traffic. In the uplink eLAA, which is prone to unexpected interference from WiFi access points, resource scheduling by the base station, and then performing a listen before talk (LBT) mechanism by the users can seriously affect the resource utilization. In this paper, we present a decentralized deep reinforcement learning (DRL)-based approach in which each user independently learns dynamic band selection strategy that maximizes its own rate. Through extensive simulations, we show that the proposed DRL-based band selection scheme improves resource utilization while supporting certain minimum quality of service (QoS).

[1]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[2]  Houman Zarrinkoub,et al.  Understanding LTE with MATLAB: From Mathematical Modeling to Simulation and Prototyping , 2014 .

[3]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[4]  Xiaoli Chu,et al.  Performance Analysis of LAA and WiFi Coexistence in Unlicensed Spectrum Based on Markov Chain , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[5]  Seung-Hoon Park,et al.  Channel Access Scheme With Alignment Reference Interval Adaptation (ARIA) for Frequency Reuse in Unlicensed Band LTE: Fuzzy Q-Learning Approach , 2018, IEEE Access.

[6]  A. Girotra,et al.  Performance Analysis of the IEEE 802 . 11 Distributed Coordination Function , 2005 .

[7]  Amitav Mukherjee,et al.  Uplink Performance of Enhanced Licensed Assisted Access (eLAA) in Unlicensed Spectrum , 2017, 2017 IEEE Wireless Communications and Networking Conference (WCNC).

[8]  Amitava Ghosh,et al.  Downlink Performance Analysis of LTE and WiFi Coexistence in Unlicensed Bands with a Simple Listen-Before-Talk Scheme , 2015, 2015 IEEE 81st Vehicular Technology Conference (VTC Spring).

[9]  Zhongming Zheng,et al.  LTE-unlicensed: the future of spectrum aggregation for cellular networks , 2015, IEEE Wireless Communications.

[10]  Chung K. Kim,et al.  Adaptive Listen-Before-Talk (LBT) scheme for LTE and Wi-Fi systems coexisting in unlicensed band , 2016, 2016 13th IEEE Annual Consumer Communications & Networking Conference (CCNC).

[11]  George K. Karagiannidis,et al.  Effect of Feedback Delay on Amplify-and-Forward Relay Networks With Beamforming , 2011, IEEE Transactions on Vehicular Technology.

[12]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[13]  Bin Li,et al.  LBT with adaptive threshold for coexistence of cellular and WLAN in unlicensed spectrum , 2016, 2016 8th International Conference on Wireless Communications & Signal Processing (WCSP).

[14]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[15]  Ying-Chang Liang,et al.  Random Access or Scheduling: Optimum LTE Licensed-Assisted Access to Unlicensed Spectrum , 2016, IEEE Communications Letters.

[16]  Hongwen Yang,et al.  Grant-less uplink transmission for LTE operated in unlicensed spectrum , 2017, 2017 IEEE 28th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC).

[17]  Tiankui Zhang,et al.  Hidden Node Aware Resource Allocation in Licensed-Assisted Access Systems , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[18]  Danna Zhou,et al.  d. , 1934, Microbial pathogenesis.

[19]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.