Contextual Bandits Approach for Selecting the Best Channel in Industry 4.0 Network

Ultra dense heterogeneous network of new radio in unlicensed band (NR-U) is a key technology for potentially accomplishing the capacity and seamless connection goal of next-generation wireless communication systems in Industry 4.0 network. Such deployment results in the cell proliferation with diverse cell size in overlapping condition, which leverage various channel connectivity option for the NR-U user. Nevertheless, coexistence of several other NR-U and/or legacy unlicensed band users in the common channel is a major technical challenge to be resolved, which severely degrades the user’s quality of service (QoS). Hence, this paper is based on the channel selection functionality for mobile NR-U users to select the best channel to use for uplink transmission in the unlicensed band. We model this problem using contextual bandits as the set of context information is provided to the user. We use Thompson’s sampling algorithm to solve the problem. The simulation result has been presented to show the effect of noise on the performance of our proposed approach.

[1]  Riku Jäntti,et al.  A Survey on Handover Management: From LTE to NR , 2019, IEEE Access.

[2]  Haejoon Jung,et al.  Outage Analysis of Multihop Wireless Backhaul Using Millimeter Wave under Blockage Effects , 2017 .

[3]  Syed Ali Hassan,et al.  Energy Efficiency and Hover Time Optimization in UAV-Based HetNets , 2020, IEEE Transactions on Intelligent Transportation Systems.

[4]  Syed Ali Hassan,et al.  A Drone-Aided Blockchain-Based Smart Vehicular Network , 2020, IEEE Transactions on Intelligent Transportation Systems.

[5]  Harald Haas,et al.  Handover Skipping for LiFi , 2019, IEEE Access.

[6]  Sangheon Pack,et al.  Performance evaluation of LTE-unlicensed in handover scenarios , 2015, 2015 International Conference on Information and Communication Technology Convergence (ICTC).

[7]  Takao Inoue,et al.  5G NR Release 16 and Millimeter Wave Integrated Access and Backhaul , 2020, 2020 IEEE Radio and Wireless Symposium (RWS).

[8]  Haejoon Jung,et al.  Future Is Unlicensed: Private 5G Unlicensed Network for Connecting Industries of Future , 2020, Sensors.

[9]  Haejoon Jung,et al.  Secrecy Rate Analysis of Open-Loop Analog Collaborative Beamforming Under Position Estimation Error of Virtual Antenna Array , 2019, IEEE Wireless Communications Letters.

[10]  Haejoon Jung,et al.  Outage Analysis of Millimeter-Wave Wireless Backhaul in the Presence of Blockage , 2016, IEEE Communications Letters.

[11]  Juho Lee,et al.  Expanding 5G New Radio Technology to Unlicensed Spectrum , 2019, 2019 IEEE Globecom Workshops (GC Wkshps).

[12]  Haejoon Jung,et al.  Performance Analysis of Three-Dimensional Clustered Device-to-Device Networks for Internet of Things , 2017, Wirel. Commun. Mob. Comput..

[13]  Haejoon Jung,et al.  Analog Cooperative Beamforming With Spherically-Bound Random Arrays for Physical-Layer Secure Communications , 2018, IEEE Communications Letters.

[14]  Haejoon Jung,et al.  Distributed Null-Steering Beamformer Design for Physical Layer Security Enhancement in Internet-of-Things Networks , 2021, IEEE Systems Journal.

[15]  Shipra Agrawal,et al.  Analysis of Thompson Sampling for the Multi-armed Bandit Problem , 2011, COLT.

[16]  Haejoon Jung,et al.  Secrecy Rate of Analog Collaborative Beamforming With Virtual Antenna Array Following Spatial Random Distributions , 2018, IEEE Wireless Communications Letters.

[17]  Benjamin Van Roy,et al.  A Tutorial on Thompson Sampling , 2017, Found. Trends Mach. Learn..

[18]  Shipra Agrawal,et al.  Thompson Sampling for Contextual Bandits with Linear Payoffs , 2012, ICML.

[19]  Haejoon Jung,et al.  User Selection and Power Allocation for Downlink NOMA Systems With Quality-Based Feedback in Rayleigh Fading Channels , 2020, IEEE Wireless Communications Letters.

[20]  Constantinos Psomas,et al.  Mobility Management in Ultra-Dense Networks: Handover Skipping Techniques , 2018, IEEE Access.

[21]  Haejoon Jung,et al.  Secrecy Performance Analysis of Analog Cooperative Beamforming in Three-Dimensional Gaussian Distributed Wireless Sensor Networks , 2019, IEEE Transactions on Wireless Communications.

[22]  Masahiro Morikura,et al.  Thompson Sampling-Based Channel Selection Through Density Estimation Aided by Stochastic Geometry , 2020, IEEE Access.