XiA: Send-It-Anyway Q-Routing for 6G-Enabled UAV-LEO Communications

In this paper, we propose a delay-aware Q-learning-based routing algorithm - XiA - for sending data from users to nearest Access Points (APs) through Unmanned Aerial Vehicle (UAV) swarms communicating using 6G technology. These UAVs assist the ground networks in overcoming communication voids while maneuvering through different demographics. However, the communication links in the THz band have limited transmission range, causing the UAVs to frequently disconnect from the swarm. We overcome such issues by waiting until the UAV comes in contact with others in case of non-time-sensitive data. In the case of time-sensitive data, the UAVs send the data to the APs through Low Earth Orbit (LEO) satellites. To empower XiA to adapt to the changing environments and expensive delays in LEO, we model the rewards by accounting for spreading and absorption in the 6G channels, and Doppler effect and pointing error in the satellite channel. We show our bias for the parameters through extensive simulations and prove that the Q-model in XiA achieves convergence under all conditions. Additionally, in comparison with state-of-the-art solutions, we observe that XiA offers an improved delay of 82%.

[1]  Do Trong Tuan,et al.  Pointing error effects on performance of free-space optical communication systems using SC-QAM signals over atmospheric turbulence channels , 2014 .

[2]  Geoffrey Ye Li,et al.  Ultra-Dense LEO: Integrating Terrestrial-Satellite Networks Into 5G and Beyond for Data Offloading , 2018, IEEE Transactions on Wireless Communications.

[3]  R. Sarpong,et al.  Bio-inspired synthesis of xishacorenes A, B, and C, and a new congener from fuscol† †Electronic supplementary information (ESI) available. See DOI: 10.1039/c9sc02572c , 2019, Chemical science.

[4]  Jincheng Tong,et al.  Study on the Scattering Effect of Terahertz Waves in Near-Surface Atmosphere , 2018, IEEE Access.

[5]  Ruhai Wang,et al.  Network Availability Maximization for Free-Space Optical Satellite Communications , 2020, IEEE Wireless Communications Letters.

[6]  Anandarup Mukherjee,et al.  Distributed aerial processing for IoT-based edge UAV swarms in smart farming , 2020, Comput. Networks.

[7]  Tianqi Mao,et al.  Spatial Modulation for Terahertz Communication Systems With Hardware Impairments , 2020, IEEE Transactions on Vehicular Technology.

[8]  R. Syski,et al.  Fundamentals of Queueing Theory , 1999, Technometrics.

[9]  Zhensen Wu,et al.  Modified model of equivalent height for predicting atmospheric attenuation at frequencies below 350 GHz , 2018 .

[10]  Weidang Lu,et al.  Incentive Mechanism Based Cooperative Spectrum Sharing for OFDM Cognitive IoT Network , 2020, IEEE Transactions on Network Science and Engineering.

[11]  Kok-Lim Alvin Yau,et al.  Route Selection in 5G-based Flying Ad-hoc Networks using Reinforcement Learning , 2020, 2020 10th IEEE International Conference on Control System, Computing and Engineering (ICCSCE).

[12]  James P. G. Sterbenz,et al.  AeroRP performance in highly-dynamic airborne networks using 3D Gauss-Markov mobility model , 2011, 2011 - MILCOM 2011 Military Communications Conference.

[13]  Ian F. Akyildiz,et al.  Multi-Ray Channel Modeling and Wideband Characterization for Wireless Communications in the Terahertz Band , 2015, IEEE Transactions on Wireless Communications.

[14]  Zhu Han,et al.  Taking Drones to the Next Level: Cooperative Distributed Unmanned-Aerial-Vehicular Networks for Small and Mini Drones , 2017, IEEE Vehicular Technology Magazine.

[15]  F. Sheikh,et al.  A Study of Diffuse Scattering in Massive MIMO Channels at Terahertz Frequencies , 2020, IEEE Transactions on Antennas and Propagation.

[16]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[17]  Soumyajit Mandal,et al.  Wireless Communications and Applications Above 100 GHz: Opportunities and Challenges for 6G and Beyond , 2019, IEEE Access.

[18]  Houbing Song,et al.  Rethinking Behaviors and Activities of Base Stations in Mobile Cellular Networks Based on Big Data Analysis , 2020, IEEE Transactions on Network Science and Engineering.

[19]  Theodore S. Rappaport,et al.  Scattering Mechanisms and Modeling for Terahertz Wireless Communications , 2019, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[20]  Chunxiao Jiang,et al.  Thirty Years of Machine Learning: The Road to Pareto-Optimal Wireless Networks , 2019, IEEE Communications Surveys & Tutorials.

[21]  Nei Kato,et al.  Flexible Resource Allocation With Inter-Beam Interference in Satellite Communication Systems With a Digital Channelizer , 2020, IEEE Transactions on Wireless Communications.

[22]  Theodoros A. Tsiftsis,et al.  On the Performance of LMS Communication With Hardware Impairments and Interference , 2019, IEEE Transactions on Communications.