Joint Optimization of Access and Backhaul Links for UAVs Based on Reinforcement Learning

In this paper, we study the application of unmanned aerial vehicle (UAV) base stations (BSs) in order to improve the cellular network capacity. We consider flying BSs where BS equipments are mounted on UAVs, making it possible to move BSs freely in space. We study the optimization of UAVs' trajectory in a network with mobile users to improve the system throughput. We consider practical two-hop communications, i.e., the access link between a user and the UAV BS, and the backhaul link between the UAV BS and a macrocell BS plugged into the core network. We propose a reinforcement learning based algorithm to control the UAVs' mobility. Additionally, the proposed algorithm is subject to physical constraints of UAV mobility. Simulation results show that considering both the backhaul and access links in the UAV mobility optimization is highly effective in improving the system performance than only focusing on the access link.

[1]  Mahbub Hassan,et al.  Understanding autonomous drone maneuverability for Internet of Things applications , 2017, 2017 IEEE 18th International Symposium on A World of Wireless, Mobile and Multimedia Networks (WoWMoM).

[2]  Rui Zhang,et al.  Wireless communications with unmanned aerial vehicles: opportunities and challenges , 2016, IEEE Communications Magazine.

[3]  Luiz A. DaSilva,et al.  Backhaul for Low-Altitude UAVs in Urban Environments , 2017, 2018 IEEE International Conference on Communications (ICC).

[4]  Ming Ding,et al.  Please Lower Small Cell Antenna Heights in 5G , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[5]  Tarik Taleb,et al.  UAV-Based IoT Platform: A Crowd Surveillance Use Case , 2017, IEEE Communications Magazine.

[6]  Mahbub Hassan,et al.  Performance Analysis of the Access Link of Drone Base Station Networks with LoS/NLoS Transmissions , 2018, INISCOM.

[7]  Mahbub Hassan,et al.  Flying Drone Base Stations for Macro Hotspots , 2018, IEEE Access.

[8]  Xiaohu Ge,et al.  User Mobility Evaluation for 5G Small Cell Networks Based on Individual Mobility Model , 2015, IEEE Journal on Selected Areas in Communications.

[9]  Mahbub Hassan,et al.  Survey on UAV Cellular Communications: Practical Aspects, Standardization Advancements, Regulation, and Security Challenges , 2018, IEEE Communications Surveys & Tutorials.

[10]  Xiang-Gen Xia,et al.  Enabling UAV cellular with millimeter-wave communication: potentials and approaches , 2016, IEEE Communications Magazine.

[11]  Ekram Hossain,et al.  Multi-Tier Drone Architecture for 5G/B5G Cellular Networks: Challenges, Trends, and Prospects , 2017, IEEE Communications Magazine.

[12]  Andrey V. Savkin,et al.  An Algorithm of Efficient Proactive Placement of Autonomous Drones for Maximum Coverage in Cellular Networks , 2018, IEEE Wireless Communications Letters.

[13]  Yijun Liu,et al.  Trajectory Optimization and Power Allocation for Multi-Hop UAV Relaying Communications , 2018, IEEE Access.

[14]  Sofie Pollin,et al.  Coexistence of Terrestrial and Aerial Users in Cellular Networks , 2017, 2017 IEEE Globecom Workshops (GC Wkshps).

[15]  Eric N. Johnson,et al.  A Comprehensive Matrix of Unmanned Aerial Systems Requirements for Potential Applications within a Department of Transportation , 2014 .

[16]  Luiz A. DaSilva,et al.  A Stochastic Geometry Model of Backhaul and User Coverage in Urban UAV Networks , 2017, ArXiv.

[17]  Um Rao Mogili,et al.  Review on Application of Drone Systems in Precision Agriculture , 2018 .

[18]  Mahbub Hassan,et al.  DroneCells: Improving 5G Spectral Efficiency using Drone-mounted Flying Base Stations , 2017, J. Netw. Comput. Appl..

[19]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[20]  Mahbub Hassan,et al.  Dynamic Base Station Repositioning to Improve Performance of Drone Small Cells , 2016, 2016 IEEE Globecom Workshops (GC Wkshps).