3D Aerial Vehicle Base Station (UAV-BS) Position Planning based on Deep Q-Learning for Capacity Enhancement of Users With Different QoS Requirements

With the development of modern network, the demand of users has increased dramatically, and more data and services are required. This has caused tremendous pressure on the Macro-cellular network of infrastructure. Air access has become a new solution for the development of communications. Unmanned aerial vehicle (UAV) is used as an air node to improve coverage and capacity. Based on deep Q-Network(DQN) algorithm and considering the different quality of service requirements of different users, this paper proposes an optimal 3D location planning algorithm. The results show that the use of multiple UAVs can not only provide capacity enhancement, but also meet the different QoS requirements of different users. The average spectral efficiency of the system is increased by 15.5%, and user coverage to meet QoS requirements increased by 25.5%.

[1]  Yiyan Wu,et al.  Cloud Transmission: A New Spectrum-Reuse Friendly Digital Terrestrial Broadcasting Transmission System , 2012, IEEE Transactions on Broadcasting.

[2]  Halim Yanikomeroglu,et al.  Backhaul-aware robust 3D drone placement in 5G+ wireless networks , 2017, 2017 IEEE International Conference on Communications Workshops (ICC Workshops).

[3]  Halim Yanikomeroglu,et al.  3-D Placement of an Unmanned Aerial Vehicle Base Station (UAV-BS) for Energy-Efficient Maximal Coverage , 2017, IEEE Wireless Communications Letters.

[4]  Halim Yanikomeroglu,et al.  HetHetNets: Heterogeneous Traffic Distribution in Heterogeneous Wireless Cellular Networks , 2015, IEEE Journal on Selected Areas in Communications.

[5]  Mehdi Bennis,et al.  Drone Small Cells in the Clouds: Design, Deployment and Performance Analysis , 2014, GLOBECOM 2014.

[6]  Xinbo Gao,et al.  Deployment of High Altitude Platforms network: A game theoretic approach , 2012, 2012 International Conference on Computing, Networking and Communications (ICNC).

[7]  Karina Mabell Gomez,et al.  On the performance of aerial LTE base-stations for public safety and emergency recovery , 2013, 2013 IEEE Globecom Workshops (GC Wkshps).

[8]  Liang Gong,et al.  Integrating network function virtualization with SDR and SDN for 4G/5G networks , 2015, IEEE Network.

[9]  Halim Yanikomeroglu,et al.  Efficient 3-D placement of an aerial base station in next generation cellular networks , 2016, 2016 IEEE International Conference on Communications (ICC).

[10]  Juan D. Deaton High Altitude Platforms for Disaster Recovery: Capabilities, Strategies, and Techniques for Emergency Telecommunications , 2008, EURASIP J. Wirel. Commun. Netw..

[11]  Rui Zhang,et al.  Placement Optimization of UAV-Mounted Mobile Base Stations , 2016, IEEE Communications Letters.

[12]  Halim Yanikomeroglu,et al.  On the Number and 3D Placement of Drone Base Stations in Wireless Cellular Networks , 2016, 2016 IEEE 84th Vehicular Technology Conference (VTC-Fall).

[13]  Halim Yanikomeroglu,et al.  3-D Placement of an Unmanned Aerial Vehicle Base Station for Maximum Coverage of Users With Different QoS Requirements , 2017, IEEE Wireless Communications Letters.

[14]  Walid Saad,et al.  Unmanned Aerial Vehicle With Underlaid Device-to-Device Communications: Performance and Tradeoffs , 2015, IEEE Transactions on Wireless Communications.

[15]  Mohsen Guizani,et al.  Call Admission Control Optimization in WiMAX Networks , 2008, IEEE Transactions on Vehicular Technology.

[16]  Kandeepan Sithamparanathan,et al.  Optimal LAP Altitude for Maximum Coverage , 2014, IEEE Wireless Communications Letters.