UAVs joint optimization problems and machine learning to improve the 5G and Beyond communication

Abstract Recently, unmanned aerial vehicles (UAVs) have gained notable interest in various applications such as wireless coverage, aerial surveillance, precision agriculture, construction, power lines monitoring and blood delivery, etc. The UAVs implicit attributes e.g., rapid deployment, quick mobility, increase in flight duration, improvements in payload capacities, etc. , place it as an effective candidate for many applications in 5G and Beyond communications. The UAVs-assisted next-generation communications are determined to be highly influenced by various techniques and technologies like artificial intelligence (AI), machine learning (ML), deep reinforcement learning (DRL), mobile edge computing (MEC), and software-defined networks (SDN). In this article, we develop a review to investigate the UAVs joint optimization problems to enhance system efficiency. We classify the joint optimization problems based on the number of parameters used in proposed optimization problems. Moreover, we explore the impact of AI, ML, DRL, MEC, and SDN over UAVs joint optimization problems and present future research challenges and directions.

[1]  Xiaobo Zhou,et al.  UAV-Enabled Confidential Data Collection in Wireless Networks , 2020 .

[2]  Kezhi Wang,et al.  Deep Reinforcement Learning Based Dynamic Trajectory Control for UAV-Assisted Mobile Edge Computing , 2019, IEEE Transactions on Mobile Computing.

[3]  Fadi Al-Turjman,et al.  Drones in IoT-enabled Spaces , 2019 .

[4]  Holger Karl,et al.  A UAV-based moving 5G RAN for massive connectivity of mobile users and IoT devices , 2020, Veh. Commun..

[5]  Pedro Cumino,et al.  Cluster-Based Control Plane Messages Management in Software-Defined Flying Ad-Hoc Network , 2019, Sensors.

[6]  Rose Qingyang Hu,et al.  Mobile Edge Computing in Unmanned Aerial Vehicle Networks , 2019, IEEE Wireless Communications.

[7]  Li Zhou,et al.  Stochastic Computation Offloading and Trajectory Scheduling for UAV-Assisted Mobile Edge Computing , 2019, IEEE Internet of Things Journal.

[8]  Deyue Zou,et al.  Learning-Based User Association for Dual-UAV Enabled Wireless Networks With D2D Connections , 2019, IEEE Access.

[9]  Xiao Liu,et al.  Trajectory Design and Power Control for Multi-UAV Assisted Wireless Networks: A Machine Learning Approach , 2018, IEEE Transactions on Vehicular Technology.

[10]  Ekram Hossain,et al.  Multi-Tier Drone Architecture for 5G/B5G Cellular Networks: Challenges, Trends, and Prospects , 2017, IEEE Communications Magazine.

[11]  Xiao Zhang,et al.  An SDN framework for UAV backbone network towards knowledge centric networking , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[12]  Jun Du,et al.  Power-Delay Trade-off for Heterogenous Cloud Enabled Multi-UAV Systems , 2019, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[13]  Lisandro Zambenedetti Granville,et al.  Software-defined networking: management requirements and challenges , 2015, IEEE Communications Magazine.

[14]  Sushma Jain,et al.  Software Defined UAV-Based Location Aware Deployment Scheme for Optimal Wireless Coverage , 2019, 2019 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech).

[15]  Mitchell M. Tseng,et al.  On equilibrium solutions to joint optimization problems in engineering design , 2013 .

[16]  Tony Q. S. Quek,et al.  Joint User Association and UAV Location Optimization for UAV-Aided Communications , 2019, IEEE Wireless Communications Letters.

[17]  Jian Yu,et al.  Joint 3D UAV Placement and Resource Allocation in Software-Defined Cellular Networks With Wireless Backhaul , 2019, IEEE Access.

[18]  Tiankui Zhang,et al.  Joint Computation and Communication Design for UAV-Assisted Mobile Edge Computing in IoT , 2020, IEEE Transactions on Industrial Informatics.

[19]  Fadi Al-Turjman,et al.  Applications of Artificial Intelligence and Machine learning in smart cities , 2020, Comput. Commun..

[20]  Houbing Song,et al.  Cache-Enabled Unmanned Aerial Vehicles for Cooperative Cognitive Radio Networks , 2020, IEEE Wireless Communications.

[21]  Jun Li,et al.  UAV-Enabled Secure Communications: Joint Trajectory and Transmit Power Optimization , 2019, IEEE Transactions on Vehicular Technology.

[22]  Christophe GUERBER,et al.  Software defined network based architecture to improve security in a swarm of drones , 2019, 2019 International Conference on Unmanned Aircraft Systems (ICUAS).

[23]  Jie Xu,et al.  Common Throughput Maximization for UAV-Enabled Interference Channel With Wireless Powered Communications , 2019, IEEE Transactions on Communications.

[24]  Mohsen Guizani,et al.  Unmanned Aerial Vehicles (UAVs): A Survey on Civil Applications and Key Research Challenges , 2018, IEEE Access.

[25]  Yue Gao,et al.  UAV Communications Based on Non-Orthogonal Multiple Access , 2018, IEEE Wireless Communications.

[26]  Halim Yanikomeroglu,et al.  Airborne Communication Networks: A Survey , 2018, IEEE Journal on Selected Areas in Communications.

[27]  David Gesbert,et al.  Simultaneous User Association and Placement in Multi-UAV Enabled Wireless Networks , 2018, WSA.

[28]  Zhu Han,et al.  Response Delay Optimization in Mobile Edge Computing Enabled UAV Swarm , 2020, IEEE Transactions on Vehicular Technology.

[29]  Mahbub Hassan,et al.  Survey on UAV Cellular Communications: Practical Aspects, Standardization Advancements, Regulation, and Security Challenges , 2018, IEEE Communications Surveys & Tutorials.

[30]  Derrick Wing Kwan Ng,et al.  Resource Allocation for Secure Multi-UAV Communication Systems With Multi-Eavesdropper , 2020, IEEE Transactions on Communications.

[31]  Yixin Zhang,et al.  Trajectory and Power Optimization for Multi-UAV Enabled Emergency Wireless Communications Networks , 2019, 2019 IEEE International Conference on Communications Workshops (ICC Workshops).

[32]  Fadi Al-Turjman A novel approach for drones positioning in mission critical applications , 2019 .

[33]  Walid Saad,et al.  Liquid State Machine Learning for Resource and Cache Management in LTE-U Unmanned Aerial Vehicle (UAV) Networks , 2018, IEEE Transactions on Wireless Communications.

[34]  Lihua Li,et al.  Resource Allocation and Basestation Placement in Downlink Cellular Networks Assisted by Multiple Wireless Powered UAVs , 2020, IEEE Transactions on Vehicular Technology.

[35]  Yansha Deng,et al.  Joint Beamforming, User Association, and Power Control for Cellular-Enabled UAV Communications , 2019, ArXiv.

[36]  Jiacheng Chen,et al.  Dynamic Task Offloading and Resource Allocation for Mobile-Edge Computing in Dense Cloud RAN , 2020, IEEE Internet of Things Journal.

[37]  Waleed Ejaz,et al.  Unmanned Aerial Vehicles enabled IoT Platform for Disaster Management , 2019, Energies.

[38]  Xuemin Shen,et al.  Energy-Efficient UAV-Assisted Mobile Edge Computing: Resource Allocation and Trajectory Optimization , 2020, IEEE Transactions on Vehicular Technology.

[39]  H. Vincent Poor,et al.  UAV-Enabled Communication Using NOMA , 2018, IEEE Transactions on Communications.

[40]  Leonardo Mostarda,et al.  Cognition in UAV-Aided 5G and Beyond Communications: A Survey , 2020, IEEE Transactions on Cognitive Communications and Networking.

[41]  Jie Xu,et al.  Capacity Characterization of UAV-Enabled Two-User Broadcast Channel , 2018, IEEE Journal on Selected Areas in Communications.

[42]  Jingwei Zhang,et al.  UAV-Enabled Radio Access Network: Multi-Mode Communication and Trajectory Design , 2018, IEEE Transactions on Signal Processing.

[43]  Walid Saad,et al.  A Tutorial on UAVs for Wireless Networks: Applications, Challenges, and Open Problems , 2018, IEEE Communications Surveys & Tutorials.

[44]  Abd-Elhamid M. Taha,et al.  An Architecture for Software Defined Drone Networks , 2019, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[45]  Ewen Denney,et al.  A programmable SDN+NFV-based architecture for UAV telemetry monitoring , 2017, 2017 14th IEEE Annual Consumer Communications & Networking Conference (CCNC).

[46]  Mario Gerla,et al.  Software-defined unmanned aerial vehicles networking for video dissemination services , 2019, Ad Hoc Networks.

[47]  Zhiyang Li,et al.  Joint Trajectory and Communication Design for Secure UAV Networks , 2019, IEEE Communications Letters.

[48]  Fadi Al-Turjman,et al.  Network Lifetime Efficiency Based on Equal and Unequal Size Clustering Strategies , 2020, AINA Workshops.

[49]  Walid Saad,et al.  Online Optimization for UAV-Assisted Distributed Fog Computing in Smart Factories of Industry 4.0 , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[50]  Baoqing Li,et al.  An Efficient Solution for Joint Power and Trajectory Optimization in UAV-Enabled Wireless Network , 2019, IEEE Access.

[51]  Wenchao Xu,et al.  Air-Ground Integrated Mobile Edge Networks: Architecture, Challenges, and Opportunities , 2018, IEEE Communications Magazine.

[52]  Zoubin Ghahramani,et al.  Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning , 2015, ICML.

[53]  Xiao Liu,et al.  Reinforcement Learning in Multiple-UAV Networks: Deployment and Movement Design , 2019, IEEE Transactions on Vehicular Technology.

[54]  Weiwei Yang,et al.  Robust Trajectory and Communication Design for Multi-UAV Enabled Wireless Networks in the Presence of Jammers , 2020, IEEE Access.

[55]  Mohamed-Slim Alouini,et al.  A Distributed Mechanism for Joint 3D Placement and User Association in UAV-Assisted Networks , 2019, 2019 IEEE Wireless Communications and Networking Conference (WCNC).

[56]  Tarik Taleb,et al.  A green strategic activity scheduling for UAV networks: A sub-modular game perspective , 2016, IEEE Communications Magazine.

[57]  Ning Ge,et al.  Maritime Coverage Enhancement Using UAVs Coordinated With Hybrid Satellite-Terrestrial Networks , 2019, IEEE Transactions on Communications.

[58]  John N. Tsitsiklis,et al.  Actor-Critic Algorithms , 1999, NIPS.

[59]  Bo Yuan,et al.  Mobilouds: An Energy Efficient MCC Collaborative Framework With Extended Mobile Participation for Next Generation Networks , 2016, IEEE Access.

[60]  Lav Gupta,et al.  Survey of Important Issues in UAV Communication Networks , 2016, IEEE Communications Surveys & Tutorials.

[61]  Evsen Yanmaz,et al.  Survey on Unmanned Aerial Vehicle Networks for Civil Applications: A Communications Viewpoint , 2016, IEEE Communications Surveys & Tutorials.

[62]  Chuan Ma,et al.  A Reinforcement Learning Based User Association Algorithm for UAV Networks , 2018, 2018 28th International Telecommunication Networks and Applications Conference (ITNAC).

[63]  Chunxiao Jiang,et al.  Joint UAV Hovering Altitude and Power Control for Space-Air-Ground IoT Networks , 2019, IEEE Internet of Things Journal.

[64]  Fadi Al-Turjman,et al.  UAVs assessment in software-defined IoT networks: An overview , 2020, Comput. Commun..

[65]  Shuowen Zhang,et al.  Cellular-Enabled UAV Communication: A Connectivity-Constrained Trajectory Optimization Perspective , 2018, IEEE Transactions on Communications.

[66]  Fei Huang,et al.  Multiple-UAV-Assisted SWIPT in Internet of Things: User Association and Power Allocation , 2019, IEEE Access.

[67]  Mubashir Husain Rehmani,et al.  Mobile Edge Computing: Opportunities, solutions, and challenges , 2017, Future Gener. Comput. Syst..

[68]  Rui Zhang,et al.  UAV-Aided Offloading for Cellular Hotspot , 2017, IEEE Transactions on Wireless Communications.

[69]  Giovanni Schembra,et al.  Designing a Softwarized Network Deployed on a Fleet of Drones for Rural Zone Monitoring , 2017, Future Internet.

[70]  Fadi Al-Turjman,et al.  An overview of security and privacy in smart cities' IoT communications , 2019, Trans. Emerg. Telecommun. Technol..