Energy-Efficient Trajectory Optimization for Aerial Video Surveillance under QoS Constraints

Surveillance drones are unmanned aerial vehicles (UAVs) that are utilized to collect video recordings of targets. In this paper, we propose a novel design framework for aerial video surveillance in urban areas, where a cellular-connected UAV captures and transmits videos to the cellular network that services users. Fundamental challenges arise due to the limited onboard energy and quality of service (QoS) requirements over environment-dependent air-to-ground cellular links, where UAVs are usually served by the sidelobes of base stations (BSs). We aim to minimize the energy consumption of the UAV by jointly optimizing the mission completion time and UAV trajectory as well as transmission scheduling and association, subject to QoS constraints. The problem is formulated as a mixed-integer nonlinear programming (MINLP) problem by taking into account building blockage and BS antenna patterns. We first consider the average performance for uncertain local environments, and obtain an efficient sub-optimal solution by employing graph theory and convex optimization techniques. Next, we investigate the site-specific performance for specific urban local environments. By reformulating the problem as a Markov decision process (MDP), a deep reinforcement learning (DRL) algorithm is proposed by employing a dueling deep Q-network (DQN) neural network model with only local observations of sampled rate measurements. Simulation results show that the proposed solutions achieve significant performance gains over baseline schemes.

[1]  Yuzhen Ding,et al.  UAV Anti-Jamming Video Transmissions With QoE Guarantee: A Reinforcement Learning-Based Approach , 2021, IEEE Transactions on Communications.

[2]  Honggang Wang,et al.  Joint Resource Allocation and 3D Aerial Trajectory Design for Video Streaming in UAV Communication Systems , 2021, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Andrey V. Savkin,et al.  Online UAV Trajectory Planning for Covert Video Surveillance of Mobile Targets , 2021, IEEE Transactions on Automation Science and Engineering.

[4]  Abbas Jamalipour,et al.  Joint Optimization of Trajectory, Propulsion, and Thrust Powers for Covert UAV-on-UAV Video Tracking and Surveillance , 2020, IEEE Transactions on Information Forensics and Security.

[5]  Lajos Hanzo,et al.  Near-Instantaneously Adaptive Multi-Set Space-Time Shift Keying for UAV-Aided Video Surveillance , 2020, IEEE Transactions on Vehicular Technology.

[6]  Yong Zeng,et al.  Energy-Efficient Data Uploading for Cellular-Connected UAV Systems , 2020, IEEE Transactions on Wireless Communications.

[7]  Xiao-Wei Tang,et al.  QoE-Driven UAV-Enabled Pseudo-Analog Wireless Video Broadcast: A Joint Optimization of Power and Trajectory , 2020, IEEE Transactions on Multimedia.

[8]  Cheng Zhan,et al.  Energy Efficient Adaptive Video Streaming With Rotary-Wing UAV , 2020, IEEE Transactions on Vehicular Technology.

[9]  Ramona Trestian,et al.  An Innovative Machine-Learning-Based Scheduling Solution for Improving Live UHD Video Streaming Quality in Highly Dynamic Network Environments , 2020, IEEE Transactions on Broadcasting.

[10]  Yang Hu,et al.  Optimal Power and Bandwidth Allocation for Multiuser Video Streaming in UAV Relay Networks , 2020, IEEE Transactions on Vehicular Technology.

[11]  Rui Zhang,et al.  Simultaneous Navigation and Radio Mapping for Cellular-Connected UAV With Deep Reinforcement Learning , 2020, IEEE Transactions on Wireless Communications.

[12]  Han Hu,et al.  Unmanned Aircraft System Aided Adaptive Video Streaming: A Joint Optimization Approach , 2020, IEEE Transactions on Multimedia.

[13]  Fumiyuki Adachi,et al.  Uplink Precoding Optimization for NOMA Cellular-Connected UAV Networks , 2020, IEEE Transactions on Communications.

[14]  Raj Jain,et al.  Potential Data Link Candidates for Civilian Unmanned Aircraft Systems: A Survey , 2019, IEEE Communications Surveys & Tutorials.

[15]  Yansha Deng,et al.  Joint Beamforming, User Association, and Power Control for Cellular-Enabled UAV Communications , 2019, ArXiv.

[16]  Shuowen Zhang,et al.  Radio Map-Based 3D Path Planning for Cellular-Connected UAV , 2019, IEEE Transactions on Wireless Communications.

[17]  Xiangyun Zhou,et al.  Uplink NOMA for Cellular-Connected UAV: Impact of UAV Trajectories and Altitude , 2019, IEEE Transactions on Communications.

[18]  Tao Jiang,et al.  Sensor-Augmented Neural Adaptive Bitrate Video Streaming on UAVs , 2019, IEEE Transactions on Multimedia.

[19]  Nicola Marchetti,et al.  Mobility in the Sky: Performance and Mobility Analysis for Cellular-Connected UAVs , 2019, IEEE Transactions on Communications.

[20]  Rui Zhang,et al.  Cooperative Downlink Interference Transmission and Cancellation for Cellular-Connected UAV: A Divide-and-Conquer Approach , 2019, IEEE Transactions on Communications.

[21]  Xiaoli Xu,et al.  Cellular-Connected UAV: Performance Analysis with 3D Antenna Modelling , 2019, 2019 IEEE International Conference on Communications Workshops (ICC Workshops).

[22]  Yonggang Wen,et al.  Optimization for HTTP Adaptive Video Streaming in UAV-Enabled Relaying System , 2019, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[23]  Qingqing Wu,et al.  Accessing From the Sky: A Tutorial on UAV Communications for 5G and Beyond , 2019, Proceedings of the IEEE.

[24]  Rui Zhang,et al.  Trajectory Design for Cellular-Connected UAV Under Outage Duration Constraint , 2019, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[25]  Derrick Wing Kwan Ng,et al.  Optimal 3D-Trajectory Design and Resource Allocation for Solar-Powered UAV Communication Systems , 2018, IEEE Transactions on Communications.

[26]  Rui Zhang,et al.  Cellular-Connected UAV: Uplink Association, Power Control and Interference Coordination , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[27]  Sofie Pollin,et al.  Cellular Connectivity for UAVs: Network Modeling, Performance Analysis, and Design Guidelines , 2018, IEEE Transactions on Wireless Communications.

[28]  Walid Saad,et al.  Echo-Liquid State Deep Learning for 360° Content Transmission and Caching in Wireless VR Networks With Cellular-Connected UAVs , 2018, IEEE Transactions on Communications.

[29]  Jie Xu,et al.  Energy Minimization for Wireless Communication With Rotary-Wing UAV , 2018, IEEE Transactions on Wireless Communications.

[30]  Rui Zhang,et al.  Cellular-Connected UAV: Potential, Challenges, and Promising Technologies , 2018, IEEE Wireless Communications.

[31]  Walid Saad,et al.  A Tutorial on UAVs for Wireless Networks: Applications, Challenges, and Open Problems , 2018, IEEE Communications Surveys & Tutorials.

[32]  Tom Schaul,et al.  Rainbow: Combining Improvements in Deep Reinforcement Learning , 2017, AAAI.

[33]  Pingzhi Fan,et al.  Non-Orthogonal Multiple Access for Cooperative Multicast Millimeter Wave Wireless Networks , 2017, IEEE Journal on Selected Areas in Communications.

[34]  Ryu Miura,et al.  A Wireless Relay Network Based on Unmanned Aircraft System With Rate Optimization , 2016, IEEE Transactions on Wireless Communications.

[35]  Rui Zhang,et al.  Energy-Efficient UAV Communication With Trajectory Optimization , 2016, IEEE Transactions on Wireless Communications.

[36]  Tom Schaul,et al.  Dueling Network Architectures for Deep Reinforcement Learning , 2015, ICML.

[37]  David Silver,et al.  Deep Reinforcement Learning with Double Q-Learning , 2015, AAAI.

[38]  Kandeepan Sithamparanathan,et al.  Optimal LAP Altitude for Maximum Coverage , 2014, IEEE Wireless Communications Letters.

[39]  Mario Osvin Pavčević,et al.  Introduction to graph theory , 1973, The Mathematical Gazette.

[40]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[41]  Propagation data and prediction methods required for the design of terrestrial broadband radio access systems operating in a frequency range from 3 to 60 GHz , 2022 .