Cooperative multi-UAV coverage mission planning platform for remote sensing applications

This paper proposes a novel mission planning platform, capable of efficiently deploying a team of UAVs to cover complex-shaped areas, in various remote sensing applications. Under the hood lies a novel optimization scheme for grid-based methods, utilizing Simulated Annealing algorithm, that significantly increases the achieved percentage of coverage and improves the qualitative features of the generated paths. Extensive simulated evaluation in comparison with a state-of-the-art alternative methodology, for coverage path planning (CPP) operations, establishes the performance gains in terms of achieved coverage and overall duration of the generated missions. On top of that, DARP algorithm is employed to allocate sub-tasks to each member of the swarm, taking into account each UAV’s sensing and operational capabilities, their initial positions and any no-fly-zones possibly defined inside the operational area. This feature is of paramount importance in real-life applications, as it has the potential to achieve tremendous performance improvements in terms of time demanded to complete a mission, while at the same time it unlocks a wide new range of applications, that was previously not feasible due to the limited battery life of UAVs. In order to investigate the actual efficiency gains that are introduced by the multi-UAV utilization, a simulated study is performed as well. All of these capabilities are packed inside an end-to-end platform that eases the utilization of UAVs’ swarms in remote sensing applications. Its versatility is demonstrated via two different real-life applications: (i) a photogrametry for precision agriculture and (ii) an indicative search and rescue for first responders missions, that were performed utilizing a swarm of commercial UAVs. An implementation of the the mCPP methodology introduced in this work, as well as a link for a demonstrative video and a link for a fully functional, on-line hosted instance of the presented platform can be found here: https://github.com/savvas-ap/mCPP-optimized-DARP .

[1]  Marc Carreras,et al.  A survey on coverage path planning for robotics , 2013, Robotics Auton. Syst..

[2]  Avrim Blum,et al.  Learning Complexity of Simulated Annealing , 2020, ArXiv.

[3]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[4]  K. R. Guruprasad X-STC: An Extended Spanning Tree-based Coverage algorithm for mobile robots , 2019, AIR 2019.

[5]  Olivier Simonin,et al.  A Common Optimization Framework for Multi-Robot Exploration and Coverage in 3D Environments , 2020, Journal of Intelligent & Robotic Systems.

[6]  Lorenzo Comba,et al.  Unsupervised detection of vineyards by 3D point-cloud UAV photogrammetry for precision agriculture , 2018, Comput. Electron. Agric..

[7]  Stephen L. Smith,et al.  On minimizing turns in robot coverage path planning , 2016, 2016 IEEE International Conference on Automation Science and Engineering (CASE).

[8]  Elias B. Kosmatopoulos,et al.  Towards an Integrated Low-Cost Agricultural Monitoring System with Unmanned Aircraft System , 2020, 2020 International Conference on Unmanned Aircraft Systems (ICUAS).

[9]  S. Ghaemi,et al.  Evaluation of Digital Image Discretization Error in Droplet Shape Measurement Using Simulation , 2009 .

[10]  Elias B. Kosmatopoulos,et al.  Autonomous and Cooperative Design of the Monitor Positions for a Team of UAVs to Maximize the Quantity and Quality of Detected Objects , 2020, IEEE Robotics and Automation Letters.

[11]  Gökhan Ince,et al.  Multi-agent search strategy based on digital pheromones for UAVs , 2016, 2016 24th Signal Processing and Communication Application Conference (SIU).

[12]  M. Er,et al.  Coverage path planning for UAVs based on enhanced exact cellular decomposition method , 2011 .

[13]  A. Ollero,et al.  Multiple UAV cooperative searching operation using polygon area decomposition and efficient coverage algorithms , 2004, DARS.

[14]  Howie Choset,et al.  Coverage for robotics – A survey of recent results , 2001, Annals of Mathematics and Artificial Intelligence.

[15]  Noam Hazon,et al.  Redundancy, Efficiency and Robustness in Multi-Robot Coverage , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[16]  Arturo de la Escalera,et al.  VBII-UAV: Vision-Based Infrastructure Inspection-UAV , 2017, WorldCIST.

[17]  Elias B. Kosmatopoulos,et al.  Real-time adaptive multi-robot exploration with application to underwater map construction , 2016, Auton. Robots.

[18]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[19]  Wen-Hua Chen,et al.  Boustrophedon coverage path planning for UAV aerial surveys in wind , 2017, 2017 International Conference on Unmanned Aircraft Systems (ICUAS).

[20]  Elon Rimon,et al.  Spanning-tree based coverage of continuous areas by a mobile robot , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[21]  W. Maes,et al.  Perspectives for Remote Sensing with Unmanned Aerial Vehicles in Precision Agriculture. , 2019, Trends in plant science.

[22]  Sonal Jain,et al.  Multi-robot forest coverage , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Xiang Huang,et al.  A Multi-Robot Coverage Path Planning Algorithm for the Environment With Multiple Land Cover Types , 2020, IEEE Access.

[24]  P. Rudol,et al.  Human Body Detection and Geolocalization for UAV Search and Rescue Missions Using Color and Thermal Imagery , 2008, 2008 IEEE Aerospace Conference.

[25]  Mani Golparvar-Fard,et al.  Visual monitoring of civil infrastructure systems via camera-equipped Unmanned Aerial Vehicles (UAVs): a review of related works , 2016 .

[26]  Pascal Bouvry,et al.  A Cooperative Coevolutionary Approach to Maximise Surveillance Coverage of UAV Swarms , 2020, 2020 IEEE 17th Annual Consumer Communications & Networking Conference (CCNC).

[27]  Taua M. Cabreira,et al.  Survey on Coverage Path Planning with Unmanned Aerial Vehicles , 2019, Drones.

[28]  Mac Schwager,et al.  Multidrone aerial surveys of penguin colonies in Antarctica , 2020, Science Robotics.

[29]  Tong Heng Lee,et al.  Coordinate Systems and Transformations , 2011 .

[30]  Jason M. O'Kane,et al.  Semi-boustrophedon coverage with a dubins vehicle , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[31]  Farid Melgani,et al.  A Convolutional Neural Network Approach for Assisting Avalanche Search and Rescue Operations with UAV Imagery , 2017, Remote. Sens..

[32]  Antonio Barrientos,et al.  Aerial remote sensing in agriculture: A practical approach to area coverage and path planning for fleets of mini aerial robots , 2011, J. Field Robotics.

[33]  Antonio Tomás Mozas-Calvache,et al.  Mission Flight Planning of RPAS for Photogrammetric Studies in Complex Scenes , 2020, ISPRS Int. J. Geo Inf..

[34]  Elias B. Kosmatopoulos,et al.  DARP: Divide Areas Algorithm for Optimal Multi-Robot Coverage Path Planning , 2017, J. Intell. Robotic Syst..

[35]  Howie Choset,et al.  Coverage Path Planning: The Boustrophedon Cellular Decomposition , 1998 .

[36]  Jianda Han,et al.  Search and Rescue Rotary‐Wing UAV and Its Application to the Lushan Ms 7.0 Earthquake , 2016, J. Field Robotics.

[37]  J. Gower,et al.  Minimum Spanning Trees and Single Linkage Cluster Analysis , 1969 .

[38]  Roland Siegwart,et al.  Revisiting Boustrophedon Coverage Path Planning as a Generalized Traveling Salesman Problem , 2019, FSR.

[39]  Elias B. Kosmatopoulos,et al.  A distributed, plug-n-play algorithm for multi-robot applications with a priori non-computable objective functions , 2019, Int. J. Robotics Res..

[40]  Howie Choset,et al.  Efficient Boustrophedon Multi-Robot Coverage: an algorithmic approach , 2008, Annals of Mathematics and Artificial Intelligence.

[41]  Noa Agmon,et al.  Constructing spanning trees for efficient multi-robot coverage , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[42]  L. Deng,et al.  UAV-based multispectral remote sensing for precision agriculture: A comparison between different cameras , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[43]  Giorgio C. Buttazzo,et al.  Coverage Path Planning for UAVs Photogrammetry with Energy and Resolution Constraints , 2016, J. Intell. Robotic Syst..

[44]  Jingxuan Sun,et al.  A Camera-Based Target Detection and Positioning UAV System for Search and Rescue (SAR) Purposes , 2016, Sensors.

[45]  C. Daughtry,et al.  What good are unmanned aircraft systems for agricultural remote sensing and precision agriculture? , 2018 .