Multi-UAV Coverage Path Planning for the Inspection of Large and Complex Structures

We present a multi-UAV Coverage Path Planning (CPP) framework for the inspection of large-scale, complex 3D structures. In the proposed sampling-based coverage path planning method, we formulate the multi-UAV inspection applications as a multi-agent coverage path planning problem. By combining two NP-hard problems: Set Covering Problem (SCP) and Vehicle Routing Problem (VRP), a Set-Covering Vehicle Routing Problem (SC-VRP) is formulated and subsequently solved by a modified Biased Random Key Genetic Algorithm (BRKGA) with novel, efficient encoding strategies and local improvement heuristics. We test our proposed method for several complex 3D structures with the 3D model extracted from OpenStreetMap. The proposed method outperforms previous methods, by reducing the length of the planned inspection path by up to 48%

[1]  Y.F. Li,et al.  Automatic sensor placement for model-based robot vision , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[2]  Lakmal Seneviratne,et al.  A survey on inspecting structures using robotic systems , 2016 .

[3]  Pat Hanrahan,et al.  Submodular Trajectory Optimization for Aerial 3D Scanning , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[4]  Taua M. Cabreira,et al.  Survey on Coverage Path Planning with Unmanned Aerial Vehicles , 2019, Drones.

[5]  Emil Fresk,et al.  Cooperative coverage path planning for visual inspection , 2018 .

[6]  Sungho Jo,et al.  Online inspection path planning for autonomous 3D modeling using a micro-aerial vehicle , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Lawrence V. Snyder,et al.  A random-key genetic algorithm for the generalized traveling salesman problem , 2006, Eur. J. Oper. Res..

[8]  Matthias Nießner,et al.  Plan3D , 2017, ACM Trans. Graph..

[9]  Juan Carlos Herrera-Lozada,et al.  Coverage Path Planning for 2D Convex Regions , 2019, Journal of Intelligent & Robotic Systems.

[10]  Ser-Nam Lim,et al.  A Reinforcement Learning Approach to the View Planning Problem , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Aric Hagberg,et al.  Exploring Network Structure, Dynamics, and Function using NetworkX , 2008, Proceedings of the Python in Science Conference.

[12]  Wei Jing,et al.  View planning for 3D shape reconstruction of buildings with unmanned aerial vehicles , 2016, 2016 14th International Conference on Control, Automation, Robotics and Vision (ICARCV).

[13]  James C. Bean,et al.  Genetic Algorithms and Random Keys for Sequencing and Optimization , 1994, INFORMS J. Comput..

[14]  Wei Lin,et al.  Sampling-based coverage motion planning for industrial inspection application with redundant robotic system , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  Howie Choset,et al.  Coverage for robotics – A survey of recent results , 2001, Annals of Mathematics and Artificial Intelligence.

[16]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[17]  Di Deng,et al.  Constrained Heterogeneous Vehicle Path Planning for Large-area Coverage , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Roland Siegwart,et al.  Structural inspection path planning via iterative viewpoint resampling with application to aerial robotics , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[19]  Wei Jing,et al.  Coverage Path Planning using Path Primitive Sampling and Primitive Coverage Graph for Visual Inspection , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  B. Faverjon,et al.  Probabilistic Roadmaps for Path Planning in High-Dimensional Con(cid:12)guration Spaces , 1996 .

[21]  Shengyong Chen,et al.  Active vision in robotic systems: A survey of recent developments , 2011, Int. J. Robotics Res..

[22]  G. Laporte.  The traveling salesman problem: An overview of exact and approximate algorithms , 1992 .

[23]  Yahya Zweiri,et al.  A survey on multi-robot coverage path planning for model reconstruction and mapping , 2019, SN Applied Sciences.

[24]  Jamal Arkat,et al.  Complete Coverage Path Planning for a Multi-UAV Response System in Post-Earthquake Assessment , 2016, Robotics.

[25]  Olivier Simonin,et al.  Multi-UAV Visual Coverage of Partially Known 3D Surfaces: Voronoi-based Initialization to Improve Local Optimizers , 2019, ArXiv.

[26]  William R. Scott,et al.  Model-based view planning , 2007, Machine Vision and Applications.

[27]  Mauricio G. C. Resende,et al.  Biased random-key genetic algorithms for combinatorial optimization , 2011, J. Heuristics.

[28]  Marc Parizeau,et al.  DEAP: evolutionary algorithms made easy , 2012, J. Mach. Learn. Res..

[29]  William J. Cook,et al.  Solution of a Large-Scale Traveling-Salesman Problem , 1954, 50 Years of Integer Programming.

[30]  G. Croes.  A Method for Solving Traveling-Salesman Problems , 1958 .

[31]  Dimitri N. Mavris,et al.  Energy-Constrained Multi-UAV Coverage Path Planning for an Aerial Imagery Mission Using Column Generation , 2019, Journal of Intelligent & Robotic Systems.

[32]  Wei Lin,et al.  Sampling-based view planning for 3D visual coverage task with Unmanned Aerial Vehicle , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[33]  Hyoung Il Son,et al.  A Voronoi Diagram-Based Workspace Partition for Weak Cooperation of Multi-Robot System in Orchard , 2020, IEEE Access.

[34]  Wolfram Burgard,et al.  OctoMap: an efficient probabilistic 3D mapping framework based on octrees , 2013, Autonomous Robots.

[35]  Alan Kuntz,et al.  Toward Asymptotically-Optimal Inspection Planning via Efficient Near-Optimal Graph Search , 2019, Robotics: Science and Systems.

[36]  Glenn H. Tarbox,et al.  Planning for Complete Sensor Coverage in Inspection , 1995, Comput. Vis. Image Underst..

[37]  Marc Carreras,et al.  A survey on coverage path planning for robotics , 2013, Robotics Auton. Syst..

[38]  Franz S. Hover,et al.  Three-dimensional coverage planning for an underwater inspection robot , 2013, Int. J. Robotics Res..