Multiobjective coverage path planning: Enabling automated inspection of complex, real-world structures

Abstract An important open problem in robotic planning is the autonomous generation of 3D inspection paths – that is, planning the best path to move a robot along in order to inspect a target structure. We recently suggested a new method for planning paths allowing the inspection of complex 3D structures, given a triangular mesh model of the structure. The method differs from previous approaches in its emphasis on generating and considering also plans that result in imperfect coverage of the inspection target. In many practical tasks, one would accept imperfections in coverage if this results in a substantially more energy efficient inspection path. The key idea is using a multiobjective evolutionary algorithm to optimize the energy usage and coverage of inspection plans simultaneously – and the result is a set of plans exploring the different ways to balance the two objectives. We here test our method on a set of inspection targets with large variation in size and complexity, and compare its performance with two state-of-the-art methods for complete coverage path planning. The results strengthen our confidence in the ability of our method to generate good inspection plans for different types of targets. The method's advantage is most clearly seen for real-world inspection targets, since traditional complete coverage methods have no good way of generating plans for structures with hidden parts. Multiobjective evolution, by optimizing energy usage and coverage together, ensures a good balance between the two – both when 100% coverage is feasible, and when large parts of the object are hidden.

[1]  Anne Auger,et al.  Theory of the hypervolume indicator: optimal μ-distributions and the choice of the reference point , 2009, FOGA '09.

[2]  Dan McLeod,et al.  Autonomous UUV inspection — Revolutionizing undersea inspection , 2011, OCEANS'11 MTS/IEEE KONA.

[3]  Maria Fox,et al.  AUV mission control via temporal planning , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Frank Kirchner,et al.  FlatFish - a compact subsea-resident inspection AUV , 2015, OCEANS 2015 - MTS/IEEE Washington.

[5]  Kalyanmoy Deb,et al.  Multi-Objective Evolutionary Algorithms , 2015, Handbook of Computational Intelligence.

[6]  Joshua D. Knowles,et al.  Memetic Algorithms for Multiobjective Optimization: Issues, Methods and Prospects , 2004 .

[7]  Vijay Kumar,et al.  Time-optimal UAV trajectory planning for 3D urban structure coverage , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Narcís Palomeras,et al.  Coverage Path Planning with Real‐time Replanning and Surface Reconstruction for Inspection of Three‐dimensional Underwater Structures using Autonomous Underwater Vehicles , 2015, J. Field Robotics.

[9]  Franz S. Hover,et al.  Sampling-based sweep planning to exploit local planarity in the inspection of complex 3D structures , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Marc Carreras,et al.  A survey on coverage path planning for robotics , 2013, Robotics Auton. Syst..

[11]  Carlos A. Coello Coello,et al.  Seeding the initial population of a multi-objective evolutionary algorithm using gradient-based information , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[12]  Frank Kirchner,et al.  Self-referenced laser system for optical 3D seafloor mapping , 2016, OCEANS 2016 MTS/IEEE Monterey.

[13]  Herman Augusto Lepikson,et al.  Planning Inspection Paths through Evolutionary Multi-objective Optimization , 2016, GECCO.

[14]  Roland Siegwart,et al.  Structural inspection path planning via iterative viewpoint resampling with application to aerial robotics , 2015, ICRA 2015.

[15]  Franz S. Hover,et al.  Inspection planning for sensor coverage of 3D marine structures , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Franz S. Hover,et al.  Advanced perception, navigation and planning for autonomous in-water ship hull inspection , 2012, Int. J. Robotics Res..

[17]  Ales Zamuda,et al.  Constrained differential evolution optimization for underwater glider path planning in sub-mesoscale eddy sampling , 2016, Appl. Soft Comput..

[18]  Lothar Thiele,et al.  Multiobjective Optimization Using Evolutionary Algorithms - A Comparative Case Study , 1998, PPSN.

[19]  Kalyanmoy Deb,et al.  Three-dimensional offline path planning for UAVs using multiobjective evolutionary algorithms , 2007, 2007 IEEE Congress on Evolutionary Computation.

[20]  Olaf Boebel,et al.  FRAM - FRontiers in Arctic marine Monitoring Visions for permanent observations in a gateway to the Arctic Ocean , 2013, 2013 MTS/IEEE OCEANS - Bergen.

[21]  Jan Albiez,et al.  Fault-tolerant control allocation technique based on explicit optimization applied to an autonomous underwater vehicle , 2016, OCEANS 2016 MTS/IEEE Monterey.

[22]  Franz S. Hover,et al.  Sampling-Based Coverage Path Planning for Inspection of Complex Structures , 2012, ICAPS.

[23]  Franz S. Hover,et al.  Planning Complex Inspection Tasks Using Redundant Roadmaps , 2011, ISRR.

[24]  Brendan Englot,et al.  Sampling-Based Coverage Path Planning for Complex 3D Structures , 2012 .

[25]  Howie Choset,et al.  Exact Cellular Decomposition of Closed Orientable Surfaces Embedded in R3. , 2001 .

[26]  Andrew M. Wallace,et al.  Model-based planning of optimal sensor placements for inspection , 1997, IEEE Trans. Robotics Autom..

[27]  Peter J. Fleming,et al.  On the Performance Assessment and Comparison of Stochastic Multiobjective Optimizers , 1996, PPSN.

[28]  Weihua Sheng,et al.  A Robotic Crack Inspection and Mapping System for Bridge Deck Maintenance , 2014, IEEE Transactions on Automation Science and Engineering.

[29]  Thomas Stützle,et al.  Exploratory Analysis of Stochastic Local Search Algorithms in Biobjective Optimization , 2010, Experimental Methods for the Analysis of Optimization Algorithms.

[30]  Kai Olav Ellefsen Dynamic robot scheduling using a genetic algorithm , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[31]  Geoffrey A. Hollinger,et al.  Uncertainty-driven view planning for underwater inspection , 2012, 2012 IEEE International Conference on Robotics and Automation.

[32]  David M. Lane,et al.  Low-cost energy measurement and estimation for autonomous underwater vehicles , 2014, OCEANS 2014 - TAIPEI.

[33]  Franz-Josef Rammig,et al.  Task Allocation Strategy for Time-Constrained Tasks in Robot Swarms , 2013, ECAL.

[34]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[35]  Kay Chen Tan,et al.  Evolutionary artificial potential fields and their application in real time robot path planning , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[36]  J. Partan,et al.  A long term vision for long-range ship-free deep ocean operations: Persistent presence through coordination of Autonomous Surface Vehicles and Autonomous Underwater Vehicles , 2012, 2012 IEEE/OES Autonomous Underwater Vehicles (AUV).

[37]  Carlos M. Fonseca,et al.  Inferential Performance Assessment of Stochastic Optimisers and the Attainment Function , 2001, EMO.

[38]  Hisao Ishibuchi,et al.  Behavior of Multiobjective Evolutionary Algorithms on Many-Objective Knapsack Problems , 2015, IEEE Transactions on Evolutionary Computation.

[39]  Ales Zamuda,et al.  Differential evolution and underwater glider path planning applied to the short-term opportunistic sampling of dynamic mesoscale ocean structures , 2014, Appl. Soft Comput..

[40]  Stéphane Doncieux,et al.  Encouraging Behavioral Diversity in Evolutionary Robotics: An Empirical Study , 2012, Evolutionary Computation.

[41]  Jianhua Zhang,et al.  Robot path planning in uncertain environment using multi-objective particle swarm optimization , 2013, Neurocomputing.

[42]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[43]  Thomas Bartz-Beielstein,et al.  Experimental Methods for the Analysis of Optimization Algorithms , 2010 .

[44]  Howie Choset,et al.  Exact cellular decomposition of closed orientable surfaces embedded in /spl Rfr//sup 3/ , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[45]  Maria Fox,et al.  Planning inspection tasks for AUVs , 2013, 2013 OCEANS - San Diego.

[46]  Marc Parizeau,et al.  DEAP: evolutionary algorithms made easy , 2012, J. Mach. Learn. Res..

[47]  Y.F. Li,et al.  Automatic sensor placement for model-based robot vision , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[48]  Nicholas M. Patrikalakis,et al.  Asymptotically optimal inspection planning using systems with differential constraints , 2013, 2013 IEEE International Conference on Robotics and Automation.