Semantics-aware Exploration and Inspection Path Planning

This paper contributes a novel strategy for semantics-aware autonomous exploration and inspection path planning. Attuned to the fact that environments that need to be explored often involve a sparse set of semantic entities of particular interest, the proposed method offers volumetric exploration combined with two new planning behaviors that together ensure that a complete mesh model is reconstructed for each semantic, while its surfaces are observed at appropriate resolution and through suitable viewing angles. Evaluated in extensive simulation studies and experimental results using a flying robot, the planner delivers efficient combined exploration and high-fidelity inspection planning that is focused on the semantics of interest. Comparisons against relevant methods of the state-of-the-art are further presented.

[1]  Paolo De Petris,et al.  Team CERBERUS Wins the DARPA Subterranean Challenge: Technical Overview and Lessons Learned , 2022, Field Robotics.

[2]  Geoffrey A. Hollinger,et al.  Resilient Multi-Sensor Exploration of Multifarious Environments with a Team of Aerial Robots , 2022, Robotics: Science and Systems.

[3]  R. Siegwart,et al.  CERBERUS in the DARPA Subterranean Challenge , 2022, Science Robotics.

[4]  Paolo De Petris,et al.  RMF-Owl: A Collision-Tolerant Flying Robot for Autonomous Subterranean Exploration , 2022, 2022 International Conference on Unmanned Aircraft Systems (ICUAS).

[5]  Roland Siegwart,et al.  CERBERUS: Autonomous Legged and Aerial Robotic Exploration in the Tunnel and Urban Circuits of the DARPA Subterranean Challenge , 2022, Field Robotics.

[6]  Paolo De Petris,et al.  Autonomous Teamed Exploration of Subterranean Environments using Legged and Aerial Robots , 2021, 2022 International Conference on Robotics and Automation (ICRA).

[7]  Margarita Chli,et al.  Semantic-aware Active Perception for UAVs using Deep Reinforcement Learning , 2021, 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[8]  Juan I. Nieto,et al.  Panoptic Multi-TSDFs: a Flexible Representation for Online Multi-resolution Volumetric Mapping and Long-term Dynamic Scene Consistency , 2021, 2022 International Conference on Robotics and Automation (ICRA).

[9]  Francesco Riccio,et al.  S-AvE: Semantic Active Vision Exploration and Mapping of Indoor Environments for Mobile Robots , 2021, 2021 European Conference on Mobile Robots (ECMR).

[10]  Howie Choset,et al.  TARE: A Hierarchical Framework for Efficiently Exploring Complex 3D Environments , 2021, Robotics: Science and Systems.

[11]  Katrina Lo Surdo,et al.  Heterogeneous Ground and Air Platforms, Homogeneous Sensing: Team CSIRO Data61's Approach to the DARPA Subterranean Challenge , 2021, Field Robotics.

[12]  Jay L. Gao,et al.  NeBula: Quest for Robotic Autonomy in Challenging Environments; TEAM CoSTAR at the DARPA Subterranean Challenge , 2021, ArXiv.

[13]  Kostas Alexis,et al.  Graph‐based subterranean exploration path planning using aerial and legged robots , 2020, J. Field Robotics.

[14]  John Carter,et al.  Semantic Trajectory Planning for Long-Distant Unmanned Aerial Vehicle Navigation in Urban Environments , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  Margarita Chli,et al.  Perception-aware Path Planning for UAVs using Semantic Segmentation , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[16]  Kostas Alexis,et al.  Complementary Multi–Modal Sensor Fusion for Resilient Robot Pose Estimation in Subterranean Environments , 2020, 2020 International Conference on Unmanned Aircraft Systems (ICUAS).

[17]  A. Markham,et al.  RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Clouds , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Martin Saska,et al.  DARPA Subterranean Challenge: Multi-robotic Exploration of Underground Environments , 2019, MESAS.

[19]  Friedrich Fraundorfer,et al.  Automatic and Semantically-Aware 3D UAV Flight Planning for Image-Based 3D Reconstruction , 2019, Remote. Sens..

[20]  He Zhang,et al.  Digital Twin in Industry: State-of-the-Art , 2019, IEEE Transactions on Industrial Informatics.

[21]  Roland Siegwart,et al.  Volumetric Instance-Aware Semantic Mapping and 3D Object Discovery , 2019, IEEE Robotics and Automation Letters.

[22]  Stefan Leutenegger,et al.  Fusion++: Volumetric Object-Level SLAM , 2018, 2018 International Conference on 3D Vision (3DV).

[23]  Christos Papachristos,et al.  Autonomous exploration and simultaneous object search using aerial robots , 2018, 2018 IEEE Aerospace Conference.

[24]  Roland Siegwart,et al.  Receding horizon path planning for 3D exploration and surface inspection , 2018, Auton. Robots.

[25]  José García Rodríguez,et al.  A Review on Deep Learning Techniques Applied to Semantic Segmentation , 2017, ArXiv.

[26]  Roland Siegwart,et al.  Voxblox: Incremental 3D Euclidean Signed Distance Fields for on-board MAV planning , 2016, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[27]  Roland Siegwart,et al.  Three-dimensional coverage path planning via viewpoint resampling and tour optimization for aerial robots , 2015, Autonomous Robots.

[28]  Roland Siegwart,et al.  Receding Horizon "Next-Best-View" Planner for 3D Exploration , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[29]  Roland Siegwart,et al.  An incremental sampling-based approach to inspection planning: the rapidly exploring random tree of trees , 2016, Robotica.

[30]  Hong Guan,et al.  Towards UAV-based bridge inspection systems: a review and an application perspective , 2015 .

[31]  Roland Siegwart,et al.  Structural inspection path planning via iterative viewpoint resampling with application to aerial robotics , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[32]  Mac Schwager,et al.  Decentralized path planning for coverage tasks using gradient descent adaptive control , 2014, Int. J. Robotics Res..

[33]  Marc Carreras,et al.  A survey on coverage path planning for robotics , 2013, Robotics Auton. Syst..

[34]  Wolfram Burgard,et al.  OctoMap: an efficient probabilistic 3D mapping framework based on octrees , 2013, Autonomous Robots.

[35]  Franz S. Hover,et al.  Advanced perception, navigation and planning for autonomous in-water ship hull inspection , 2012, Int. J. Robotics Res..

[36]  Geoffrey A. Hollinger,et al.  Uncertainty-driven view planning for underwater inspection , 2012, 2012 IEEE International Conference on Robotics and Automation.

[37]  Roland Siegwart,et al.  Highly compact robots for inspection of power plants , 2010, 2010 1st International Conference on Applied Robotics for the Power Industry.

[38]  David Cohen-Steiner,et al.  A greedy Delaunay-based surface reconstruction algorithm , 2004, The Visual Computer.

[39]  Keld Helsgaun,et al.  An effective implementation of the Lin-Kernighan traveling salesman heuristic , 2000, Eur. J. Oper. Res..

[40]  Brian Yamauchi,et al.  A frontier-based approach for autonomous exploration , 1997, Proceedings 1997 IEEE International Symposium on Computational Intelligence in Robotics and Automation CIRA'97. 'Towards New Computational Principles for Robotics and Automation'.

[41]  J. Marzat,et al.  Path Planning Incorporating Semantic Information for Autonomous Robot Navigation , 2022, International Conference on Informatics in Control, Automation and Robotics.

[42]  Geoffrey A. Hollinger,et al.  Resilient and Modular Subterranean Exploration with a Team of Roving and Flying Robots , 2022 .

[43]  Sendai,et al.  2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , 2020 .

[44]  Marco Hutter,et al.  ANYmal in the Field: Solving Industrial Inspection of an Offshore HVDC Platform with a Quadrupedal Robot , 2019, FSR.

[45]  Peter I. Corke,et al.  Vertical Infrastructure Inspection Using a Quadcopter and Shared Autonomy Control , 2012, FSR.

[46]  Howie Choset,et al.  Coverage Path Planning: The Boustrophedon Cellular Decomposition , 1998 .