Coverage Path Planning with Real‐time Replanning and Surface Reconstruction for Inspection of Three‐dimensional Underwater Structures using Autonomous Underwater Vehicles

We present a novel method for planning coverage paths for inspecting complex structures on the ocean floor using an autonomous underwater vehicle AUV. Our method initially uses a 2.5-dimensional 2.5D prior bathymetric map to plan a nominal coverage path that allows the AUV to pass its sensors over all points on the target area. The nominal path uses a standard mowing-the-lawn pattern in effectively planar regions, while in regions with substantial 3D relief it follows horizontal contours of the terrain at a given offset distance. We then go beyond previous approaches in the literature by considering the vehicle's state uncertainty rather than relying on the unrealistic assumption of an idealized path execution. Toward that end, we present a replanning algorithm based on a stochastic trajectory optimization that reshapes the nominal path to cope with the actual target structure perceived in situ. The replanning algorithm runs onboard the AUV in real time during the inspection mission, adapting the path according to the measurements provided by the vehicle's range-sensing sonars. Furthermore, we propose a pipeline of state-of-the-art surface reconstruction techniques we apply to the data acquired by the AUV to obtain 3D models of the inspected structures that show the benefits of our planning method for 3D mapping. We demonstrate the efficacy of our method in experiments at sea using the GIRONA 500 AUV, where we cover part of a breakwater structure in a harbor and an underwater boulder rising from 40i¾?m up to 27i¾?m depth.

[1]  Howie Choset,et al.  Exploiting critical points to reduce positioning error for sensor-based navigation , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[2]  Geoffrey A. Hollinger,et al.  Sampling-based robotic information gathering algorithms , 2014, Int. J. Robotics Res..

[3]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[4]  Vijay Kumar,et al.  Time-optimal UAV trajectory planning for 3D urban structure coverage , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Ryan M. Eustice,et al.  Perception-driven navigation: Active visual SLAM for robotic area coverage , 2013, 2013 IEEE International Conference on Robotics and Automation.

[6]  Antonio Barrientos,et al.  Aerial remote sensing in agriculture: A practical approach to area coverage and path planning for fleets of mini aerial robots , 2011, J. Field Robotics.

[7]  Howie Choset,et al.  Path Planning for Robotic Demining: Robust Sensor-Based Coverage of Unstructured Environments and Probabilistic Methods , 2003, Int. J. Robotics Res..

[8]  Sylvia C. Wong,et al.  Qualitative Topological Coverage of Unknown Environments by Mobile Robots , 2006 .

[9]  Wolfram Burgard,et al.  Coastal navigation-mobile robot navigation with uncertainty in dynamic environments , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[10]  Geoffrey A. Hollinger,et al.  Active planning for underwater inspection and the benefit of adaptivity , 2012, Int. J. Robotics Res..

[11]  J. R. Stack,et al.  Combining random and data-driven coverage planning for underwater mine detection , 2003, Oceans 2003. Celebrating the Past ... Teaming Toward the Future (IEEE Cat. No.03CH37492).

[12]  Timothy Bretl,et al.  Probably approximately correct coverage for robots with uncertainty , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Wolfram Burgard,et al.  Active mobile robot localization by entropy minimization , 1997, Proceedings Second EUROMICRO Workshop on Advanced Mobile Robots.

[14]  Stefan Schaal,et al.  STOMP: Stochastic trajectory optimization for motion planning , 2011, 2011 IEEE International Conference on Robotics and Automation.

[15]  Liam Paull,et al.  Sensor-Driven Online Coverage Planning for Autonomous Underwater Vehicles , 2013 .

[16]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[17]  Stefan B. Williams,et al.  Bathymetric particle filter SLAM using trajectory maps , 2012, Int. J. Robotics Res..

[18]  Howie Choset,et al.  Exact Cellular Decomposition of Closed Orientable Surfaces Embedded in R3. , 2001 .

[19]  Hanumant Singh,et al.  Robotic tools for deep water archaeology: Surveying an ancient shipwreck with an autonomous underwater vehicle , 2010, J. Field Robotics.

[20]  M. Carreras,et al.  Mapping the Moon: Using a lightweight AUV to survey the site of the 17th century ship ‘La Lune’ , 2013, 2013 MTS/IEEE OCEANS - Bergen.

[21]  Howie Choset,et al.  Hierarchical Segmentation of Piecewise Pseudoextruded Surfaces for Uniform Coverage , 2009, IEEE Transactions on Automation Science and Engineering.

[22]  Howie Choset,et al.  Uniform Coverage of Automotive Surface Patches , 2005, Int. J. Robotics Res..

[23]  Wesley H. Huang Optimal line-sweep-based decompositions for coverage algorithms , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[24]  Yasir Latif,et al.  Fast minimum uncertainty search on a graph map representation , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  B. Faverjon,et al.  Probabilistic Roadmaps for Path Planning in High-Dimensional Con(cid:12)guration Spaces , 1996 .

[26]  Seth Hutchinson,et al.  Minimum uncertainty robot path planning using a POMDP approach , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  A. Ollero,et al.  Multiple UAV cooperative searching operation using polygon area decomposition and efficient coverage algorithms , 2004, DARS.

[28]  Leonidas J. Guibas,et al.  Bounded Uncertainty Roadmaps for Path Planning , 2008, WAFR.

[29]  Pere Ridao,et al.  Kornati bathymetry survey data-set for navigation and mapping , 2011, 2011 19th Mediterranean Conference on Control & Automation (MED).

[30]  Timothy Bretl,et al.  Robust coverage by a mobile robot of a planar workspace , 2013, 2013 IEEE International Conference on Robotics and Automation.

[31]  Jaime Valls Miró,et al.  Active Pose SLAM , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[32]  Howie Choset,et al.  Coverage of Known Spaces: The Boustrophedon Cellular Decomposition , 2000, Auton. Robots.

[33]  R. McEwen,et al.  Low-cost terrain relative navigation for long-range AUVs , 2008, OCEANS 2008.

[34]  N. Roy,et al.  The Belief Roadmap: Efficient Planning in Belief Space by Factoring the Covariance , 2009, Int. J. Robotics Res..

[35]  Florent Lamiraux,et al.  A framework for planning motions in stochastic maps , 2008, 2008 10th International Conference on Control, Automation, Robotics and Vision.

[36]  Karl Iagnemma,et al.  Stochastic mobility-based path planning in uncertain environments , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[37]  Anthony Stentz,et al.  Using linear landmarks for path planning with uncertainty in outdoor environments , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[38]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[39]  Steve Oudot,et al.  Provably good sampling and meshing of surfaces , 2005, Graph. Model..

[40]  P. Abbeel,et al.  LQG-MP: Optimized path planning for robots with motion uncertainty and imperfect state information , 2011 .

[41]  Liam Paull,et al.  Area coverage planning that accounts for pose uncertainty with an AUV seabed surveying application , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[42]  Howie Choset,et al.  Sensor-based coverage with extended range detectors , 2006, IEEE Transactions on Robotics.

[43]  Stefan B. Williams,et al.  Simultaneous Localisation and Mapping and Dense Stereoscopic Seafloor Reconstruction Using an AUV , 2008, ISER.

[44]  Marc Carreras,et al.  Girona 500 AUV: From Survey to Intervention , 2012, IEEE/ASME Transactions on Mechatronics.

[45]  David S. Wettergreen,et al.  Active localization on the ocean floor with multibeam sonar , 2008, OCEANS 2008.

[46]  P. Ridao,et al.  COLA2: A Control Architecture for AUVs , 2012, IEEE Journal of Oceanic Engineering.

[47]  Dana R. Yoerger,et al.  Autonomous underwater vehicle maps seafloor , 1997 .

[48]  Arto Visala,et al.  Coverage path planning algorithms for agricultural field machines , 2009 .

[49]  Oliver Brock,et al.  Sampling-Based Motion Planning Using Uncertain Knowledge , 2006 .

[50]  Shahriar Negahdaripour,et al.  Efficient three‐dimensional scene modeling and mosaicing , 2009, J. Field Robotics.

[51]  Lydia E. Kavraki,et al.  Probabilistic roadmaps for path planning in high-dimensional configuration spaces , 1996, IEEE Trans. Robotics Autom..

[52]  Ralph L. Hollis,et al.  Contact sensor-based coverage of rectilinear environments , 1999, Proceedings of the 1999 IEEE International Symposium on Intelligent Control Intelligent Systems and Semiotics (Cat. No.99CH37014).

[53]  Masahiro Ono,et al.  Chance-Constrained Optimal Path Planning With Obstacles , 2011, IEEE Transactions on Robotics.

[54]  Ron Alterovitz,et al.  Motion planning under uncertainty using iterative local optimization in belief space , 2012, Int. J. Robotics Res..

[55]  Pere Ridao,et al.  Uncertainty-driven survey path planning for bathymetric mapping , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[56]  Hans-Peter Seidel,et al.  An efficient construction of reduced deformable objects , 2013, ACM Trans. Graph..

[57]  B. Shirinzadeh,et al.  Optimal area covering using genetic algorithms , 2007, 2007 IEEE/ASME international conference on advanced intelligent mechatronics.

[58]  Vincent Dupourqué,et al.  A robot operating system , 1984, ICRA.

[59]  Nicholas Roy,et al.  Adapting probabilistic roadmaps to handle uncertain maps , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[60]  Howie Choset,et al.  Morse Decompositions for Coverage Tasks , 2002, Int. J. Robotics Res..

[61]  Elon Rimon,et al.  Spiral-STC: an on-line coverage algorithm of grid environments by a mobile robot , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[62]  Nicholas M. Patrikalakis,et al.  Asymptotically optimal inspection planning using systems with differential constraints , 2013, 2013 IEEE International Conference on Robotics and Automation.

[63]  Alain Lambert,et al.  Safe Path Planning in an Uncertain-Configuration Space using RRT , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[64]  David Hsu,et al.  Integrated Perception and Planning in the Continuous Space: A POMDP Approach , 2013, Robotics: Science and Systems.

[65]  Nadine Le Fort-Piat,et al.  Safe Task Planning Integrating Uncertainties and Local Maps Federations , 2000, Int. J. Robotics Res..

[66]  Ioannis M. Rekleitis,et al.  Optimal coverage of a known arbitrary environment , 2010, 2010 IEEE International Conference on Robotics and Automation.

[67]  Leslie Pack Kaelbling,et al.  Belief space planning assuming maximum likelihood observations , 2010, Robotics: Science and Systems.

[68]  Howie Choset,et al.  Sensor-based Coverage of Unknown Environments: Incremental Construction of Morse Decompositions , 2002, Int. J. Robotics Res..

[69]  Beom Hee Lee,et al.  3-D terrain covering and map building algorithm for an AUV , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[70]  Michael M. Kazhdan,et al.  Screened poisson surface reconstruction , 2013, TOGS.

[71]  Steven M. LaValle,et al.  Rapidly-Exploring Random Trees: Progress and Prospects , 2000 .

[72]  Stefan B. Williams,et al.  Generation and visualization of large‐scale three‐dimensional reconstructions from underwater robotic surveys , 2010, J. Field Robotics.

[73]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[74]  Marc Carreras,et al.  A survey on coverage path planning for robotics , 2013, Robotics Auton. Syst..

[75]  Franz S. Hover,et al.  Three-dimensional coverage planning for an underwater inspection robot , 2013, Int. J. Robotics Res..

[76]  Vijay Kumar,et al.  An Optimization-based Approach to Time Critical Cooperative Surveillance and Coverage with Unmanned Aerial Vehicles , 2006 .

[77]  Marc Carreras,et al.  Planning coverage paths on bathymetric maps for in-detail inspection of the ocean floor , 2013, 2013 IEEE International Conference on Robotics and Automation.

[78]  Geoffrey A. Hollinger,et al.  Active and Adaptive Dive Planning for Dense Bathymetric Mapping , 2012, ISER.

[79]  David Hsu,et al.  SARSOP: Efficient Point-Based POMDP Planning by Approximating Optimally Reachable Belief Spaces , 2008, Robotics: Science and Systems.

[80]  Howie Choset,et al.  Leap-Frog Path Design for Multi-Robot Cooperative Localization , 2009, FSR.

[81]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[82]  Michael Bosse,et al.  Coverage Algorithms for an Under-actuated Car-Like Vehicle in an Uncertain Environment , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[83]  Han-Pang Huang,et al.  Robot Motion Planning in Dynamic Uncertain Environments , 2011, Adv. Robotics.

[84]  Ioannis M. Rekleitis,et al.  Optimal complete terrain coverage using an Unmanned Aerial Vehicle , 2011, 2011 IEEE International Conference on Robotics and Automation.

[85]  Kamal K. Gupta,et al.  RRT-SLAM for motion planning with motion and map uncertainty for robot exploration , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[86]  Reid G. Simmons,et al.  Particle RRT for Path Planning with Uncertainty , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[87]  Ruigang Yang,et al.  Multi-resolution real-time stereo on commodity graphics hardware , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[88]  Dana R. Yoerger,et al.  Fine-Scale Three-Dimensional Mapping of a Deep-Sea Hydrothermal Vent Site Using the Jason ROV System , 2000, Int. J. Robotics Res..

[89]  Charlie C. L. Wang,et al.  Fast Intersection-Free Offset Surface Generation From Freeform Models With Triangular Meshes , 2011, IEEE Transactions on Automation Science and Engineering.

[90]  Vijay Kumar,et al.  An Optimization-Based Approach to Time-Critical Cooperative Surveillance and Coverage with UAVs , 2006, ISER.

[91]  J. Escartín,et al.  Globally aligned photomosaic of the Lucky Strike hydrothermal vent field (Mid‐Atlantic Ridge, 37°18.5′N): Release of georeferenced data, mosaic construction, and viewing software , 2008 .

[92]  Chaomin Luo,et al.  A Bioinspired Neural Network for Real-Time Concurrent Map Building and Complete Coverage Robot Navigation in Unknown Environments , 2008, IEEE Transactions on Neural Networks.

[93]  Wolfram Burgard,et al.  OctoMap: an efficient probabilistic 3D mapping framework based on octrees , 2013, Autonomous Robots.

[94]  Thierry Siméon,et al.  The Stochastic Motion Roadmap: A Sampling Framework for Planning with Markov Motion Uncertainty , 2007, Robotics: Science and Systems.

[95]  Pere Ridao,et al.  Coverage path planning with realtime replanning for inspection of 3D underwater structures , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[96]  Vladimir J. Lumelsky,et al.  A terrain-covering algorithm for an AUV , 1996, Auton. Robots.

[97]  Marc Carreras,et al.  Efficient seabed coverage path planning for ASVs and AUVs , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[98]  Ryan M. Eustice,et al.  Opportunistic sampling-based planning for active visual SLAM , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.