Long‐term Mapping Techniques for Ship Hull Inspection and Surveillance using an Autonomous Underwater Vehicle

This paper reports on a system for an autonomous underwater vehicle to perform in situ, multiple session hull inspection using long-term simultaneous localization and mapping SLAM. Our method assumes very little a priori knowledge, and it does not require the aid of acoustic beacons for navigation, which is a typical mode of navigation in this type of application. Our system combines recent techniques in underwater saliency-informed visual SLAM and a method for representing the ship hull surface as a collection of many locally planar surface features. This methodology produces accurate maps that can be constructed in real-time on consumer-grade computing hardware. A single-session SLAM result is initially used as a prior map for later sessions, where the robot automatically merges the multiple surveys into a common hull-relative reference frame. To perform the relocalization step, we use a particle filter that leverages the locally planar representation of the ship hull surface, and a fast visual descriptor matching algorithm. Finally, we apply the recently developed graph sparsification tool, generic linear constraints, as a way to manage the computational complexity of the SLAM system as the robot accumulates information across multiple sessions. We show results for 20 SLAM sessions for two large vessels over the course of days, months, and even up to three years, with a total path length of approximately 10.2 km.

[1]  Michael Bosse,et al.  Simultaneous Localization and Map Building in Large-Scale Cyclic Environments Using the Atlas Framework , 2004, Int. J. Robotics Res..

[2]  John J. Leonard,et al.  A Computationally Efficient Method for Large-Scale Concurrent Mapping and Localization , 2000 .

[3]  Frank Dellaert,et al.  iSAM: Incremental Smoothing and Mapping , 2008, IEEE Transactions on Robotics.

[4]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.

[5]  Roland Siegwart,et al.  3D SLAM using planar segments , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Niko Sünderhauf,et al.  Switchable constraints for robust pose graph SLAM , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Ryan M. Eustice,et al.  Multi-view registration for feature-poor underwater imagery , 2011, 2011 IEEE International Conference on Robotics and Automation.

[8]  Frank Dellaert,et al.  Tectonic SAM: Exact, Out-of-Core, Submap-Based SLAM , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[9]  O. Pizarro,et al.  Large Area 3-D Reconstructions From Underwater Optical Surveys , 2009, IEEE Journal of Oceanic Engineering.

[10]  Paul Ozog,et al.  Real-time SLAM with piecewise-planar surface models and sparse 3D point clouds , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Franz S. Hover,et al.  A Vehicle System for Autonomous Relative Survey of In-Water Ships , 2007 .

[12]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[13]  Pere Ridao,et al.  Visual inspection of hydroelectric dams using an autonomous underwater vehicle , 2010, J. Field Robotics.

[14]  Gordon Wyeth,et al.  OpenFABMAP: An open source toolbox for appearance-based loop closure detection , 2012, 2012 IEEE International Conference on Robotics and Automation.

[15]  Michael Bosse,et al.  Map Matching and Data Association for Large-Scale Two-dimensional Laser Scan-based SLAM , 2008, Int. J. Robotics Res..

[16]  Paul Ozog,et al.  Toward long-term, automated ship hull inspection with visual SLAM, explicit surface optimization, and generic graph-sparsification , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[17]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[18]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[19]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[20]  Frank Dellaert,et al.  Square Root SAM: Simultaneous Localization and Mapping via Square Root Information Smoothing , 2006, Int. J. Robotics Res..

[21]  C. Roman,et al.  Imaging Coral I: Imaging Coral Habitats with the SeaBED AUV , 2004 .

[22]  Franz S. Hover,et al.  Advanced perception, navigation and planning for autonomous in-water ship hull inspection , 2012, Int. J. Robotics Res..

[23]  Wolfram Burgard,et al.  Robust map optimization using dynamic covariance scaling , 2013, 2013 IEEE International Conference on Robotics and Automation.

[24]  Wolfram Burgard,et al.  A Tree Parameterization for Efficiently Computing Maximum Likelihood Maps using Gradient Descent , 2007, Robotics: Science and Systems.

[25]  Paul Newman,et al.  FAB-MAP: Probabilistic Localization and Mapping in the Space of Appearance , 2008, Int. J. Robotics Res..

[26]  Luke Fletcher,et al.  Multiple relative pose graphs for robust cooperative mapping , 2010, 2010 IEEE International Conference on Robotics and Automation.

[27]  Luis Volnei Sudati Sagrilo,et al.  On the reliability of an automated ultrasonic system for hull inspection in ship-based oil production units , 2003 .

[28]  Cyrill Stachniss,et al.  Information-theoretic compression of pose graphs for laser-based SLAM , 2012, Int. J. Robotics Res..

[29]  Kurt Konolige,et al.  Towards lifelong visual maps , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[30]  Hanumant Singh,et al.  Improved vehicle based multibeam bathymetry using sub-maps and SLAM , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  P. Firoozfam,et al.  An ROV Stereovision System for Ship-Hull Inspection , 2006, IEEE Journal of Oceanic Engineering.

[32]  Francisco Bonnín-Pascual,et al.  Detection of Cracks and Corrosion for Automated Vessels Visual Inspection , 2010, CCIA.

[33]  Mario E. Munich,et al.  Monocular graph SLAM with complexity reduction , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[34]  Henrik I. Christensen,et al.  Planar surface SLAM with 3D and 2D sensors , 2012, 2012 IEEE International Conference on Robotics and Automation.

[35]  Franz S. Hover,et al.  Mapping 3D Underwater Environments with Smoothed Submaps , 2013, FSR.

[36]  M. Shibata,et al.  Ship hull inspection using a small underwater robot with a mechanical contact mechanism , 2012, 2012 Oceans - Yeosu.

[37]  L.L. Menegaldo,et al.  SIRUS: A mobile robot for Floating Production Storage and Offloading (FPSO) ship hull inspection , 2008, 2008 10th IEEE International Workshop on Advanced Motion Control.

[38]  Ryan M. Eustice,et al.  Pose-graph visual SLAM with geometric model selection for autonomous underwater ship hull inspection , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[39]  Randall Smith,et al.  Estimating Uncertain Spatial Relationships in Robotics , 1987, Autonomous Robot Vehicles.

[40]  Oystein Engelhardtsen,et al.  HUGIN 1000 Arctic Class AUV , 2011 .

[41]  Franz S. Hover,et al.  Imaging sonar-aided navigation for autonomous underwater harbor surveillance , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[42]  P. H. Milne,et al.  Underwater Acoustic Positioning Systems , 1983 .

[43]  Ryan M. Eustice,et al.  Real-Time Visual SLAM for Autonomous Underwater Hull Inspection Using Visual Saliency , 2013, IEEE Transactions on Robotics.

[44]  Wolfram Burgard,et al.  G2o: A general framework for graph optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[45]  Ryan M. Eustice,et al.  Conservative edge sparsification for graph SLAM node removal , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[46]  Frank Dellaert,et al.  Covariance recovery from a square root information matrix for data association , 2009, Robotics Auton. Syst..

[47]  Juan D. Tardós,et al.  Data association in stochastic mapping using the joint compatibility test , 2001, IEEE Trans. Robotics Autom..

[48]  Simon J. Julier,et al.  The scaled unscented transformation , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[49]  Ryan M. Eustice,et al.  Long-term simultaneous localization and mapping with generic linear constraint node removal , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[50]  Chris Murphy,et al.  Toward extraplanetary under‐ice exploration: Robotic steps in the Arctic , 2009, J. Field Robotics.

[51]  S. E. Harris,et al.  Lamp Ray: ship hull assessment for value, safety and readiness , 1999, Oceans '99. MTS/IEEE. Riding the Crest into the 21st Century. Conference and Exhibition. Conference Proceedings (IEEE Cat. No.99CH37008).

[52]  E. O. Belcher,et al.  Ship berthing and hull inspection using the CetusII AUV and MIRIS high-resolution sonar , 2002, OCEANS '02 MTS/IEEE.

[53]  Sebastian Thrun,et al.  The Graph SLAM Algorithm with Applications to Large-Scale Mapping of Urban Structures , 2006, Int. J. Robotics Res..

[54]  E. O. Belcher,et al.  Object identification with acoustic lenses , 2001, MTS/IEEE Oceans 2001. An Ocean Odyssey. Conference Proceedings (IEEE Cat. No.01CH37295).

[55]  Ryan M. Eustice,et al.  Generic factor-based node marginalization and edge sparsification for pose-graph SLAM , 2013, 2013 IEEE International Conference on Robotics and Automation.

[56]  Franz S. Hover,et al.  SLAM for ship hull inspection using exactly sparse extended information filters , 2008, 2008 IEEE International Conference on Robotics and Automation.

[57]  O. Pizarro,et al.  Visually Augmented Navigation for Autonomous Underwater Vehicles , 2008, IEEE Journal of Oceanic Engineering.

[58]  Luciano Luporini Menegaldo,et al.  Development and Navigation of a Mobile Robot for Floating Production Storage and Offloading Ship Hull Inspection , 2009, IEEE Transactions on Industrial Electronics.

[59]  Paul Ozog,et al.  On the importance of modeling camera calibration uncertainty in visual SLAM , 2013, 2013 IEEE International Conference on Robotics and Automation.

[60]  Dana R. Yoerger,et al.  Field trials of the Nereus hybrid underwater robotic vehicle in the challenger deep of the Mariana Trench , 2009, OCEANS 2009.

[61]  Frank Dellaert,et al.  Incremental smoothing and mapping , 2008 .