Identifying structural anomalies in image reconstructions of underwater ship hulls

This paper reports on an algorithm enabling an autonomous underwater vehicle (AUV) to localize into a 3D computer aided design (CAD) model of a ship hull in situ using an optical camera and Doppler velocity log (DVL). The precision of our localization algorithm allows the identification of structural deviations between 3D structure inferred from bundle-adjusted camera imagery and the CAD model. These structural deviations are clustered into shapes, which allow us to fuse camera-derived structure into a CAD-derived 3D mesh. This augmented CAD model can be used within a 3D photomosaicing pipeline, providing a visually intuitive 3D reconstruction of the ship hull. We evaluate our algorithm on the Bluefin Robotics Hovering Autonomous Underwater Vehicle (HAUV) surveying the SS Curtiss, and provide a 3D reconstruction that fuses the CAD mesh with 3D information corresponding to underwater structure, such as biofouling.

[1]  Frank Dellaert,et al.  Square Root SAM: Simultaneous Localization and Mapping via Square Root Information Smoothing , 2006, Int. J. Robotics Res..

[2]  Paul Ozog,et al.  Building 3D mosaics from an Autonomous Underwater Vehicle, Doppler velocity log, and 2D imaging sonar , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[4]  Giulio Sandini,et al.  Extraction of 3-D Information and Volumetric Uncertainty from Multiple Stereo Images , 1988, ECAI.

[5]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[6]  E. O. Belcher,et al.  Object identification with acoustic lenses , 2001, MTS/IEEE Oceans 2001. An Ocean Odyssey. Conference Proceedings (IEEE Cat. No.01CH37295).

[7]  Antoni Burguera,et al.  Imaging Systems for Advanced Underwater Vehicles , 2011 .

[8]  Paul Ozog,et al.  Long‐term Mapping Techniques for Ship Hull Inspection and Surveillance using an Autonomous Underwater Vehicle , 2016, J. Field Robotics.

[9]  Randall Smith,et al.  Estimating Uncertain Spatial Relationships in Robotics , 1987, Autonomous Robot Vehicles.

[10]  Franz S. Hover,et al.  A Vehicle System for Autonomous Relative Survey of In-Water Ships , 2007 .

[11]  Ryan M. Eustice,et al.  Real-Time Visual SLAM for Autonomous Underwater Hull Inspection Using Visual Saliency , 2013, IEEE Transactions on Robotics.

[12]  Pere Ridao,et al.  Visual inspection of hydroelectric dams using an autonomous underwater vehicle , 2010, J. Field Robotics.

[13]  Gérard G. Medioni,et al.  Object modelling by registration of multiple range images , 1992, Image Vis. Comput..

[14]  P. Firoozfam,et al.  An ROV Stereovision System for Ship-Hull Inspection , 2006, IEEE Journal of Oceanic Engineering.

[15]  Francisco Bonnín-Pascual,et al.  Detection of Cracks and Corrosion for Automated Vessels Visual Inspection , 2010, CCIA.

[16]  Gérard G. Medioni,et al.  Object modeling by registration of multiple range images , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[17]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[18]  N. A. Brokloff,et al.  Matrix algorithm for Doppler sonar navigation , 1994, Proceedings of OCEANS'94.

[19]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[20]  Stefan B. Williams,et al.  Generation and visualization of large‐scale three‐dimensional reconstructions from underwater robotic surveys , 2010, J. Field Robotics.

[21]  William J. Schroeder,et al.  The Visualization Toolkit , 2005, The Visualization Handbook.

[22]  E. O. Belcher,et al.  Ship berthing and hull inspection using the CetusII AUV and MIRIS high-resolution sonar , 2002, OCEANS '02 MTS/IEEE.

[23]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[24]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.

[25]  John J. Leonard,et al.  Kintinuous: Spatially Extended KinectFusion , 2012, AAAI 2012.

[26]  Mariette Yvinec,et al.  A surface reconstruction method for in-detail underwater 3D optical mapping , 2015, Int. J. Robotics Res..