Vessel Visual Inspection : A Mosaicing Approach

Vessel maintenance entails periodic visual inspections of internal and external parts of the hull in order to detect the typical defective situations affecting metallic structures. Nowadays, robots are becoming more and more important regarding these inspection tasks, since they can collect the requested information and, thus, prevent humans from performing tedious, and even dangerous tasks because of places hard to reach for humans. A Micro Aerial Vehicle (MAV) fitted with vision cameras can be used as part of an automated or semi-automated inspection strategy. The resulting collection of individual images, however, does not permit the surveyor to get a global overview of the state of the surface under inspection, apart from the fact that typically defects appear broken along a number of consecutive images. Image mosaicing can certainly help in this case. To this end, in this paper, we propose a novel image mosaicing approach able to deal with this kind of scenarios. Our solution employs a graph-based registration method from which relevant topological relationships between (overlapping) images are found. This graph is built according to a visual index based on a Bag-of-Words (BoW) scheme making use of binary descriptors for speeding up the image description process. At the end of the paper, we report about the results of a number of experiments that validate our approach, including the outcome of defect detectors working directly over the mosaic.

[1]  Frank Kirchner,et al.  A Robot Application for Marine Vessel Inspection , 2014, J. Field Robotics.

[2]  Armagan Elibol,et al.  A new global alignment approach for underwater optical mapping , 2011 .

[3]  Alexandre Bernardino,et al.  Mosaic-based navigation for autonomous underwater vehicles , 2003 .

[4]  Harpreet S. Sawhney,et al.  Robust Video Mosaicing through Topology Inference and Local to Global Alignment , 1998, ECCV.

[5]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[6]  D. Lowe,et al.  Fast Matching of Binary Features , 2012, 2012 Ninth Conference on Computer and Robot Vision.

[7]  Andrea Fusiello,et al.  High resolution video mosaicing with global alignment , 2004, CVPR 2004.

[8]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[9]  Xin Yang,et al.  Local difference binary for ultrafast and distinctive feature description. , 2013, IEEE transactions on pattern analysis and machine intelligence.

[10]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[11]  Pere Ridao,et al.  Visual inspection of hydroelectric dams using an autonomous underwater vehicle , 2010, J. Field Robotics.

[12]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[13]  Emilio Garcia-Fidalgo,et al.  On the use of binary feature descriptors for loop closure detection , 2014, Proceedings of the 2014 IEEE Emerging Technology and Factory Automation (ETFA).

[14]  Dorian Gálvez-López,et al.  Bags of Binary Words for Fast Place Recognition in Image Sequences , 2012, IEEE Transactions on Robotics.

[15]  Aníbal Ollero,et al.  Homography Based Kalman Filter for Mosaic Building. Applications to UAV position estimation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[16]  Alberto Ortiz,et al.  Semi-autonomous visual inspection of vessels assisted by an unmanned Micro Aerial Vehicle , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Karen Spärck Jones.  A statistical interpretation of term specificity and its application in retrieval , 2021, J. Documentation.

[18]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[19]  Alberto Ortiz,et al.  A probabilistic approach for defect detection based on saliency mechanisms , 2014, Proceedings of the 2014 IEEE Emerging Technology and Factory Automation (ETFA).

[20]  Shahriar Negahdaripour,et al.  Global alignment of sensor positions with noisy motion measurements , 2004, IEEE Transactions on Robotics.

[21]  Mustafa Unel,et al.  A new approach to real-time mosaicing of aerial images , 2014, Robotics Auton. Syst..

[22]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[23]  Andreas Birk,et al.  Fast and robust photomapping with an Unmanned Aerial Vehicle (UAV) , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Hanumant Singh,et al.  Toward large-area mosaicing for underwater scientific applications , 2003 .

[25]  Gérard G. Medioni,et al.  Map-Enhanced UAV Image Sequence Registration and Synchronization of Multiple Image Sequences , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Massimo Caccia,et al.  A real-time mosaicking algorithm using binary features for ROVs , 2013, 21st Mediterranean Conference on Control and Automation.