A new global alignment approach for underwater optical mapping

Lately, underwater vehicles have become important tools for exploration, monitoring and creation of maps of the seabed. Within mapping applications, the maps obtained from optical data are becoming essential in different study areas such as biological, geological and archaeological surveys, or in detection of benthic temporal changes. However, the underwater medium is very challenging for optical sensors and does not allow the area of interest to be imaged in a single image. Therefore, image mosaicing methods are necessary. Although recent advances in detection of correspondences between images have resulted in highly effective image registration methods, global alignment methods are still needed to obtain a globally coherent mosaic. In this paper, we propose a new global alignment method which works on the mosaic frame and does not require non-linear optimisation. Additionally, a simple image rectifying method is presented to reduce the down-scaling effect which might occur when minimising errors defined in the mosaic frame. Moreover, this rectifying method can also be seen as an alternative and straightforward way of incorporating different sensor information if available. The proposed framework has been tested with underwater image sequences. The resulting method is faster than its counterparts while providing the same level of registration quality.

[1]  Nathalie Pessel,et al.  Real-time geo-referenced video mosaicking with the MATISSE system , 2003, Oceans 2003. Celebrating the Past ... Teaming Toward the Future (IEEE Cat. No.03CH37492).

[2]  Andrea Fusiello,et al.  High resolution video mosaicing with global alignment , 2004, CVPR 2004.

[3]  Manolis I. A. Lourakis,et al.  SBA: A software package for generic sparse bundle adjustment , 2009, TOMS.

[4]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.

[5]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[6]  Nicholas Ayache,et al.  Robust mosaicing with correction of motion distortions and tissue deformations for in vivo fibered microscopy , 2006, Medical Image Anal..

[7]  O. Delaunoy,et al.  Towards Detecting Changes in Underwater Image Sequences , 2008, OCEANS 2008 - MTS/IEEE Kobe Techno-Ocean.

[8]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[9]  Xu Liu,et al.  A Novel 2D Marker Design and Application for Object Tracking and Event Detection , 2008, ISVC.

[10]  D. Stramski,et al.  Estimation of the inherent optical properties of natural waters from the irradiance attenuation coefficient and reflectance in the presence of Raman scattering. , 2000, Applied optics.

[11]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[12]  Ryan M. Eustice,et al.  Large-area visually augmented navigation for autonomous underwater vehicles , 2005 .

[13]  Robert M. Haralick Propagating covariance in computer vision , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[14]  Xun Xu,et al.  Mosaic-based positioning and improved motion-estimation methods for automatic navigation of submersible vehicles , 2002 .

[15]  Laurie M. Linnett,et al.  Underwater video mosaicing for seabed mapping , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[16]  R. García,et al.  Large-Area Photo-Mosaics Using Global Alignment and Navigation Data , 2007, OCEANS 2007.

[17]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[18]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[19]  Alexandre Bernardino,et al.  Mosaic-based navigation for autonomous underwater vehicles , 2003 .

[20]  Gérard G. Medioni,et al.  A graph-based global registration for 2D mosaics , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[21]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[22]  James Davis,et al.  Mosaics of scenes with moving objects , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[23]  G. Tirumala Vasu,et al.  High Resolution Video Mosaicing , 2011 .

[24]  Paul Beaudet,et al.  Rotationally invariant image operators , 1978 .

[25]  José Santos-Victor,et al.  Linear global mosaics for underwater surveying , 2004 .

[26]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Andrew Zisserman,et al.  Metric rectification for perspective images of planes , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[28]  S.M. Rock,et al.  An Operational Real-Time Large-Scale Visual Mosaicking and Navigation System , 2006, OCEANS 2006.

[29]  C. Distante,et al.  A fully automated approach for underwater mosaicking , 2006, OCEANS 2006.

[30]  Y. Rzhanov,et al.  Deep-sea Geo-referenced Video Mosaics , 2006, OCEANS 2006.

[31]  Pere Ridao,et al.  ICTINEUAUV Wins the First SAUC-E Competition , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[32]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[33]  Joan Batlle,et al.  Positioning an underwater vehicle through image mosaicking , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[34]  José Santos-Victor,et al.  Underwater Video Mosaics as Visual Navigation Maps , 2000, Comput. Vis. Image Underst..

[35]  J R Zaneveld,et al.  Absorption and attenuation of visible and near-infrared light in water: dependence on temperature and salinity. , 1997, Applied optics.

[36]  Rafael García,et al.  A New Global Alignment Method for Feature Based Image Mosaicing , 2008, ISVC.

[37]  David Capel,et al.  Image Mosaicing and Super-resolution , 2004, Distinguished Dissertations.

[38]  Harpreet S. Sawhney,et al.  Robust Video Mosaicing through Topology Inference and Local to Global Alignment , 1998, ECCV.

[39]  Hanumant Singh,et al.  Toward large-area mosaicing for underwater scientific applications , 2003 .

[40]  Serge J. Belongie,et al.  Covariance Propagation for Guided Matching , 2006 .

[41]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[42]  Azriel Rosenfeld,et al.  Analysis of the least median of squares estimator for computer vision applications , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[43]  Eun-Young Elaine Kang,et al.  Progressive Multi-image Registration based on Feature Tracking , 2006, IPCV.

[44]  Charles V. Stewart,et al.  A Feature-Based Technique for Joint Linear Estimation of High-Order Image-to-Mosaic Transformations: Mosaicing the Curved Human Retina , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Reinhard Klette,et al.  Theoretical Foundations of Computer Vision , 1996, Computing Supplement.

[46]  J. Escartín,et al.  Globally aligned photomosaic of the Lucky Strike hydrothermal vent field (Mid‐Atlantic Ridge, 37°18.5′N): Release of georeferenced data, mosaic construction, and viewing software , 2008 .

[47]  Bodo Rosenhahn,et al.  Geometric and Photometric Correction of Projected Rectangular Pictures , 2005 .