Refractive Structure-from-Motion on Underwater Images

In underwater environments, cameras need to be confined in an underwater housing, viewing the scene through a piece of glass. In case of flat port underwater housings, light rays entering the camera housing are refracted twice, due to different medium densities of water, glass, and air. This causes the usually linear rays of light to bend and the commonly used pinhole camera model to be invalid. When using the pinhole camera model without explicitly modeling refraction in Structure-from-Motion (SfM) methods, a systematic model error occurs. Therefore, in this paper, we propose a system for computing camera path and 3D points with explicit incorporation of refraction using new methods for pose estimation. Additionally, a new error function is introduced for non-linear optimization, especially bundle adjustment. The proposed method allows to increase reconstruction accuracy and is evaluated in a set of experiments, where the proposed method's performance is compared to SfM with the perspective camera model.

[1]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[2]  Visesh Chari,et al.  Multi-View Geometry of the Refractive Plane , 2009, BMVC.

[3]  Michel Dhome,et al.  Generic and real-time structure from motion using local bundle adjustment , 2009, Image Vis. Comput..

[4]  Anne Jordt,et al.  Perspective and Non-perspective Camera Models in Underwater Imaging - Overview and Error Analysis , 2011, Theoretical Foundations of Computer Vision.

[5]  Anne Jordt,et al.  Calibration of Housing Parameters for Underwater Stereo-Camera Rigs , 2011, BMVC.

[6]  R. Hartley Triangulation, Computer Vision and Image Understanding , 1997 .

[7]  E. Malis,et al.  3D Reconstruction of Natural Underwater Scenes Using the Stereovision System IRIS , 2007, OCEANS 2007 - Europe.

[8]  Stefan B. Williams,et al.  Error modeling and calibration of exteroceptive sensors for accurate mapping applications , 2010 .

[9]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[10]  Anne Jordt,et al.  Refractive Calibration of Underwater Cameras , 2012, ECCV.

[11]  Peter F. Sturm,et al.  A generic structure-from-motion framework , 2006, Comput. Vis. Image Underst..

[12]  H. Singh,et al.  Hemispherical refraction and camera calibration in underwater vision , 2008, OCEANS 2008.

[13]  Rongxin Li,et al.  Quantitative photogrammetric analysis of digital underwater video imagery , 1997 .

[14]  Anne Jordt,et al.  Refractive Plane Sweep for Underwater Images , 2013, GCPR.

[15]  J. Davenport Editor , 1960 .

[16]  Hanumant Singh,et al.  Robotic tools for deep water archaeology: Surveying an ancient shipwreck with an autonomous underwater vehicle , 2010, J. Field Robotics.

[17]  Yee-Hong Yang,et al.  Two-View Underwater Structure and Motion for Cameras under Flat Refractive Interfaces , 2012, ECCV.

[18]  Jean-Thierry Lapresté,et al.  Underwater Camera Calibration , 2000, ECCV.

[19]  David Nistér,et al.  A Minimal Solution to the Generalised 3-Point Pose Problem , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[20]  Visesh Chari,et al.  A theory of multi-layer flat refractive geometry , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Hiroshi Yasaka,et al.  1.3-V/sub pp/ push-pull drive InP Mach-Zehnder modulator module for 40 Gbit/s operation , 2005 .

[22]  Shree K. Nayar,et al.  The Raxel Imaging Model and Ray-Based Calibration , 2005, International Journal of Computer Vision.

[23]  Yee-Hong Yang,et al.  Experimental study of the influence of refraction on underwater three-dimensional reconstruction using the SVP camera model. , 2012, Applied optics.

[24]  Alexandru Tupan,et al.  Triangulation , 1997, Comput. Vis. Image Underst..

[25]  P. Sturm,et al.  On Calibration, Structure from Motion and Multi-View Geometry for Generic Camera Models , 2006 .

[26]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[27]  Soren W. Henriksen,et al.  Manual of photogrammetry , 1980 .

[28]  Tsuhan Chen,et al.  Multi-view 3D reconstruction for scenes under the refractive plane with known vertical direction , 2011, 2011 International Conference on Computer Vision.

[29]  Michele Scardi,et al.  Extracting fish size using dual underwater cameras , 2006 .