Image rectification with the pinax camera model in underwater stereo systems with verged cameras

Vision methods are very commonly used in underwater robotics. However, the cameras must be enclosed in a sealed housing for which flat-pane windows are the most economical and hence most popular solution. But they cause non-trivial refraction-based distortions at the air-glass-water interface. Recently, a new model for underwater cameras calibration called Pinax was introduced, which combines aspects of an axial and a pinhole camera model to derive an as accurate as possible and at the same time computational feasible solution. Here it is shown, how the Pinax model can be applied to stereo cameras when two verged cameras are behind a single flat glass panel. Real world experiments under different water conditions show that our method outperforms standard methods using pinhole models in combination with in-water calibration.

[1]  Yee-Hong Yang,et al.  Two-View Camera Housing Parameters Calibration for Multi-layer Flat Refractive Interface , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Shahriar Negahdaripour,et al.  Opti-Acoustic Stereo Imaging, System Calibration and 3-D Reconstruction , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Stefan B. Williams,et al.  Bundle adjustment in large-scale 3D reconstructions based on underwater robotic surveys , 2011, OCEANS 2011 IEEE - Spain.

[4]  E. Malis,et al.  3D Reconstruction of Natural Underwater Scenes Using the Stereovision System IRIS , 2007, OCEANS 2007 - Europe.

[5]  S. Negahdaripour,et al.  Integrated System for Robust 6-DOF Positioning Utilizing New Closed-Form Visual Motion Estimation Methods in Planar Terrains , 2006, IEEE Journal of Oceanic Engineering.

[6]  H. Singh,et al.  Hemispherical refraction and camera calibration in underwater vision , 2008, OCEANS 2008.

[7]  Anne Jordt,et al.  Refractive Calibration of Underwater Cameras , 2012, ECCV.

[8]  Yee-Hong Yang,et al.  Experimental study of the influence of refraction on underwater three-dimensional reconstruction using the SVP camera model. , 2012, Applied optics.

[9]  Stefan B. Williams,et al.  Generation and visualization of large‐scale three‐dimensional reconstructions from underwater robotic surveys , 2010, J. Field Robotics.

[10]  Peter F. Sturm,et al.  Multi-view geometry for general camera models , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[11]  Hanumant Singh,et al.  Relative Pose Estimation for Instrumented, Calibrated Imaging Platforms , 2003, DICTA.

[12]  Reinhard Koch,et al.  3D reconstruction based on underwater video from ROV Kiel 6000 considering underwater imaging conditions , 2009, OCEANS 2009-EUROPE.

[13]  Euan S. Harvey,et al.  Design and Calibration of an Underwater Stereo-video System for the Monitoring of Marine Fauna Populations , 2001 .

[14]  Minglun Gong,et al.  Refractive Epipolar Geometry for Underwater Stereo Matching , 2011, 2011 Canadian Conference on Computer and Robot Vision.

[15]  Visesh Chari,et al.  Multi-View Geometry of the Refractive Plane , 2009, BMVC.

[16]  Andreas Birk,et al.  The Pinax-model for accurate and efficient refraction correction of underwater cameras in flat-pane housings , 2017 .

[17]  Hanumant Singh,et al.  Stereo self-calibration for seafloor mapping using AUVs , 2010, 2010 IEEE/OES Autonomous Underwater Vehicles.

[18]  Marie-José Aldon,et al.  Camera Self-Calibration in Underwater Environment , 2003, WSCG.

[19]  Daniel Toal,et al.  Review of Machine Vision Applications in Unmanned Underwater Vehicles , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[20]  Visesh Chari,et al.  A theory of multi-layer flat refractive geometry , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  José Santos-Victor,et al.  Underwater Video Mosaics as Visual Navigation Maps , 2000, Comput. Vis. Image Underst..

[22]  R. W. Austin,et al.  The Index of Refraction of Seawater , 1976 .

[23]  Rongxin Li,et al.  Quantitative photogrammetric analysis of digital underwater video imagery , 1997 .