Camera Calibration for Underwater 3D Reconstruction Based on Ray Tracing Using Snell’s Law

Accurately estimating the 3D position of underwater objects is of great interest when doing research on marine animals. An inherent problem of 3D reconstruction of underwater positions is the presence of refraction which invalidates the assumption of a single viewpoint. Three ways of performing 3D reconstruction on underwater objects are compared in this work: an approach relying solely on in-air camera calibration, an approach with the camera calibration performed under water and an approach based on ray tracing with Snell's law. As expected, the in-air camera calibration showed to be the most inaccurate as it does not take refraction into account. The precision of the estimated 3D positions based on the underwater camera calibration and the ray tracing based approach were, on the other hand, almost identical. However, the ray tracing based approach is found to be advantageous as it is far more flexible in terms of the calibration procedure due to the decoupling of the intrinsic and extrinsic camera parameters.

[1]  Yan Qiu Chen,et al.  Feature point based 3D tracking of multiple fish from multi-view images , 2017, PloS one.

[2]  J. Casebolt,et al.  Effects of light refraction on the accuracy of camera calibration and reconstruction in underwater motion analysis , 2006, Sports Biomechanics.

[3]  Josef Kittler,et al.  A Comparative Study of Hough Transform Methods for Circle Finding , 1989, Alvey Vision Conference.

[4]  Anthony L Andrady,et al.  Microplastics in the marine environment. , 2011, Marine pollution bulletin.

[5]  Ulrike K Müller,et al.  Refraction corrected calibration for aquatic locomotion research: application of Snell’s law improves spatial accuracy , 2015, Bioinspiration & biomimetics.

[6]  Giuseppe Bianco,et al.  Plankton 3D tracking: the importance of camera calibration in stereo computer vision systems , 2013 .

[7]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[8]  Sachit Butail,et al.  Three-dimensional scoring of zebrafish behavior unveils biological phenomena hidden by two-dimensional analyses , 2017, Scientific Reports.

[9]  Marco Bibuli,et al.  Autonomous Underwater Intervention: Experimental Results of the MARIS Project , 2018, IEEE Journal of Oceanic Engineering.

[10]  Takashi Matsuyama,et al.  Dynamic 3D capture of swimming fish by underwater active stereo , 2016 .

[11]  Pedro D. V. Buschinelli,et al.  Underwater 3D shape measurement using inverse triangulation through two flat refractive surfaces , 2016, OCEANS 2016 MTS/IEEE Monterey.

[12]  Alexandru Tupan,et al.  Triangulation , 1997, Comput. Vis. Image Underst..

[13]  Xi En Cheng,et al.  Automatically Detect and Track Multiple Fish Swimming in Shallow Water with Frequent Occlusion , 2014, PloS one.

[14]  Yoshimasa Kawata,et al.  3-D measurement of objects in a cylindrical glass water tank with a laser range finder , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[15]  Yee-Hong Yang,et al.  Experimental study of the influence of refraction on underwater three-dimensional reconstruction using the SVP camera model. , 2012, Applied optics.

[16]  Roman Kuchkuda,et al.  An introduction to ray tracing , 1993, Comput. Graph..

[17]  A. Pérez-Escudero,et al.  idTracker: tracking individuals in a group by automatic identification of unmarked animals , 2014, Nature Methods.

[18]  Richard C. Thompson,et al.  Microplastic—an emerging contaminant of potential concern? , 2007, Integrated environmental assessment and management.

[19]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Visesh Chari,et al.  A theory of multi-layer flat refractive geometry , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Lars Kuhnert,et al.  Calibration and 3D ground truth data generation with orthogonal camera-setup and refraction compensation for aquaria in real-time , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[22]  Fabio Bruno,et al.  A Comparative Analysis between Active and Passive Techniques for Underwater 3D Reconstruction of Close-Range Objects , 2013, Sensors.