An Alignment Method for the Integration of Underwater 3D Data Captured by a Stereovision System and an Acoustic Camera

The integration of underwater 3D data captured by acoustic and optical systems is a promising technique in various applications such as mapping or vehicle navigation. It allows for compensating the drawbacks of the low resolution of acoustic sensors and the limitations of optical sensors in bad visibility conditions. Aligning these data is a challenging problem, as it is hard to make a point-to-point correspondence. This paper presents a multi-sensor registration for the automatic integration of 3D data acquired from a stereovision system and a 3D acoustic camera in close-range acquisition. An appropriate rig has been used in the laboratory tests to determine the relative position between the two sensor frames. The experimental results show that our alignment approach, based on the acquisition of a rig in several poses, can be adopted to estimate the rigid transformation between the two heterogeneous sensors. A first estimation of the unknown geometric transformation is obtained by a registration of the two 3D point clouds, but it ends up to be strongly affected by noise and data dispersion. A robust and optimal estimation is obtained by a statistical processing of the transformations computed for each pose. The effectiveness of the method has been demonstrated in this first experimentation of the proposed 3D opto-acoustic camera.

[1]  Mark Shortis,et al.  Calibration Techniques for Accurate Measurements by Underwater Camera Systems , 2015, Sensors.

[2]  Gerald B. Mills International Hydrographic Survey Standards , 2015 .

[3]  L. Neumann,et al.  a New Color Correction Method for Underwater Imaging , 2015 .

[4]  Pierre Drap,et al.  Underwater Multimodal Survey: Merging Optical and Acoustic Data , 2014 .

[5]  Hanumant Singh,et al.  Map Building Fusing Acoustic and Visual Information using Autonomous Underwater Vehicles , 2013, J. Field Robotics.

[6]  Fabio Bruno,et al.  A Comparative Analysis between Active and Passive Techniques for Underwater 3D Reconstruction of Close-Range Objects , 2013, Sensors.

[7]  Djamel Merad,et al.  Underwater image preprocessing for automated photogrammetry in high turbidity water: An application on the Arles-Rhone XIII roman wreck in the Rhodano river, France , 2012, 2012 18th International Conference on Virtual Systems and Multimedia.

[8]  Sandro Barone,et al.  Experimentation of structured light and stereo vision for underwater 3D reconstruction , 2011 .

[9]  Andreas Geiger,et al.  Efficient Large-Scale Stereo Matching , 2010, ACCV.

[10]  M. Rubin,et al.  Arithmetic and geometric solutions for average rigid-body rotation , 2010 .

[11]  X. Cufi,et al.  Calibration of optical camera coupled to acoustic multibeam for underwater 3D scene reconstruction , 2010, OCEANS'10 IEEE SYDNEY.

[12]  Wolfram Burgard,et al.  A Tutorial on Graph-Based SLAM , 2010, IEEE Intelligent Transportation Systems Magazine.

[13]  Stefan B. Williams,et al.  Error modeling and calibration of exteroceptive sensors for accurate mapping applications , 2010 .

[14]  Raimondo Schettini,et al.  Underwater Image Processing: State of the Art of Restoration and Image Enhancement Methods , 2010, EURASIP J. Adv. Signal Process..

[15]  Shahriar Negahdaripour,et al.  Opti-Acoustic Stereo Imaging: On System Calibration and 3-D Target Reconstruction , 2009, IEEE Transactions on Image Processing.

[16]  Yunbao Huang,et al.  Multi-sensor calibration through iterative registration and fusion , 2009, Comput. Aided Des..

[17]  T. Nicosevici,et al.  Online Robust 3D Mapping Using Structure from Motion Cues , 2008, OCEANS 2008 - MTS/IEEE Kobe Techno-Ocean.

[18]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[19]  Shahriar Negahdaripour,et al.  Integration of Motion Cues in Optical and Sonar Videos for 3-D Positioning , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Shahriar Negahdaripour Epipolar Geometry of Opti-Acoustic Stereo Imaging , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Shahriar Negahdaripour,et al.  Direct and Indirect 3-D Reconstruction from Opti-Acoustic Stereo Imaging , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[22]  U. Castellani,et al.  A complete system for on-line 3D modelling from acoustic images , 2005, Signal Process. Image Commun..

[23]  S. Negahdaripour Calibration of DIDSON forward-scan acoustic video camera , 2005, Proceedings of OCEANS 2005 MTS/IEEE.

[24]  Andrea Fusiello,et al.  Augmented scene modeling and visualization by optical and acoustic sensor integration , 2004, IEEE Transactions on Visualization and Computer Graphics.

[25]  Robert Pless,et al.  Extrinsic calibration of a camera and laser range finder (improves camera calibration) , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[26]  Stefan B. Williams,et al.  Simultaneous localisation and mapping on the Great Barrier Reef , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[27]  Hanumant Singh,et al.  Sensor fusion of structure-from-motion, bathymetric 3D, and beacon-based navigation modalities , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[28]  Hugh F. Durrant-Whyte,et al.  A solution to the simultaneous localization and map building (SLAM) problem , 2001, IEEE Trans. Robotics Autom..

[29]  Vittorio Murino,et al.  Reconstruction and segmentation of underwater acoustic images combining confidence information in MRF models , 2001, Pattern Recognit..

[30]  A. Trucco,et al.  Three-dimensional image generation and processing in underwater acoustic vision , 2000, Proceedings of the IEEE.

[31]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Janne Heikkilä,et al.  Geometric Camera Calibration Using Circular Control Points , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Andrea Fusiello,et al.  Calibration of an Optical-Acoustic Sensor , 2000 .

[34]  Andrea Fusiello,et al.  Virtual environment modeling by integrated optical and acoustic sensing , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[35]  R. K. Hansen,et al.  A 3D Underwater Acoustic Camera — Properties and Applications , 1996 .

[36]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  David G. Lowe,et al.  Fitting Parameterized Three-Dimensional Models to Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  H. S. Wolff,et al.  iRun: Horizontal and Vertical Shape of a Region-Based Graph Compression , 2022, Sensors.

[39]  H. Barnes Oceanography and Marine Biology , 1959 .