Extrinsic calibration of an RGB camera to a 3D imaging sonar

The introduction of low-cost RGB-depth (RGB-D) sensors have led to a diversity of algorithms for robust 3D scene reconstruction under controlled settings, but the underwater realization of such algorithms has been hampered by the constrained performance of most RGB-D sensors in water. We explore the possibility of fusing a point cloud generated from a high-frequency, mechanically scanned 3D imaging sonar with visual data from a camera to create a rich 3D representation of objects in the water column. A state-of-the-art algorithm for depth sensor-to-camera registration utilizing concurrent images of spherical targets is adapted, and the resulting alignment is used to combine sonar and visual imagery.

[1]  Long Quan,et al.  Linear N-Point Camera Pose Determination , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[3]  Sandro Barone,et al.  Experimentation of structured light and stereo vision for underwater 3D reconstruction , 2011 .

[4]  S. Nayar,et al.  Structured light methods for underwater imaging: light stripe scanning and photometric stereo , 2005, Proceedings of OCEANS 2005 MTS/IEEE.

[5]  Robert Pless,et al.  Extrinsic calibration of a camera and laser range finder (improves camera calibration) , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[6]  In-So Kweon,et al.  A novel 2.5D pattern for extrinsic calibration of tof and camera fusion system , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  John J. Leonard,et al.  Real-time large-scale dense RGB-D SLAM with volumetric fusion , 2014, Int. J. Robotics Res..

[8]  Roland Siegwart,et al.  Extrinsic self calibration of a camera and a 3D laser range finder from natural scenes , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  S Negahdaripour.  A new method for calibration of an opti-acoustic stereo imaging system , 2010, OCEANS 2010 MTS/IEEE SEATTLE.

[10]  Urbano Nunes,et al.  Fast and Accurate Calibration of a Kinect Sensor , 2013, 2013 International Conference on 3D Vision.

[11]  Chris Roman,et al.  Application of structured light imaging for high resolution mapping of underwater archaeological sites , 2010, OCEANS'10 IEEE SYDNEY.

[12]  Juho Kannala,et al.  Accurate and Practical Calibration of a Depth and Color Camera Pair , 2011, CAIP.

[13]  Kurt Konolige,et al.  Change Their Perception: RGB-D for 3-D Modeling and Recognition , 2013, IEEE Robotics & Automation Magazine.

[14]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[15]  Daniel Herrera C,et al.  Joint depth and color camera calibration with distortion correction. , 2012, IEEE transactions on pattern analysis and machine intelligence.

[16]  Fabio Morbidi,et al.  Easy-to-Use and Accurate Calibration of RGB-D Cameras from Spheres , 2013, PSIVT.

[17]  X. Cufi,et al.  Calibration of optical camera coupled to acoustic multibeam for underwater 3D scene reconstruction , 2010, OCEANS'10 IEEE SYDNEY.

[18]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[19]  Aggelos K. Katsaggelos,et al.  Automatic, fast, online calibration between depth and color cameras , 2014, J. Vis. Commun. Image Represent..

[20]  V. Lepetit,et al.  EPnP: An Accurate O(n) Solution to the PnP Problem , 2009, International Journal of Computer Vision.

[21]  Zhengyou Zhang,et al.  Calibration between depth and color sensors for commodity depth cameras , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[22]  Shahriar Negahdaripour,et al.  Opti-Acoustic Stereo Imaging: On System Calibration and 3-D Target Reconstruction , 2009, IEEE Transactions on Image Processing.