Colour-Consistent Structure-from-Motion Models using Underwater Imagery

This paper presents an automated approach to correcting for colour inconsistency in underwater images collected from multiple perspectives during the construction of 3D structure-from-motion models. When capturing images underwater, the water column imposes several effects on images that are negligible in air such as colour-dependant attenuation and lighting patterns. These effects cause problems for human interpretation of images and also confound computer-based techniques for clustering and classification. Our approach exploits the 3D structure of the scene generated using structure-from-motion and photogrammetry techniques accounting for distance-based attenuation, vignetting and lighting pattern, and improves the consistency of photo-textured 3D models. Results are presented using imagery collected in two different underwater environments using an Autonomous Underwater Vehicle (AUV).

[1]  Gregory Dudek,et al.  A Statistical Learning-Based Method for Color Correction of Underwater Images , 2005 .

[2]  Jules S. Jaffe,et al.  Computer modeling and the design of optimal underwater imaging systems , 1990 .

[3]  O. Pizarro,et al.  Visually Augmented Navigation for Autonomous Underwater Vehicles , 2008, IEEE Journal of Oceanic Engineering.

[4]  Stefan B. Williams,et al.  Generation and visualization of large‐scale three‐dimensional reconstructions from underwater robotic surveys , 2010, J. Field Robotics.

[5]  Carrick Detweiler,et al.  Color-accurate underwater imaging using perceptual adaptive illumination , 2010, Auton. Robots.

[6]  Yoav Y. Schechner,et al.  Clear underwater vision , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[7]  Reinhard Koch,et al.  3D reconstruction based on underwater video from ROV Kiel 6000 considering underwater imaging conditions , 2009, OCEANS 2009-EUROPE.

[8]  G. Buchsbaum.  A spatial processor model for object colour perception , 1980 .

[9]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[10]  Rafael García,et al.  Surface reconstruction methods for the recovery of 3D models from underwater interest areas , 2011, OCEANS 2011 IEEE - Spain.

[11]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[12]  Shree K. Nayar,et al.  Modeling the space of camera response functions , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Atsushi Yamashita,et al.  Color Registration of Underwater Images for Underwater Sensing with Consideration of Light Attenuation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[14]  Stefan B. Williams,et al.  Efficient View-Based SLAM Using Visual Loop Closures , 2008, IEEE Transactions on Robotics.

[15]  Marc Pollefeys,et al.  Robust Radiometric Calibration and Vignetting Correction , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.