Local color correction with three dimensional point set registration for underwater stereo images

This paper proposes a novel local color correction algorithm that uses three dimensional (3D) point set registration especially for underwater stereo images. Due to the limited visibility in an underwater environment, underwater stereo images are usually captured by a half-mirror-based stereo camera that helps to prevent the unwanted visual fatigues induced by excessive disparities. However, the interaction between the half mirror and the scattered light components in the water may produce strong local color discrepancies. Thus, the proposed algorithm extracts sufficient information on the entire image area between the left and right images using 3D point set registration to counteract these effects. Since the proposed algorithm simultaneously processes all three color channels in the local color space, it is robust to the strong local color discrepancies in underwater stereo images. The proposed algorithm is both subjectively and objectively evaluated by comparing the histograms, the color similarities, and the disparity images before and after color correction. After color correction, the proposed algorithm achieves a color similarity up to 96.67%, while other conventional algorithms show color similarities only up to 90.66%. Although the proposed algorithm is designed for underwater stereo images, it can be used for various stereo images and applications.

[1]  Qi Wang,et al.  A Robust Algorithm for Color Correction between Two Stereo Images , 2009, ACCV.

[2]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[3]  Filippo Speranza,et al.  Effect of disparity and motion on visual comfort of stereoscopic images , 2006, Electronic Imaging.

[4]  Yushan Chen,et al.  YUV Correction for Multi-View Video Compression , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[5]  André Kaup,et al.  Histogram-Based Prefiltering for Luminance and Chrominance Compensation of Multiview Video , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Kwanghoon Sohn,et al.  Visual Fatigue Prediction for Stereoscopic Image , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[8]  Gary J. Sullivan,et al.  Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard , 2011, Proceedings of the IEEE.

[9]  Kenji Yamamoto,et al.  Color correction for multi-view video using energy minimization of view networks , 2008, Int. J. Autom. Comput..

[10]  Norimichi Tsumura,et al.  Spectral Based Color Correction Technique Compatible with Standard RGB System , 2006 .

[11]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.

[12]  Greg Welch,et al.  Ensuring color consistency across multiple cameras , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[13]  Stefano Soatto,et al.  A Variational Approach to Problems in Calibration of Multiple Cameras , 2007, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Mei Yu,et al.  Fast color correction for multi-view video by modeling spatio-temporal variation , 2010, J. Vis. Commun. Image Represent..

[15]  Alexander Toet,et al.  Visual comfort of binocular and 3D displays , 2004 .

[16]  Yoav Y. Schechner,et al.  Active Polarization Descattering , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Yoav Y. Schechner,et al.  Clear underwater vision , 2004, CVPR 2004.

[18]  B. L. McGlamery,et al.  A Computer Model For Underwater Camera Systems , 1980, Other Conferences.

[19]  Jules S. Jaffe,et al.  Computer modeling and the design of optimal underwater imaging systems , 1990 .

[20]  Hae-Dong Kim,et al.  A hybrid color matching between stereo image sequences , 2011, 2011 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[21]  Jon Y. Hardeberg,et al.  Visualization and Interactive Manipulation of Color Gamuts , 2002, Color Imaging Conference.

[22]  Andriy Myronenko,et al.  Point Set Registration: Coherent Point Drift , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.