Color Correction for Multi-view Images Using Relative Luminance and Chrominance Mapping Curves

In order to capture 3D scenes, a multi-view camera consisting of two or more cameras is widely used; however, color consistency among views is not guaranteed in many situations. In this paper, we design relative mapping curves with consideration of the properties of luminance and chrominance components to improve the consistency. The input images are categorized into source and reference views. We convert their color domain to the YUV color space, and estimate coefficients in the mapping curves by analyzing correspondences between the two views. After that, we generate lookup tables and convert the color distributions of the source views. From the experimental results, we confirm that our proposed method improves the visual quality of multi-view images and reduces Euclidean distances in the CIELab color space among views.

[1]  Yo-Sung Ho,et al.  An efficient image rectification method for parallel multi-camera arrangement , 2011, IEEE Transactions on Consumer Electronics.

[2]  Ken Chen,et al.  New Color Correction Approach to Multi-view Images with Region Correspondence , 2006, ICIC.

[3]  Masayuki Tanimoto,et al.  Multiview Imaging and 3DTV , 2007, IEEE Signal Processing Magazine.

[4]  André Kaup,et al.  Histogram-Based Prefiltering for Luminance and Chrominance Compensation of Multiview Video , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Toshiaki Fujii,et al.  Multiview Video Coding Using View Interpolation and Color Correction , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[7]  Thomas Wiegand,et al.  3D Video and Free Viewpoint Video - Technologies, Applications and MPEG Standards , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[8]  S. Burak Gokturk,et al.  A Time-Of-Flight Depth Sensor - System Description, Issues and Solutions , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[9]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[10]  Masayuki Tanimoto Overview of free viewpoint television , 2006, Signal Process. Image Commun..

[11]  Greg Welch,et al.  Ensuring color consistency across multiple cameras , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[12]  Yo-Sung Ho,et al.  Generation of high-quality depth maps using hybrid camera system for 3-D video , 2011, J. Vis. Commun. Image Represent..

[13]  Mark E. Gorzynski,et al.  CRT colorimetry. part I: Theory and practice , 1993 .

[14]  Richard Szeliski,et al.  High-accuracy stereo depth maps using structured light , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[15]  P. Gill,et al.  Algorithms for the Solution of the Nonlinear Least-Squares Problem , 1978 .

[16]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[17]  Masayuki Tanimoto,et al.  Multi-View Imaging and 3DTV (Special Issue Overview and Introduction) , 2007 .

[18]  Holly E. Rushmeier,et al.  The 3D Model Acquisition Pipeline , 2002, Comput. Graph. Forum.