Two Illuminant Estimation and User Correction Preference

This paper examines the problem of white-balance correction when a scene contains two illuminations. This is a two step process: 1) estimate the two illuminants, and 2) correct the image. Existing methods attempt to estimate a spatially varying illumination map, however, results are error prone and the resulting illumination maps are too lowresolution to be used for proper spatially varying whitebalance correction. In addition, the spatially varying nature of these methods make them computationally intensive. We show that this problem can be effectively addressed by not attempting to obtain a spatially varying illumination map, but instead by performing illumination estimation on large sub-regions of the image. Our approach is able to detect when distinct illuminations are present in the image and accurately measure these illuminants. Since our proposed strategy is not suitable for spatially varying image correction, a user study is performed to see if there is a preference for how the image should be corrected when two illuminants are present, but only a global correction can be applied. The user study shows that when the illuminations are distinct, there is a preference for the outdoor illumination to be corrected resulting in warmer final result. We use these collective findings to demonstrate an effective two illuminant estimation scheme that produces corrected images that users prefer.

[1]  Frédo Durand,et al.  Light mixture estimation for spatially varying white balance , 2008, ACM Trans. Graph..

[2]  Raimondo Schettini,et al.  Computational color constancy , 2011, 3rd European Workshop on Visual Information Processing.

[3]  Joost van de Weijer,et al.  Computational Color Constancy: Survey and Experiments , 2011, IEEE Transactions on Image Processing.

[4]  Joost van de Weijer,et al.  Improving Color Constancy by Photometric Edge Weighting , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Luis von Ahn,et al.  Matchin: eliciting user preferences with an online game , 2009, CHI.

[6]  Andrew Blake,et al.  Bayesian color constancy revisited , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Theo Gevers,et al.  Color Constancy for Multiple Light Sources , 2012, IEEE Transactions on Image Processing.

[8]  Graham D. Finlayson,et al.  Corrected-Moment Illuminant Estimation , 2013, 2013 IEEE International Conference on Computer Vision.

[9]  G. Buchsbaum A spatial processor model for object colour perception , 1980 .

[10]  E. Land The retinex theory of color vision. , 1977, Scientific American.

[11]  Frédo Durand,et al.  User-guided white balance for mixed lighting conditions , 2012, ACM Trans. Graph..

[12]  Marc Ebner,et al.  Color constancy based on local space average color , 2009, Machine Vision and Applications.

[13]  Graham D. Finlayson,et al.  Colour constancy using the chromagenic constraint , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  Michael S. Brown,et al.  Effective learning-based illuminant estimation using simple features , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Joost van de Weijer,et al.  Multi-Illuminant Estimation With Conditional Random Fields , 2014, IEEE Transactions on Image Processing.

[16]  Christian Riess,et al.  Color constancy and non-uniform illumination: Can existing algorithms work? , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[17]  Kai-Fu Yang,et al.  Efficient illuminant estimation for color constancy using grey pixels , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Mark S. Drew,et al.  Exemplar-Based Color Constancy and Multiple Illumination , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  K. Ikeuchi,et al.  Color constancy through inverse-intensity chromaticity space. , 2004, Journal of the Optical Society of America. A, Optics, image science, and vision.

[20]  Raimondo Schettini,et al.  Adaptive Color Constancy Using Faces , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  GijsenijA.,et al.  Computational Color Constancy , 2011 .

[22]  Giulia Boato,et al.  RAISE: a raw images dataset for digital image forensics , 2015, MMSys.

[23]  Christian Riess,et al.  Illuminant color estimation for real-world mixed-illuminant scenes , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).