Efficient illuminant estimation for color constancy using grey pixels

Illuminant estimation is a key step for computational color constancy. Instead of using the grey world or grey edge assumptions, we propose in this paper a novel method for illuminant estimation by using the information of grey pixels detected in a given color-biased image. The underlying hypothesis is that most of the natural images include some detectable pixels that are at least approximately grey, which can be reliably utilized for illuminant estimation. We first validate our assumption through comprehensive statistical evaluation on diverse collection of datasets and then put forward a novel grey pixel detection method based on the illuminant-invariant measure (IIM) in three logarithmic color channels. Then the light source color of a scene can be easily estimated from the detected grey pixels. Experimental results on four benchmark datasets (three recorded under single illuminant and one under multiple illuminants) show that the proposed method outperforms most of the state-of-the-art color constancy approaches with the inherent merit of low computational cost.

[1]  Lilong Shi,et al.  The Rehabilitation of MaxRGB , 2010, CIC.

[2]  Kai-Fu Yang,et al.  Color Constancy Using Double-Opponency , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Marc Ebner,et al.  Color Constancy , 2007, Computer Vision, A Reference Guide.

[4]  Brian V. Funt,et al.  Estimating Illumination Chromaticity via Support Vector Regression , 2004, Color Imaging Conference.

[5]  Mark S. Drew,et al.  The Role of Bright Pixels in Illumination Estimation , 2012, Color Imaging Conference.

[6]  P. A. Dufort,et al.  Color categorization and color constancy in a neural network model of V4 , 1991, Biological Cybernetics.

[7]  H C Lee,et al.  Method for computing the scene-illuminant chromaticity from specular highlights. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[8]  Chin-Teng Lin,et al.  Bio-Inspired Computer Fovea Model Based on Hexagonal-Type Cellular Neural Network , 2007, IEEE Transactions on Circuits and Systems I: Regular Papers.

[9]  Byoung-Ho Kang,et al.  Illumination Estimation via Thin-Plate Spline Interpolation , 2007, CIC.

[10]  Steven D. Hordley,et al.  Scene illuminant estimation: Past, present, and future , 2006 .

[11]  Joost van de Weijer,et al.  Generalized Gamut Mapping using Image Derivative Structures for Color Constancy , 2008, International Journal of Computer Vision.

[12]  Raimondo Schettini,et al.  Automatic color constancy algorithm selection and combination , 2010, Pattern Recognit..

[13]  Brian V. Funt,et al.  Color Constant Color Indexing , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  K. Ikeuchi,et al.  Color constancy through inverse-intensity chromaticity space. , 2004, Journal of the Optical Society of America. A, Optics, image science, and vision.

[15]  David A. Forsyth,et al.  A novel algorithm for color constancy , 1990, International Journal of Computer Vision.

[16]  Hedva Spitzer,et al.  Color constancy: a biological model and its application for still and video images , 2000, 21st IEEE Convention of the Electrical and Electronic Engineers in Israel. Proceedings (Cat. No.00EX377).

[17]  Yongjie Li,et al.  Efficient Color Boundary Detection with Color-Opponent Mechanisms , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Joost van de Weijer,et al.  Computational Color Constancy: Survey and Experiments , 2011, IEEE Transactions on Image Processing.

[19]  Joost van de Weijer,et al.  Improving Color Constancy by Photometric Edge Weighting , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Brian V. Funt,et al.  Removing Outliers in Illumination Estimation , 2012, CIC.

[21]  Theo Gevers,et al.  Color Constancy Using Natural Image Statistics and Scene Semantics , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Brian V. Funt,et al.  A data set for color research , 2002 .

[23]  Yongjie Li,et al.  Efficient Color Constancy with Local Surface Reflectance Statistics , 2014, ECCV.

[24]  Raimondo Schettini,et al.  Adaptive Color Constancy Using Faces , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  D H Brainard,et al.  Bayesian color constancy. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[26]  Brian V. Funt,et al.  A Large Image Database for Color Constancy Research , 2003, CIC.

[27]  Cordelia Schmid,et al.  Using High-Level Visual Information for Color Constancy , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[28]  Leif H. Finkel,et al.  A multistage neural network for color constancy and color induction , 1995, IEEE Trans. Neural Networks.

[29]  Graham D. Finlayson,et al.  Shades of Gray and Colour Constancy , 2004, CIC.

[30]  Mark S. Drew,et al.  The Zeta-image, illuminant estimation, and specularity manipulation , 2014, Comput. Vis. Image Underst..

[31]  Joost van de Weijer,et al.  Author Manuscript, Published in "ieee Transactions on Image Processing Edge-based Color Constancy , 2022 .

[32]  M. S. Drew,et al.  Color constancy - Generalized diagonal transforms suffice , 1994 .

[33]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[34]  D. Foster Color constancy , 2011, Vision Research.

[35]  Theo Gevers,et al.  Color Constancy for Multiple Light Sources , 2012, IEEE Transactions on Image Processing.

[36]  Andrew Blake,et al.  Bayesian color constancy revisited , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  G. Buchsbaum A spatial processor model for object colour perception , 1980 .

[38]  Byoung-Ho Kang,et al.  Automatic White Balancing via Gray Surface Identification , 2007, CIC.

[39]  Keigo Hirakawa,et al.  Color Constancy with Spatio-Spectral Statistics , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Raimondo Schettini,et al.  Improving Color Constancy Using Indoor–Outdoor Image Classification , 2008, IEEE Transactions on Image Processing.

[41]  Yongjie Li,et al.  A Color Constancy Model with Double-Opponency Mechanisms , 2013, 2013 IEEE International Conference on Computer Vision.

[42]  Mark S. Drew,et al.  Exemplar-Based Color Constancy and Multiple Illumination , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[44]  Arnold W. M. Smeulders,et al.  Color Based Object Recognition , 1997, ICIAP.

[45]  Joost van de Weijer,et al.  Multi-Illuminant Estimation With Conditional Random Fields , 2014, IEEE Transactions on Image Processing.

[46]  Dilip K Prasad,et al.  Illuminant estimation for color constancy: why spatial-domain methods work and the role of the color distribution. , 2014, Journal of the Optical Society of America. A, Optics, image science, and vision.

[47]  Frédo Durand,et al.  Learning to predict where humans look , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[48]  Kobus Barnard,et al.  Improvements to Gamut Mapping Colour Constancy Algorithms , 2000, ECCV.