Adaptive Color Constancy Using Faces

In this work we design an adaptive color constancy algorithm that, exploiting the skin regions found in faces, is able to estimate and correct the scene illumination. The algorithm automatically switches from global to spatially varying color correction on the basis of the illuminant estimations on the different faces detected in the image. An extensive comparison with both global and local color constancy algorithms is carried out to validate the effectiveness of the proposed algorithm in terms of both statistical and perceptual significance on a large heterogeneous data set of RAW images containing faces.

[1]  D. L. Macadam.  Chromatic adaptation. , 1956, Journal of the Optical Society of America.

[2]  Steven D. Hordley,et al.  Scene illuminant estimation: Past, present, and future , 2006 .

[3]  Joost van de Weijer,et al.  Generalized Gamut Mapping using Image Derivative Structures for Color Constancy , 2008, International Journal of Computer Vision.

[4]  M. S. Drew,et al.  Color constancy - Generalized diagonal transforms suffice , 1994 .

[5]  Frédo Durand,et al.  User-guided white balance for mixed lighting conditions , 2012, ACM Trans. Graph..

[6]  Simone Bianco,et al.  Color Constancy Using Single Colors , 2012, ECCV Workshops.

[7]  David A. Forsyth,et al.  A novel algorithm for color constancy , 1990, International Journal of Computer Vision.

[8]  Raimondo Schettini,et al.  Improving Color Constancy Using Indoor–Outdoor Image Classification , 2008, IEEE Transactions on Image Processing.

[9]  Andrew P. Witkin,et al.  Scale-space filtering: A new approach to multi-scale description , 1984, ICASSP.

[10]  J. Montojo.  Face-based Chromatic Adaptation for Tagged Photo Collections , 2009 .

[11]  Rui Huang,et al.  Shape-from-shading under complex natural illumination , 2011, 2011 18th IEEE International Conference on Image Processing.

[12]  G. Buchsbaum.  A spatial processor model for object colour perception , 1980 .

[13]  Stephen Lin,et al.  A New In-Camera Imaging Model for Color Computer Vision and Its Application , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  G. Finlayson,et al.  Re-evaluating colour constancy algorithms , 2004, ICPR 2004.

[15]  Christian Riess,et al.  Exposing Digital Image Forgeries by Illumination Color Classification , 2013, IEEE Transactions on Information Forensics and Security.

[16]  Ko Nishino,et al.  The world in an eye [eye image interpretation] , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[17]  Andrew Blake,et al.  Bayesian color constancy revisited , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Mika Laaksonen,et al.  Using the skin locus to cope with chang-ing illumination conditions in color-based face tracking , 2000 .

[19]  Raimondo Schettini,et al.  Automatic color constancy algorithm selection and combination , 2010, Pattern Recognit..

[20]  Sabine Süsstrunk,et al.  Assessing human skin color from uncalibrated images , 2007, Int. J. Imaging Syst. Technol..

[21]  F. Wilcoxon.  Individual Comparisons by Ranking Methods , 1945 .

[22]  Christian Riess,et al.  Color constancy and non-uniform illumination: Can existing algorithms work? , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[23]  Raimondo Schettini,et al.  Recall or precision-oriented strategies for binary classification of skin pixels , 2008, J. Electronic Imaging.

[24]  Frédo Durand,et al.  Light mixture estimation for spatially varying white balance , 2008, ACM Trans. Graph..

[25]  Theo Gevers,et al.  Perceptual analysis of distance measures for color constancy algorithms. , 2009, Journal of the Optical Society of America. A, Optics, image science, and vision.

[26]  K. Gegenfurtner,et al.  Memory modulates color appearance , 2006, Nature Neuroscience.

[27]  Shaziya .P.S. Khan,et al.  Exposing Digital Image Forgeries by Illumination Color Classification , 2015 .

[28]  Raimondo Schettini,et al.  Consensus-based framework for illuminant chromaticity estimation , 2008, J. Electronic Imaging.

[29]  Carl Staelin,et al.  Skin-Sensitive Automatic Color Correction , 2009 .

[30]  Marc Ebner,et al.  Color constancy based on local space average color , 2009, Machine Vision and Applications.

[31]  Theo Gevers,et al.  Color Constancy Using Natural Image Statistics and Scene Semantics , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  E. Land.  The retinex theory of color vision. , 1977, Scientific American.

[33]  Graham D. Finlayson,et al.  Color by Correlation: A Simple, Unifying Framework for Color Constancy , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Raimondo Schettini,et al.  Color constancy using faces , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Brian V. Funt,et al.  White Point Estimation for Uncalibrated Images , 1999, Color Imaging Conference.

[36]  Keigo Hirakawa,et al.  Color Constancy with Spatio-Spectral Statistics , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Joost van de Weijer,et al.  Color in Computer Vision: Fundamentals and Applications , 2012 .

[38]  Shree K. Nayar,et al.  Eyes for relighting , 2004, ACM Trans. Graph..

[39]  Sajib Saha,et al.  Color Correction: A Novel Weighted Von Kries Model Based on Memory Colors , 2011, CCIW.

[40]  Cordelia Schmid,et al.  Using High-Level Visual Information for Color Constancy , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[41]  Theo Gevers,et al.  Color Constancy for Multiple Light Sources , 2012, IEEE Transactions on Image Processing.

[42]  Vijayan K. Asari,et al.  Skin color constancy for illumination invariant skin segmentation , 2005, IS&T/SPIE Electronic Imaging.

[43]  Shree K. Nayar,et al.  Using eye reflections for face recognition under varying illumination , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[44]  Nikolaos G. Bourbakis,et al.  A survey of skin-color modeling and detection methods , 2007, Pattern Recognit..

[45]  Joost van de Weijer,et al.  Author Manuscript, Published in "ieee Transactions on Image Processing Edge-based Color Constancy , 2022 .

[46]  Kobus Barnard,et al.  Improvements to Gamut Mapping Colour Constancy Algorithms , 2000, ECCV.

[47]  Joost van de Weijer,et al.  Computational Color Constancy: Survey and Experiments , 2011, IEEE Transactions on Image Processing.

[48]  Ira Kemelmacher-Shlizerman,et al.  Face reconstruction in the wild , 2011, 2011 International Conference on Computer Vision.

[49]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[50]  W.E. Snyder,et al.  Color image processing pipeline , 2005, IEEE Signal Processing Magazine.

[51]  Gui Yun Tian,et al.  Skin chromaticity gamuts for illumination recovery , 2012, CGIV.

[52]  De Xu,et al.  Color constancy using 3D scene geometry , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[53]  Brian V. Funt,et al.  Is Machine Colour Constancy Good Enough? , 1998, ECCV.