Beyond White: Ground Truth Colors for Color Constancy Correction

A limitation in color constancy research is the inability to establish ground truth colors for evaluating corrected images. Many existing datasets contain images of scenes with a color chart included, however, only the chart's neutral colors (grayscale patches) are used to provide the ground truth for illumination estimation and correction. This is because the corrected neutral colors are known to lie along the achromatic line in the camera's color space (i.e. R=G=B), the correct RGB values of the other color patches are not known. As a result, most methods estimate a 3*3 diagonal matrix that ensures only the neutral colors are correct. In this paper, we describe how to overcome this limitation. Specifically, we show that under certain illuminations, a diagonal 3*3 matrix is capable of correcting not only neutral colors, but all the colors in a scene. This finding allows us to find the ground truth RGB values for the color chart in the camera's color space. We show how to use this information to correct all the images in existing datasets to have correct colors. Working from these new color corrected datasets, we describe how to modify existing color constancy algorithms to perform better image correction.

[1]  Joost van de Weijer,et al.  Color constancy based on the Grey-edge hypothesis , 2005, IEEE International Conference on Image Processing 2005.

[2]  D H Brainard,et al.  Analysis of the retinex theory of color vision. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[3]  Michael S. Brown,et al.  Effective learning-based illuminant estimation using simple features , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  M. H. Brill,et al.  Color Appearance Models, 2nd Edition , 2005 .

[5]  Raimondo Schettini,et al.  Computational color constancy , 2011, 3rd European Workshop on Visual Information Processing.

[6]  G. Buchsbaum.  A spatial processor model for object colour perception , 1980 .

[7]  Steven J. Gortler,et al.  The von Kries Hypothesis and a Basis for Color Constancy , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[8]  Sabine Süsstrunk,et al.  What is the space of spectral sensitivity functions for digital color cameras? , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[9]  Keigo Hirakawa,et al.  Color Constancy with Spatio-Spectral Statistics , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Andrew Blake,et al.  Bayesian color constancy revisited , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Stephen Lin,et al.  A New In-Camera Imaging Model for Color Computer Vision and Its Application , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Hao Jiang,et al.  Nondiagonal color correction , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[13]  Joost van de Weijer,et al.  Computational Color Constancy: Survey and Experiments , 2011, IEEE Transactions on Image Processing.

[14]  Mark S. Drew,et al.  Color constancy: enhancing von Kries adaption via sensor transformations , 1993, Electronic Imaging.

[15]  Mark D. Fairchild,et al.  Color Appearance Models: Fairchild/Color Appearance Models , 2013 .

[16]  Joost van de Weijer,et al.  Improving Color Constancy by Photometric Edge Weighting , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Brian V. Funt,et al.  A data set for color research , 2002 .

[18]  Graham D. Finlayson,et al.  Shades of Gray and Colour Constancy , 2004, CIC.

[19]  Dilip K Prasad,et al.  Illuminant estimation for color constancy: why spatial-domain methods work and the role of the color distribution. , 2014, Journal of the Optical Society of America. A, Optics, image science, and vision.

[20]  D. Foster,et al.  Frequency of metamerism in natural scenes. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[21]  Brian V. Funt,et al.  A Large Image Database for Color Constancy Research , 2003, CIC.

[22]  Ching-Chun Huang,et al.  A study of non-diagonal models for image white balance , 2013, Electronic Imaging.

[23]  Joost van de Weijer,et al.  Author Manuscript, Published in "ieee Transactions on Image Processing Edge-based Color Constancy , 2022 .

[24]  Tom Minka,et al.  Bayesian Color Constancy with Non-Gaussian Models , 2003, NIPS.

[25]  Graham D. Finlayson,et al.  Reproduction Angular Error: An Improved Performance Metric for Illuminant Estimation , 2014, BMVC.

[26]  Dirk P. Kroese,et al.  Kernel density estimation via diffusion , 2010, 1011.2602.

[27]  Graham D. Finlayson,et al.  Corrected-Moment Illuminant Estimation , 2013, 2013 IEEE International Conference on Computer Vision.

[28]  Raimondo Schettini,et al.  Error-Tolerant Color Rendering for Digital Cameras , 2014, Journal of Mathematical Imaging and Vision.

[29]  Alexander D. Logvinenko,et al.  Metamer Mismatching , 2014, IEEE Transactions on Image Processing.

[30]  Trevor Darrell,et al.  Modeling Radiometric Uncertainty for Vision with Tone-Mapped Color Images , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Mark S. Drew,et al.  Exemplar-Based Color Constancy and Multiple Illumination , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Mark S. Drew,et al.  Diagonal transforms suffice for color constancy , 1993, 1993 (4th) International Conference on Computer Vision.

[33]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .

[34]  David A. Forsyth,et al.  A novel algorithm for color constancy , 1990, International Journal of Computer Vision.

[35]  Graham D. Finlayson,et al.  Color by Correlation: A Simple, Unifying Framework for Color Constancy , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Raimondo Schettini,et al.  Color constancy using faces , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.