A comparison of computational color constancy algorithms. I: Methodology and experiments with synthesized data

We introduce a context for testing computational color constancy, specify our approach to the implementation of a number of the leading algorithms, and report the results of three experiments using synthesized data. Experiments using synthesized data are important because the ground truth is known, possible confounds due to camera characterization and pre-processing are absent, and various factors affecting color constancy can be efficiently investigated because they can be manipulated individually and precisely. The algorithms chosen for close study include two gray world methods, a limiting case of a version of the Retinex method, a number of variants of Forsyth's gamut-mapping method, Cardei et al.'s neural net method, and Finlayson et al.'s color by correlation method. We investigate the ability of these algorithms to make estimates of three different color constancy quantities: the chromaticity of the scene illuminant, the overall magnitude of that illuminant, and a corrected, illumination invariant, image. We consider algorithm performance as a function of the number of surfaces in scenes generated from reflectance spectra, the relative effect on the algorithms of added specularities, and the effect of subsequent clipping of the data. All data is available on-line at http://www.cs.sfu.ca/(tilde)color/data, and implementations for most of the algorithms are also available (http://www.cs.sfu.ca/(tilde)color/code).

[1]  Brian V. Funt,et al.  A data set for color research , 2002 .

[2]  Ron Gershon,et al.  Measurement and Analysis of Object Reflectance Spectra , 1994 .

[3]  John K. Tsotsos,et al.  From [R, G, B] to Surface Reflectance: Computing Color Constant Descriptors in Images , 1987, IJCAI.

[4]  E H Land,et al.  An alternative technique for the computation of the designator in the retinex theory of color vision. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[5]  G. Finlayson,et al.  Coefficient color constancy , 1995 .

[6]  G. Buchsbaum A spatial processor model for object colour perception , 1980 .

[7]  J. A. Worthey Limitations of color constancy , 1985 .

[8]  Graham D. Finlayson,et al.  A theory of selection for gamut mapping colour constancy , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[9]  S. McKee,et al.  Quantitative studies in retinex theory a comparison between theoretical predictions and observer responses to the “color mondrian” experiments , 1976, Vision Research.

[10]  L. Maloney,et al.  Color constancy: a method for recovering surface spectral reflectance , 1987 .

[11]  H C Lee,et al.  Method for computing the scene-illuminant chromaticity from specular highlights. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[12]  F. Frances Yao,et al.  Computational Geometry , 1991, Handbook of Theoretical Computer Science, Volume A: Algorithms and Complexity.

[13]  Brian V. Funt,et al.  Color constancy under varying illumination , 1995, Proceedings of IEEE International Conference on Computer Vision.

[14]  Brian V. Funt,et al.  Camera characterization for color research , 2002 .

[15]  Jay L. Devore,et al.  Probability and statistics for engineering and the sciences , 1982 .

[16]  E. Land Recent advances in retinex theory , 1986, Vision Research.

[17]  Graham D. Finlayson,et al.  Color in Perspective , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Vlad C. Cardei,et al.  A neural network approach to colour constancy , 2000 .

[19]  Brian V. Funt,et al.  Colour by Correlation in a Three-Dimensional Colour Space , 2000, ECCV.

[20]  E. Land The retinex theory of color vision. , 1977, Scientific American.

[21]  M. H. Brill,et al.  Necessary and sufficient conditions for Von Kries chromatic adaptation to give color constancy , 1982, Journal of mathematical biology.

[22]  Graham D. Finlayson,et al.  Color by Correlation: A Simple, Unifying Framework for Color Constancy , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  John J. McCann Magnitude of Color Shifts from Average-Quanta Catch Adaptation , 1997, Color Imaging Conference.

[24]  Graham D. Finlayson,et al.  Color by Correlation , 1997, CIC.

[25]  David A. Forsyth,et al.  A novel algorithm for color constancy , 1990, International Journal of Computer Vision.

[26]  Berthold K. P. Horn,et al.  Determining lightness from an image , 1974, Comput. Graph. Image Process..

[27]  Guillermo Sapiro,et al.  Color and Illuminant Voting , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Wayne Richard Automated detection of effective scene illuminant chromaticity from specular highlights in digital images , 1995 .

[29]  Brian V. Funt,et al.  Learning Color Constancy , 1996, CIC.

[30]  M. H. Brill,et al.  Heuristic analysis of von Kries color constancy. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[31]  G D Finlayson,et al.  Spectral sharpening: sensor transformations for improved color constancy. , 1994, Journal of the Optical Society of America. A, Optics, image science, and vision.

[32]  K Barnard,et al.  Sensor sharpening for computational color constancy. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[33]  M. D'Zmura,et al.  Color constancy. I. Basic theory of two-stage linear recovery of spectral descriptions for lights and surfaces. , 1993, Journal of the Optical Society of America. A, Optics, image science, and vision.

[34]  E H Land,et al.  Recent advances in retinex theory and some implications for cortical computations: color vision and the natural image. , 1983, Proceedings of the National Academy of Sciences of the United States of America.

[35]  D H Brainard,et al.  Bayesian color constancy. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[36]  B. Wandell,et al.  Standard surface-reflectance model and illuminant estimation , 1989 .

[37]  Kobus Barnard,et al.  Practical colour constancy , 1999 .

[38]  Shoji Tominaga Realization of Color Constancy Using the Dichromatic Reflection Model , 1994, Color Imaging Conference.

[39]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[40]  D H Brainard,et al.  Analysis of the retinex theory of color vision. , 1986, Journal of the Optical Society of America. A, Optics and image science.