Supervised color constancy using a color chart

One of the key problems in machine vision is color constancy: the ability to match object colors in images taken under different colors of illumination. This is a difficult problem because the apparent color will depend upon the spectral reflectance function of the object and the spectral distribution function of the incident light, both of which are generally unknown. Methods to solve this problem use a small number of basis functions to represent the two functions, and some sort of reference knowledge to allow the calculation of the coefficients. Most methods have the weakness that the reference property may not actually hold for all images, or will have too little information to recover enough of the functions to make an accurate determination of what the color should be. We have developed a method for color constancy that uses a color chart of known spectral characteristics to give stronger reference criteria, and with a large number of colors to give enough information to calculate the illuminant to the desired degree of accuracy. We call this approach "supervised color constancy" since the process is supervised by a picture of a known color chart. We present here two methods for computing supervised color constancy, one using least squares estimation, the other using a neural network. We show experimental results for the supervised calculation of the spectral power distribution of an unknown illuminant. Once this has been calculated, the color of any object with known reflectance can be reliably predicted. We arc developing an extension to allow the prediction of color appearance for an object whose spectral reflectance function is not known. We also propose a method of "incremental color constancy" which determines object color by repeated application of supervised color constancy under changing illumination.

[1]  J. Parkkinen,et al.  Characteristic spectra of Munsell colors , 1989 .

[2]  Stuart C. Shapiro,et al.  Encyclopedia of artificial intelligence, vols. 1 and 2 (2nd ed.) , 1992 .

[3]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[4]  Tomaso Poggio,et al.  Synthesizing a color algorithm from examples , 1988 .

[5]  L. Maloney Evaluation of linear models of surface spectral reflectance with small numbers of parameters. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[6]  A. Sanders Optical radiation measurements , 1985 .

[7]  A. H. Munsell,et al.  Munsell book of color , 1950 .

[8]  Steven A. Shafer,et al.  Obtaining accurate color images for machine-vision research , 1990, Electronic Imaging.

[9]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[10]  W. Budde Physical detectors of optical radiation , 1983 .

[11]  R. Gershon The use of color in computational vision , 1987 .

[12]  Brian A. Wandell,et al.  The Synthesis and Analysis of Color Images , 1992, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Tomaso A. Poggio,et al.  Learning a Color Algorithm from Examples , 1987, NIPS.

[14]  E. Land The retinex theory of color vision. , 1977, Scientific American.

[15]  Glenn Healey,et al.  A color metric for computer vision , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Sang Wook Lee,et al.  Image Segmentation with Detection of Highlights and Inter-Reflections Using Color , 1989 .

[17]  B. Wandell,et al.  Standard surface-reflectance model and illuminant estimation , 1989 .

[18]  Leo Maurice Hurvich,et al.  Color vision , 1981 .

[19]  S. Shafer Describing light mixtures through linear algebra , 1982 .

[20]  L. Maloney,et al.  Color constancy: a method for recovering surface spectral reflectance. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[21]  James L. McClelland,et al.  James L. McClelland, David Rumelhart and the PDP Research Group, Parallel distributed processing: explorations in the microstructure of cognition . Vol. 1. Foundations . Vol. 2. Psychological and biological models . Cambridge MA: M.I.T. Press, 1987. , 1989, Journal of Child Language.

[22]  M D'Zmura,et al.  Mechanisms of color constancy. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[23]  Günter Wyszecki,et al.  Evaluation of Metameric Colors , 1958 .

[24]  B. Wandell,et al.  Component estimation of surface spectral reflectance , 1990 .