Diagonal Transforms Suuce for Color Constancy

This paper's main result is to show that under the conditions imposed by the Maloney-Wandell color constancy algorithm, color constancy can in fact be expressed in terms of a simple independent adjustment of the sensor responses|in other words as a von Kries adaptation type of coeecient rule algorithm|so long as the sensor space is rst transformed to a new basis. Our overall goal is to present a theoretical analysis connecting many established theories of color constancy. For the case where surface reeectances are 2-dimensional and illu-minants are 3-dimensional, we prove that perfect colour constancy can always be solved for by an independent adjustment of sensor responses, which means that the colour constancy transform can be expressed as a diagonal matrix. This result requires a prior transformation of the sensor basis and to support it we show in particular that there exists a transformation of the original sensor basis under which the non-diagonal methods of Maloney-Wandell, Forsyth's MWEXT and Funt and Drew's lightness algorithm all reduce to simpler, diagonal-matrix theories of colour constancy. Our results are strong in the sense that no constraint is placed on the initial sensor spectral sensitivities. In addition to purely theoretical arguments, the paper contains results from simulations of diagonal-matrix-based color constancy in which the spectra of real illuminants and reeectances along with the human cone sensitivity functions are used. The simulations demonstrate that when the cone sensor space is transformed to its new basis in the appropriate manner, a diagonal matrix supports close to optimal colour constancy.

[1]  D. B. Judd,et al.  Final Report of the O.S.A. Subcommittee on the Spacing of the Munsell Colors , 1943 .

[2]  D. B. Judd,et al.  Spectral Distribution of Typical Daylight as a Function of Correlated Color Temperature , 1964 .

[3]  J. Cohen Dependency of the spectral reflectance curves of the Munsell color chips , 1964 .

[4]  W D Wright,et al.  Color Science, Concepts and Methods. Quantitative Data and Formulas , 1967 .

[5]  J. J. Vos,et al.  On the derivation of the foveal receptor primaries. , 1971, Vision research.

[6]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[7]  R. Harwerth,et al.  Red-Green Cone Interactions in the Increment-Threshold Spectral Sensitivity of Primates , 1971, Science.

[8]  E. Land The retinex theory of color vision. , 1977, Scientific American.

[9]  M. H. Brill,et al.  A device performing illuminant-invariant assessment of chromatic relations. , 1978, Journal of theoretical biology.

[10]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[11]  Andrew Blake,et al.  Boundary conditions for lightness computation in Mondrian World , 1985, Comput. Vis. Graph. Image Process..

[12]  L. Maloney,et al.  Color constancy: a method for recovering surface spectral reflectance. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[13]  A Hurlbert,et al.  Formal connections between lightness algorithms. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[14]  L. Maloney Evaluation of linear models of surface spectral reflectance with small numbers of parameters. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[15]  Frank C. H Tong,et al.  Specularity removal for shape-from-shading , 1987 .

[16]  Mark S. Drew,et al.  Color constancy computation in near-Mondrian scenes using a finite dimensional linear model , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  B A Wandell,et al.  Task-dependent color discrimination. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[18]  Michael J. Swain,et al.  Indexing via color histograms , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[19]  R. Harwerth,et al.  Spectral sensitivity and adaptation characteristics of cone mechanisms under white-light adaptation. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[20]  Mark S. Drew,et al.  Color Space Analysis of Mutual Illumination , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Drew,et al.  Enhancing von Kries Adaptation via Sensor Transformations , 1993 .

[22]  Brian V. Funt,et al.  Color Constant Color Indexing , 1995, IEEE Trans. Pattern Anal. Mach. Intell..