Color constancy in variegated scenes: role of low-level mechanisms in discounting illumination changes.

For a visual system to possess color constancy across varying illumination, chromatic signals from a scene must remain constant at some neural stage. We found that photoreceptor and opponent-color signals from a large sample of natural and man-made objects under one kind of natural daylight were almost perfectly correlated with the signals from those objects under every other spectrally different phase of daylight. Consequently, in scenes consisting of many objects, the effect of illumination changes on specific color mechanisms can be simulated by shifting all chromaticities by an additive or multiplicative constant along a theoretical axis. When the effect of the illuminant change was restricted to specific color mechanisms, thresholds for detecting a change in the colors in a scene were significantly elevated in the presence of spatial variations along the same chromatic axis as the simulated chromaticity shift. In a variegated scene, correlations between spatially local chromatic signals across illuminants, and the desensitization caused by eye movements across spatial variations, help the visual system to attenuate the perceptual effects that are due to changes in illumination.

[1]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[2]  J. Endler.  The Color of Light in Forests and Its Implications , 1993 .

[3]  R. Shapley,et al.  Spatial structure of cone inputs to receptive fields in primate lateral geniculate nucleus , 1992, Nature.

[4]  M. S. Drew,et al.  Color constancy - Generalized diagonal transforms suffice , 1994 .

[5]  D. B. Judd.  Hue Saturation and Lightness of Surface Colors with Chromatic Illumination , 1940 .

[6]  Michael H. Brill,et al.  The relation between the color of the illuminant and the color of the illuminated object , 1995 .

[7]  Qasim Zaidi,et al.  Visual mechanisms that signal the direction of color changes , 1993, Vision Research.

[8]  P. Lennie,et al.  Chromatic mechanisms in striate cortex of macaque , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  Leif H. Finkel,et al.  Network simulations of retinal and cortical contributions to color constancy , 1995, Vision Research.

[10]  R. Carpenter,et al.  Movements of the Eyes , 1978 .

[11]  L. Arend,et al.  Simultaneous color constancy. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[12]  B. Wandell,et al.  Asymmetric color matching: how color appearance depends on the illuminant. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[13]  Wilson S. Geisler,et al.  Color as a source of information in the stereo correspondence process , 1990, Vision Research.

[14]  M. D'Zmura,et al.  Color constancy. I. Basic theory of two-stage linear recovery of spectral descriptions for lights and surfaces. , 1993, Journal of the Optical Society of America. A, Optics, image science, and vision.

[15]  J. A. Worthey.  Limitations of color constancy , 1985 .

[16]  A. Valberg,et al.  “Colour constancy” in Mondrian patterns: A partial cancellation of physical chromaticity shifts by simultaneous contrast , 1990, Vision Research.

[17]  J. H. Hateren.  Spatial, temporal and spectral pre-processing for colour vision , 1993 .

[18]  David H. Foster,et al.  An operational approach to colour constancy , 1992, Vision Research.

[19]  D. W. Heeley,et al.  Cardinal directions of color space , 1982, Vision Research.

[20]  L. Maloney.  Evaluation of linear models of surface spectral reflectance with small numbers of parameters. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[21]  R. M. Boynton,et al.  Chromaticity diagram showing cone excitation by stimuli of equal luminance. , 1979, Journal of the Optical Society of America.

[22]  J. Pokorny,et al.  Appearance of steadily viewed lights , 1987, Vision Research.

[23]  M D'Zmura,et al.  Detection of contrary chromatic change. , 1994, Journal of the Optical Society of America. A, Optics, image science, and vision.

[24]  G. Finlayson,et al.  COEFFICIENT CHANNELS : DERIVATION AND RELATIONSHIP TO OTHER THEORETICAL STUDIES , 1996 .

[25]  S. McKee,et al.  Quantitative studies in retinex theory a comparison between theoretical predictions and observer responses to the “color mondrian” experiments , 1976, Vision Research.

[26]  James L. Dannemiller,et al.  Rank orderings of photoreceptor photon catches from natural objects are nearly illuminant-invariant , 1993, Vision Research.

[27]  M. B. Mandler,et al.  Mechanisms of simultaneous color induction. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[28]  N. Graham.  Visual Pattern Analyzers , 1989 .

[29]  A. H. Taylor,et al.  The Distribution of Energy in the Visible Spectrum of Daylight , 1941 .

[30]  Marcel P. Lucassen,et al.  Testing the Contrast Explanation of Color Constancy , 1991 .

[31]  Q. Zaidi.  Parallel and Serial Connections Between Human Color Mechanisms , 1992 .

[32]  Ron Gershon,et al.  Measurement and Analysis of Object Reflectance Spectra , 1994 .

[33]  Drew,et al.  Enhancing von Kries Adaptation via Sensor Transformations , 1993 .

[34]  Mark D. Fairchild,et al.  Chromatic adaptation to natural and incandescent illuminants , 1992, Vision Research.

[35]  Mark S. Drew,et al.  Color constancy: enhancing von Kries adaption via sensor transformations , 1993, Electronic Imaging.

[36]  B. Spehar,et al.  Brightness Induction from Uniform and Complex Surrounds: A General Model , 1996, Vision Research.

[37]  M. D'Zmura,et al.  Color constancy. II. Results for two-stage linear recovery of spectral descriptions for lights and surfaces. , 1993, Journal of the Optical Society of America. A, Optics, image science, and vision.

[38]  Mary Hayhoe,et al.  Adaptation Mechanisms in Color and Brightness , 1991 .

[39]  J L Dannemiller,et al.  Computational approaches to color constancy: adaptive and ontogenetic considerations. , 1989, Psychological review.

[40]  Steven K. Shevell,et al.  Color appearance with sparse chromatic context , 1995, Vision Research.

[41]  L. Maloney,et al.  Color constancy: a method for recovering surface spectral reflectance. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[42]  P. Lennie,et al.  Spatial frequency analysis in the visual system. , 1985, Annual review of neuroscience.

[43]  E H Land,et al.  Recent advances in retinex theory and some implications for cortical computations: color vision and the natural image. , 1983, Proceedings of the National Academy of Sciences of the United States of America.

[44]  P. Lennie,et al.  Chromatic mechanisms in lateral geniculate nucleus of macaque. , 1984, The Journal of physiology.

[45]  M H Brill,et al.  Image segmentation by object color: a unifying framework and connection to color constancy. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[46]  Qasim Zaidi,et al.  Lateral interactions within color mechanism in simultaneous induced contrast , 1992, Vision Research.

[47]  J. Pokorny,et al.  Spectral sensitivity of the foveal cone photopigments between 400 and 500 nm , 1975, Vision Research.

[48]  Graham D. Finlayson,et al.  Color in Perspective , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[49]  M D'Zmura,et al.  Mechanisms of color constancy. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[50]  D. Foster,et al.  Relational colour constancy from invariant cone-excitation ratios , 1994, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[51]  W L Sachtler,et al.  Chromatic and luminance signals in visual memory. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[52]  M. H. Brill,et al.  Necessary and sufficient conditions for Von Kries chromatic adaptation to give color constancy , 1982, Journal of mathematical biology.