Surface color perception and equivalent illumination models.

Vision provides information about the properties and identity of objects. The ease with which we perceive object properties belies the difficulty of the underlying information-processing task. In the case of object color, retinal information about object reflectance is confounded with information about the illumination as well as about the object's shape and pose. There is no obvious rule that allows transformation of the retinal image to a color representation that depends primarily on object surface reflectance. Under many circumstances, however, object color appearance is remarkably stable across scenes in which the object is viewed. Here, we review a line of experiments and theory that aim to understand how the visual system stabilizes object color appearance. Our emphasis is on models derived from explicit analysis of the computational problem of estimating the physical properties of illuminants and surfaces from the retinal image, and experiments that test these models. We argue that this approach has considerable promise for allowing generalization from simplified laboratory experiments to richer scenes that more closely approximate natural viewing. We discuss the relation between the work we review and other theoretical approaches available in the literature.

[1]  David D. Cox,et al.  Untangling invariant object recognition , 2007, Trends in Cognitive Sciences.

[2]  A. Gilchrist,et al.  When does perceived lightness depend on perceived spatial arrangement? , 1980, Perception & psychophysics.

[3]  D. Foster Color constancy , 2011, Vision Research.

[4]  B. Wandell,et al.  Color Constancy: From Physics to Appearance , 1993 .

[5]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[6]  L. Maloney,et al.  Perceived surface color in binocularly viewed scenes with two light sources differing in chromaticity. , 2004, Journal of vision.

[7]  Katja Doerschner,et al.  Cues to an equivalent lighting model. , 2006, Journal of vision.

[8]  D H Brainard,et al.  Analysis of the retinex theory of color vision. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[9]  Jeroen J. M. Granzier,et al.  Luminance-color correlation is not used to estimate the color of the illumination. , 2005, Journal of vision.

[10]  Refractor Vision , 2000, The Lancet.

[11]  W. Geisler Sequential ideal-observer analysis of visual discriminations. , 1989, Psychological review.

[12]  L. Maloney Physics-based approaches to modeling surface color perception , 1999 .

[13]  Graham D. Finlayson,et al.  Color constancy in diagonal chromaticity space , 1995, Proceedings of IEEE International Conference on Computer Vision.

[14]  V. Ramachandran,et al.  The Neurobiology of Perception , 1985, Perception.

[15]  David A. Forsyth,et al.  A novel algorithm for color constancy , 1990, International Journal of Computer Vision.

[16]  G. Leibniz,et al.  New Essays on Human Understanding. , 1981 .

[17]  David H Brainard,et al.  Surface-Illuminant Ambiguity and Color Constancy: Effects of Scene Complexity and Depth Cues , 2002, Perception.

[18]  Robin E. Hauck,et al.  An equivalent illuminant model for the effect of surface slant on perceived lightness. , 2004, Journal of vision.

[19]  L. Chalupa,et al.  The visual neurosciences , 2004 .

[20]  Henry Miller,et al.  The Neurobiology of the , 1993 .

[21]  Michael S. Landy,et al.  Computational models of visual processing , 1991 .

[22]  Jussi Parkkinen,et al.  Vector-subspace model for color representation , 1990 .

[23]  Brian A. Wandell,et al.  Illuminant Estimation: Beyond the Bases , 2000, Color Imaging Conference.

[24]  Marina G Bloj,et al.  An Empirical Study of the Traditional Mach Card Effect , 2002, Perception.

[25]  E. Bizzi,et al.  The Cognitive Neurosciences , 1996 .

[26]  Karl R Gegenfurtner,et al.  Categorical color constancy for simulated surfaces. , 2009, Journal of vision.

[27]  J. Beck,et al.  Judgments of surface illumination and lightness. , 1961, Journal of experimental psychology.

[28]  Wilson S. Geisler,et al.  A Bayesian approach to the evolution of perceptual and cognitive systems , 2003, Cogn. Sci..

[29]  L. Maloney,et al.  Color constancy: a method for recovering surface spectral reflectance , 1987 .

[30]  S. Ullman Aligning pictorial descriptions: An approach to object recognition , 1989, Cognition.

[31]  Jeroen J. M. Granzier,et al.  Can illumination estimates provide the basis for color constancy? , 2009, Journal of vision.

[32]  M. Landy,et al.  A Bilinear Model of the Illuminant's Effect on Color Appearance , 1991 .

[33]  Steven K Shevell,et al.  Stereo disparity improves color constancy , 2002, Vision Research.

[34]  A. Gray,et al.  I. THE ORIGIN OF SPECIES BY MEANS OF NATURAL SELECTION , 1963 .

[35]  D. Brainard,et al.  Luminosity thresholds: effects of test chromaticity and ambient illumination. , 1996, Journal of the Optical Society of America. A, Optics, image science, and vision.

[36]  Laurence T Maloney,et al.  Detection of light transformations and concomitant changes in surface albedo. , 2010, Journal of vision.

[37]  E. Land Recent advances in retinex theory , 1986, Vision Research.

[38]  D. Brainard,et al.  Color constancy in the nearly natural image. 2. Achromatic loci. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[39]  Robert W. Burnham,et al.  Prediction of Color Appearance with Different Adaptation Illuminations , 1957 .

[40]  D. Brainard,et al.  Mechanisms of color constancy under nearly natural viewing. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[41]  L. Maloney Evaluation of linear models of surface spectral reflectance with small numbers of parameters. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[42]  D. Krantz A theory of context effects based on cross-context matching , 1968 .

[43]  A. Logvinenko,et al.  Trade-Off between Achromatic Colour and Perceived Illumination as Revealed by the Use of Pseudoscopic Inversion of Apparent Depth , 1994, Perception.

[44]  M. D'Zmura,et al.  Color constancy. I. Basic theory of two-stage linear recovery of spectral descriptions for lights and surfaces. , 1993, Journal of the Optical Society of America. A, Optics, image science, and vision.

[45]  D. Brainard,et al.  PSYCHOLOGICAL SCIENCE Research Article LIGHTNESS CONSTANCY: A Direct Test of the Illumination-Estimation Hypothesis , 2022 .

[46]  H. B. Barlow,et al.  Possible Principles Underlying the Transformations of Sensory Messages , 2012 .

[47]  G. Buchsbaum A spatial processor model for object colour perception , 1980 .

[48]  H. Boyaci,et al.  Testing limits on matte surface color perception in three-dimensional scenes with complex light fields , 2007, Vision Research.

[49]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[50]  William Epstein,et al.  Phenomenal Orientation and Perceived Achromatic Color , 1961 .

[51]  Wilson S. Geisler,et al.  Real-world illumination measurements with a multidirectional photometer , 2010 .

[52]  Peter B. Delahunt,et al.  Bayesian model of human color constancy. , 2006, Journal of vision.

[53]  Mark S. Drew,et al.  Color constancy computation in near-Mondrian scenes using a finite dimensional linear model , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[54]  David E. Meyer,et al.  Attention and performance XIV (silver jubilee volume): synergies in experimental psychology, artificial intelligence, and cognitive neuroscience , 1993 .

[55]  Laurence T Maloney,et al.  Illuminant estimation as cue combination. , 2002, Journal of vision.

[56]  A. Gilchrist,et al.  An anchoring theory of lightness perception. , 1999 .

[57]  Peter B. Delahunt,et al.  Does human color constancy incorporate the statistical regularity of natural daylight? , 2004, Journal of vision.

[58]  Percy Williams Bridgman,et al.  The Logic of Modern Physics , 1927 .

[59]  D H Brainard,et al.  Color constancy in the nearly natural image. I. Asymmetric matches. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[60]  David H Brainard,et al.  Color and material perception: achievements and challenges. , 2010, Journal of vision.

[61]  L. Arend,et al.  Simultaneous color constancy. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[62]  Nicole C Rust,et al.  Ambiguity and invariance: two fundamental challenges for visual processing , 2010, Current Opinion in Neurobiology.

[63]  M. D'Zmura,et al.  Color constancy. II. Results for two-stage linear recovery of spectral descriptions for lights and surfaces. , 1993, Journal of the Optical Society of America. A, Optics, image science, and vision.

[64]  T. Troscianko,et al.  AI and the eye , 1990 .

[65]  Vilayanur S. Ramachandran,et al.  Theories of Perception. , 1951 .

[66]  Qasim Zaidi,et al.  Colour constancy in context: roles for local adaptation and levels of reference. , 2004, Journal of vision.

[67]  J. Beck,et al.  Apparent spatial arrangement and perceived brightness. , 1954, Journal of experimental psychology.

[68]  B. Wandell,et al.  Asymmetric color matching: how color appearance depends on the illuminant. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[69]  Karl R. Gegenfurtner,et al.  Color Vision: From Genes to Perception , 1999 .

[70]  Jeroen B. J. Smeets,et al.  True color only exists in the eye of the observer , 2003, Behavioral and Brain Sciences.

[71]  Graham D. Finlayson,et al.  Color by Correlation: A Simple, Unifying Framework for Color Constancy , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[72]  H. Helson,et al.  Fundamental problems in color vision. II. Hue, lightness, and saturation of selective samples in chromatic illumination , 1940 .

[73]  W. Geisler Sequential ideal-observer analysis of visual discriminations. , 1989 .

[74]  M D'Zmura,et al.  Color constancy. III. General linear recovery of spectral descriptions for lights and surfaces. , 1994, Journal of the Optical Society of America. A, Optics, image science, and vision.

[75]  Jon M. Speigle,et al.  Predicting color from gray: the relationship between achromatic adjustment and asymmetric matching. , 1999, Journal of the Optical Society of America. A, Optics, image science, and vision.

[76]  L. Maloney,et al.  The effect of perceived surface orientation on perceived surface albedo in binocularly viewed scenes. , 2003, Journal of vision.

[77]  Laurence T. Maloney,et al.  Illuminant cues in surface color perception: tests of three candidate cues , 2001, Vision Research.

[78]  J. Cohen Dependency of the spectral reflectance curves of the Munsell color chips , 1964 .

[79]  Simon French,et al.  Decision Making: Descriptive, Normative, and Prescriptive Interactions , 1990 .

[80]  A. Hurlbert Colour constancy , 2007, Current Biology.

[81]  A. AlanGilchrist Seeing in Black and White , 2006 .

[82]  Greg Humphreys,et al.  Physically Based Rendering: From Theory to Implementation , 2004 .

[83]  Robin E. Hauck,et al.  Measurements of the effect of surface slant on perceived lightness. , 2004, Journal of vision.

[84]  D. Foster,et al.  Relational colour constancy from invariant cone-excitation ratios , 1994, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[85]  P. Vernon The World of Colour , 1935 .

[86]  Laurence T. Maloney,et al.  Color constancy and color perception: the linear-models framework , 1993 .

[87]  J. Beck Surface color perception , 1972 .

[88]  D. B. Judd,et al.  Spectral Distribution of Typical Daylight as a Function of Correlated Color Temperature , 1964 .

[89]  S. McKee,et al.  Quantitative studies in retinex theory a comparison between theoretical predictions and observer responses to the “color mondrian” experiments , 1976, Vision Research.

[90]  D H Brainard,et al.  Bayesian color constancy. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[91]  D. Brainard,et al.  Surface gloss and color perception of 3D objects , 2008, Visual Neuroscience.