Lightness computation by the human visual system

Abstract. A model of achromatic color computation by the human visual system is presented, which is shown to account in an exact quantitative way for a large body of appearance matching data collected with simple visual displays. The model equations are closely related to those of the original Retinex model of Land and McCann. However, the present model differs in important ways from Land and McCann’s theory in that it invokes additional biological and perceptual mechanisms, including contrast gain control, different inherent neural gains for incremental, and decremental luminance steps, and two types of top-down influence on the perceptual weights applied to local luminance steps in the display: edge classification and spatial integration attentional windowing. Arguments are presented to support the claim that these various visual processes must be instantiated by a particular underlying neural architecture. By pointing to correspondences between the architecture of the model and findings from visual neurophysiology, this paper suggests that edge classification involves a top-down gating of neural edge responses in early visual cortex (cortical areas V1 and/or V2) while spatial integration windowing occurs in cortical area V4 or beyond.

[1]  H E Smithson,et al.  Sensory, computational and cognitive components of human colour constancy , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[2]  S Marcelja,et al.  Mathematical description of the responses of simple cortical cells. , 1980, Journal of the Optical Society of America.

[3]  E H Land,et al.  An alternative technique for the computation of the designator in the retinex theory of color vision. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Christiane B Wiebel,et al.  Testing the role of Michelson contrast for the perception of surface lightness. , 2016, Journal of vision.

[5]  D. Stubbs,et al.  A New Set of Illusions—the Dynamic Luminance-Gradient Illusion and the Breathing Light Illusion , 2006, Perception.

[6]  R Shapley,et al.  Contrast and assimilation in the perception of brightness. , 1985, Proceedings of the National Academy of Sciences of the United States of America.

[7]  H. Helson.  Studies of anomalous contrast and assimilation. , 1963, Journal of the Optical Society of America.

[8]  J. P. Jones,et al.  An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[9]  S. Zeki,et al.  The architecture of the colour centre in the human visual brain: new results and a review * , 2000, The European journal of neuroscience.

[10]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[11]  J M Kennedy,et al.  Sun Figure: An Illusory Diffuse Contour Resulting from an Arrangement of Dots , 1976, Perception.

[12]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[13]  M. Rudd,et al.  Darkness filling-in: a neural model of darkness induction , 2001, Vision Research.

[14]  Anitha Pasupathy,et al.  Equiluminance Cells in Visual Cortical Area V4 , 2011, The Journal of Neuroscience.

[15]  Lin-Juan Cong,et al.  Perceptual learning of contrast discrimination under roving: the role of semantic sequence in stimulus tagging. , 2014, Journal of vision.

[16]  E H Land,et al.  Recent advances in retinex theory and some implications for cortical computations: color vision and the natural image. , 1983, Proceedings of the National Academy of Sciences of the United States of America.

[17]  Robert W. Kentridge,et al.  Chromatic edges, surfaces and constancies in cerebral achromatopsia , 2004, Neuropsychologia.

[18]  M. McCourt,et al.  A unified theory of brightness contrast and assimilation incorporating oriented multiscale spatial filtering and contrast normalization , 2004, Vision Research.

[19]  M. Rudd.  Edge integration in achromatic color perception and the lightness-darkness asymmetry. , 2013, Journal of vision.

[20]  M. McCourt,et al.  Oriented multiscale spatial filtering and contrast normalization: a parsimonious model of brightness induction in a continuum of stimuli including White, Howe and simultaneous brightness contrast , 2005, Vision Research.

[21]  M. Kuefer.  Psychophysics Introduction To Its Perceptual Neural And Social Prospects , 2016 .

[22]  Michael E. Rudd,et al.  Progress on a computational model of achromatic color processing , 2003, IS&T/SPIE Electronic Imaging.

[23]  V. Walsh,et al.  How does the cortex construct color? , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[24]  K. Naka,et al.  S‐potentials from colour units in the retina of fish (Cyprinidae) , 1966, The Journal of physiology.

[25]  M. Rudd,et al.  The highest luminance anchoring rule in achromatic color perception: some counterexamples and an alternative theory. , 2005, Journal of vision.

[26]  D. Hubel,et al.  Receptive fields of single neurones in the cat's striate cortex , 1959, The Journal of physiology.

[27]  Qasim Zaidi,et al.  Neuronal nonlinearity explains greater visual spatial resolution for darks than lights , 2014, Proceedings of the National Academy of Sciences.

[28]  T. Agostini,et al.  A new effect of luminance gradient on achromatic simultaneous contrast , 2002, Psychonomic bulletin & review.

[29]  M. Rudd,et al.  Quantitative properties of achromatic color induction: An edge integration analysis , 2004, Vision Research.

[30]  M. McCourt,et al.  A multiscale spatial filtering account of the White effect, simultaneous brightness contrast and grating induction , 1999, Vision Research.

[31]  H. Wallach,et al.  The perception of neutral colors. , 1963, Scientific American.

[32]  S. Zeki,et al.  Three cortical stages of colour processing in the human brain. , 1998, Brain : a journal of neurology.

[33]  M. Rudd,et al.  Stevens's brightness law, contrast gain control, and edge integration in achromatic color perception: a unified model. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[34]  Alan Cowey,et al.  Colour constancy impairments in patients with lesions of the prestriate cortex , 1998, Experimental Brain Research.

[35]  J. P. Jones,et al.  The two-dimensional spatial structure of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[36]  A. Gilchrist,et al.  Relative area and relative luminance combine to anchor surface lightness values , 1999, Perception & psychophysics.

[37]  R. Shapley,et al.  Brightness induction by local contrast and the spatial dependence of assimilation , 1988, Vision Research.

[38]  E. G. Heinemann,et al.  Simultaneous brightness induction as a function of inducing and test-field luminances. , 1955, Journal of experimental psychology.

[39]  J. Daugman.  Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[40]  Michael E. Rudd,et al.  Lightness computation by a neural filling-in mechanism , 2001, IS&T/SPIE Electronic Imaging.

[41]  S. Zeki,et al.  The neurological basis of conscious color perception in a blind patient. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[42]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[43]  M. McCourt,et al.  A multiscale spatial filtering account of the Wertheimer–Benary effect and the corrugated Mondrian , 2001, Vision Research.

[44]  M. Rudd,et al.  Contrast polarity and edge integration in achromatic color perception. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[45]  A. Gilchrist,et al.  An anchoring theory of lightness perception. , 1999 .

[46]  Frederick A.A. Kingdom,et al.  Lightness, brightness and transparency: A quarter century of new ideas, captivating demonstrations and unrelenting controversy , 2011, Vision Research.

[47]  Alessandro Rizzi,et al.  The Art and Science of HDR Imaging: McCann/The Art and Science of HDR Imaging , 2011 .

[48]  H. Helson.  Some Factors and Implications of Color Constancy , 1943 .

[49]  Barbara Blakeslee,et al.  The Oriented Difference of Gaussians (ODOG) model of brightness perception: Overview and executable Mathematica notebooks , 2015, Behavior Research Methods.

[50]  B. Anderson,et al.  Lightness, brightness, and anchoring. , 2014, Journal of vision.

[51]  L. Arend,et al.  Lightness, brightness, and brightness contrast: 2. Reflectance variation , 1993, Perception & psychophysics.

[52]  MichaelE Rudd,et al.  Retinex-like computations in human lightness perception and their possible realization in visual cortex , 2016 .

[53]  D Zavagno,et al.  Some New Luminance-Gradient Effects , 1999, Perception.

[54]  A. Gilchrist,et al.  Lightness perception in simple images: testing the anchoring rules. , 2014, Journal of vision.

[55]  Barbara Blakeslee,et al.  The Oriented Difference-of-Gaussians Model of Brightness Perception , 2016 .

[56]  H. Wallach.  Brightness constancy and the nature of achromatic colors. , 1948, Journal of experimental psychology.

[57]  A. AlanGilchrist.  Seeing in Black and White , 2006 .

[58]  Alan E. Robinson,et al.  Explaining brightness illusions using spatial filtering and local response normalization , 2007, Vision Research.

[59]  M. A. Repucci,et al.  Spatial Structure and Symmetry of Simple-Cell Receptive Fields in Macaque Primary Visual Cortex , 2002 .

[60]  K H Ruddock,et al.  Colour identification and colour constancy are impaired in a patient with incomplete achromatopsia associated with prestriate cortical lesions , 1995, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[61]  D. Hubel,et al.  Colour-generating interactions across the corpus callosum , 1983, Nature.

[62]  Kuntal Ghosh,et al.  A parsimonious model of brightness induction , 2018, Biological Cybernetics.

[63]  M. Rudd.  How attention and contrast gain control interact to regulate lightness contrast and assimilation: a computational neural model. , 2010, Journal of vision.

[64]  John J. McCann,et al.  Retinex at 50: color theory and spatial algorithms, a review , 2017, J. Electronic Imaging.

[65]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[66]  T. Agostini,et al.  The phantom illusion , 2015, Vision Research.

[67]  A. Gilchrist,et al.  Anchoring of lightness values by relative luminance and relative area. , 2009, Journal of vision.

[68]  L. Arend,et al.  Lightness, brightness, and brightness contrast: 1. Illuminance variation , 1993, Perception & psychophysics.

[69]  Luminance gradients, perceived illumination, and lightness perception. , 1997 .

[70]  M. McCourt,et al.  A Multiscale Filtering Explanation of Gradient Induction and Remote Brightness Induction Effects: A Reply to Logvinenko (2003) , 2005, Perception.

[71]  Michael E. Rudd,et al.  A cortical edge-integration model of object-based lightness computation that explains effects of spatial context and individual differences , 2014, Front. Hum. Neurosci..

[72]  M. McCourt,et al.  A Multiscale Spatial Filtering Account of Brightness Phenomena , 2003 .