A neural field model for color perception unifying assimilation and contrast

We address the question of color-space interactions in the brain, by proposing a neural field model of color perception with spatial context for the visual area V1 of the cortex. Our framework reconciles two opposing perceptual phenomena, known as simultaneous contrast and chromatic assimilation. They have been previously shown to act synergistically, so that at some point in an image, the color seems perceptually more similar to that of adjacent neighbors, while being more dissimilar from that of remote ones. Thus, their combined effects are enhanced in the presence of a spatial pattern, and can be measured as larger shifts in color matching experiments. Our model supposes a hypercolumnar structure coding for colors in V1, and relies on the notion of color opponency introduced by Hering. The connectivity kernel of the neural field exploits the balance between attraction and repulsion in color and physical spaces, so as to reproduce the sign reversal in the influence of neighboring points. The color sensation at a point, defined from a steady state of the neural activities, is then extracted as a nonlinear percept conveyed by an assembly of neurons. It connects the cortical and perceptual levels, because we describe the search for a color match in asymmetric matching experiments as a mathematical projection on color sensations. We validate our color neural field alongside this color matching framework, by performing a multi-parameter regression to data produced by psychophysicists and ourselves. All the results show that we are able to explain the nonlinear behavior of shifts observed along one or two dimensions in color space, which cannot be done using a simple linear model.

[1]  H. Wallach Brightness constancy and the nature of achromatic colors. , 1948, Journal of experimental psychology.

[2]  D. Jameson,et al.  An opponent-process theory of color vision. , 1957, Psychological review.

[3]  D. Hubel,et al.  Receptive fields of single neurones in the cat's striate cortex , 1959, The Journal of physiology.

[4]  A. Linksz Outlines of a Theory of the Light Sense. , 1965 .

[5]  R. L. Valois,et al.  Analysis of response patterns of LGN cells. , 1966, Journal of the Optical Society of America.

[6]  D. Hubel,et al.  Spatial and chromatic interactions in the lateral geniculate body of the rhesus monkey. , 1966, Journal of neurophysiology.

[7]  W D Wright,et al.  Color Science, Concepts and Methods. Quantitative Data and Formulas , 1967 .

[8]  J. Cohen,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulas , 1968 .

[9]  郁夫 藤村,et al.  色対比と Color Appearance , 1970 .

[10]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[11]  P. O. Bishop,et al.  Spatial vision. , 1971, Annual review of psychology.

[12]  W. Rushton Review Lecture. Pigments and signals in colour vision , 1972 .

[13]  W. Rushton Pigments and signals in colour vision. , 1972, The Journal of physiology.

[14]  J. Walraven Spatial characteristics of chromatic induction; the segregation of lateral effects from straylight artefacts. , 1973, Vision research.

[15]  H. L. Resnikoff Differential geometry and color perception , 1974 .

[16]  E. Schwartz The development of specific visual connections in the monkey and the goldfish: outline of a geometric theory of receptotopic structure. , 1977, Journal of theoretical biology.

[17]  Donald P. Greenberg,et al.  Color spaces for computer graphics , 1978, SIGGRAPH.

[18]  J. Movshon,et al.  Spatial and temporal contrast sensitivity of neurones in areas 17 and 18 of the cat's visual cortex. , 1978, The Journal of physiology.

[19]  O. Faugeras Digital color image processing within the framework of a human visual model , 1979 .

[20]  R. M. Boynton,et al.  Chromaticity diagram showing cone excitation by stimuli of equal luminance. , 1979, Journal of the Optical Society of America.

[21]  W. Cowan,et al.  Changes in perceived color due to chromatic interactions , 1982, Vision Research.

[22]  G. Wyszecki,et al.  Color Science Concepts and Methods , 1982 .

[23]  P. Lennie,et al.  Chromatic mechanisms in lateral geniculate nucleus of macaque. , 1984, The Journal of physiology.

[24]  D. Hubel,et al.  Anatomy and physiology of a color system in the primate visual cortex , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[25]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[26]  M. B. Mandler,et al.  Mechanisms of simultaneous color induction. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[27]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[28]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[29]  D. Hubel,et al.  Segregation of form, color, movement, and depth: anatomy, physiology, and perception. , 1988, Science.

[30]  John J. McCann,et al.  The Role Of Simple Nonlinear Operations In Modeling Human Lightness And Color Sensations , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[31]  S. Shevell,et al.  Color perception within a chromatic context: the effect of short-wavelength light on color appearance , 1994, Vision Research.

[32]  H. Sompolinsky,et al.  Theory of orientation tuning in visual cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[33]  B. Wandell,et al.  Photoreceptor sensitivity changes explain color appearance shifts induced by large uniform backgrounds in dichoptic matching , 1995, Vision Research.

[34]  C. L. Hardin,et al.  Color categories in thought and language: Author index , 1997 .

[35]  R. D'Andrade,et al.  Color categories in thought and language: It's not really red, green, yellow, blue: an inquiry into perceptual color space , 1997 .

[36]  D. Macleod,et al.  Color appearance depends on the variance of surround colors , 1997, Current Biology.

[37]  B. Ermentrout Neural networks as spatio-temporal pattern-forming systems , 1998 .

[38]  Terrence J. Sejnowski,et al.  Seeing White: Qualia in the Context of Decoding Population Codes , 1999, Neural Computation.

[39]  A. Shepherd Remodelling colour contrast: implications for visual processing and colour representation , 1999, Vision Research.

[40]  M. Golubitsky,et al.  Geometric visual hallucinations, Euclidean symmetry and the functional architecture of striate cortex. , 2001, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[41]  Phil Q. Jin,et al.  The role of spatial frequency in color induction , 2001, Vision Research.

[42]  The spatial transformation of color in the primary visual cortex of the macaque monkey , 2001 .

[43]  M. Aminoff Principles of Neural Science. 4th edition , 2001 .

[44]  J. Cowan,et al.  SO3 symmetry breaking mechanism for orientation and spatial frequency tuning in the visual cortex. , 2002, Physical review letters.

[45]  J. Lund,et al.  Anatomical substrates for functional columns in macaque monkey primary visual cortex. , 2003, Cerebral cortex.

[46]  T. Sejnowski,et al.  Representation of Color Stimuli in Awake Macaque Primary Visual Cortex , 2003, Neuron.

[47]  Charles Poynton,et al.  Digital Video and HDTV Algorithms and Interfaces , 2012 .

[48]  J. Cowan,et al.  Erratum: A spherical model for orientation and spatial-frequency tuning in a cortical hypercolumn (Philosophical Transactions of the Royal Society of London Series B (October 29, 2003) 357 (1643-1667)) , 2003 .

[49]  P. Bressloff Spatially periodic modulation of cortical patterns by long-range horizontal connections , 2003 .

[50]  B. Pinna,et al.  The watercolor effect: a new principle of grouping and figure–ground organization , 2003, Vision Research.

[51]  J. Cowan,et al.  A spherical model for orientation and spatial-frequency tuning in a cortical hypercolumn. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[52]  J. Cowan,et al.  The functional geometry of local and horizontal connections in a model of V1 , 2003, Journal of Physiology-Paris.

[53]  S. Amari Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[54]  S. Shevell,et al.  Chromatic induction from S-cone patterns , 2004, Vision Research.

[55]  Pascual Capilla,et al.  Corresponding-pair procedure: a new approach to simulation of dichromatic color perception. , 2004, Journal of the Optical Society of America. A, Optics, image science, and vision.

[56]  M. Rudd,et al.  Quantitative properties of achromatic color induction: An edge integration analysis , 2004, Vision Research.

[57]  J. Cowan,et al.  A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue , 1973, Kybernetik.

[58]  S. Shevell,et al.  Color shifts from S-cone patterned backgrounds: contrast sensitivity and spatial frequency selectivity , 2005, Vision Research.

[59]  Alessandro Rizzi,et al.  Mathematical definition and analysis of the retinex algorithm. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[60]  N. Newman The Visual Neurosciences , 2005 .

[61]  Paul C. Bressloff,et al.  Spontaneous symmetry breaking in self–organizing neural fields , 2005, Biological Cybernetics.

[62]  R. Lenz Spectral Color Spaces : Their Structure and Transformations , 2005 .

[63]  R. Shapley,et al.  Brightness contrast inhibits color induction: evidence for a new kind of color theory. , 2006, Spatial vision.

[64]  Reiner Lenz,et al.  The Hyperbolic Geometry of Illumination-Induced Chromaticity Changes , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[65]  D. Hubel Blobs and color vision , 2007, Cell Biophysics.

[66]  Jun Xiao,et al.  Hue maps in primate striate cortex , 2007, NeuroImage.

[67]  R. Shapley,et al.  The Orientation Selectivity of Color-Responsive Neurons in Macaque V1 , 2008, The Journal of Neuroscience.

[68]  P. Monnier Standard definitions of chromatic induction fail to describe induction with S-cone patterned backgrounds , 2008, Vision Research.

[69]  Mukta Paliwal,et al.  Neural networks and statistical techniques: A review of applications , 2009, Expert Syst. Appl..

[70]  Olivier P. Faugeras,et al.  Hyperbolic Planforms in Relation to Visual Edges and Textures Perception , 2009, PLoS Comput. Biol..

[71]  Eric Dubois The Structure and Properties of Color Spaces and the Representation of Color Images , 2009, The Structure and Properties of Color Spaces and the Representation of Color Images.

[72]  Daniel Y. Ts’o,et al.  Whither the hypercolumn? , 2009, The Journal of physiology.

[73]  M. Rudd How attention and contrast gain control interact to regulate lightness contrast and assimilation: a computational neural model. , 2010, Journal of vision.

[74]  Bevil R. Conway,et al.  Advances in Color Science: From Retina to Behavior , 2010, The Journal of Neuroscience.

[75]  Olivier D. Faugeras,et al.  Local/Global Analysis of the Stationary Solutions of Some Neural Field Equations , 2009, SIAM J. Appl. Dyn. Syst..

[76]  D. Foster Color constancy , 2011, Vision Research.

[77]  Devis Tuia,et al.  Remote Sensing Image Processing. Synthesis Lectures on Image, Video, and Multimedia Processing. , 2011 .

[78]  Paul C. Bressloff,et al.  Neural field model of binocular rivalry waves , 2012, Journal of Computational Neuroscience.

[79]  Richard Courant,et al.  Wiley Classics Library , 2011 .

[80]  R. Shapley,et al.  Color in the Cortex: single- and double-opponent cells , 2011, Vision Research.

[81]  P. Bressloff Spatiotemporal dynamics of continuum neural fields , 2012 .

[82]  Stephen Coombes,et al.  Neural fields : theory and applications , 2014 .

[83]  P. Bressloff Waves in Neural Media , 2014 .

[84]  Roland Potthast,et al.  Tutorial on Neural Field Theory , 2014 .

[85]  Daniel Bennequin,et al.  Remarks on Invariance in the Primary Visual Systems of Mammals , 2014 .

[86]  Marc Ebner,et al.  Color Constancy , 2007, Computer Vision, A Reference Guide.

[87]  Marcelo Bertalmío,et al.  From image processing to computational neuroscience: a neural model based on histogram equalization , 2014, Front. Comput. Neurosci..

[88]  Elena Yu. Smirnova,et al.  A mathematical model of color and orientation processing in V1 , 2015, Biological Cybernetics.

[89]  O. Faugeras,et al.  On the Effects on Cortical Spontaneous Activity of the Symmetries of the Network of Pinwheels in Visual Area V1 , 2015, Journal of mathematical neuroscience.

[90]  N. Justin Marshall,et al.  Human Color Vision , 2016, Springer Series in Vision Research.

[91]  E. Provenzi A differential geometry model for the perceived colors space , 2016 .

[92]  Steffen Beich,et al.  Digital Video And Hdtv Algorithms And Interfaces , 2016 .

[93]  Gorjan Alagic,et al.  #p , 2019, Quantum information & computation.

[94]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[95]  G. Gronchi,et al.  A variational model for context-driven effects in perception and cognition , 2017 .

[96]  Hedva Spitzer,et al.  Neuronal Mechanism for Compensation of Longitudinal Chromatic Aberration-Derived Algorithm , 2018, Front. Bioeng. Biotechnol..

[97]  J. Krauskopf,et al.  Cone Contrast and Opponent Modulation Color Spaces 565 ( a ) , 2022 .