The physiology and psychophysics of the color-form relationship: a review

The relationship between color and form has been a long standing issue in visual science. A picture of functional segregation and topographic clustering emerges from anatomical and electrophysiological studies in animals, as well as by brain imaging studies in human. However, one of the many roles of chromatic information is to support form perception, and in some cases it can do so in a way superior to achromatic (luminance) information. This occurs both at an early, contour-detection stage, as well as in late, higher stages involving spatial integration and the perception of global shapes. Pure chromatic contrast can also support several visual illusions related to form-perception. On the other hand, form seems a necessary prerequisite for the computation and assignment of color across space, and there are several respects in which the color of an object can be influenced by its form. Evidently, color and form are mutually dependent. Electrophysiological studies have revealed neurons in the visual brain able to signal contours determined by pure chromatic contrast, the spatial tuning of which is similar to that of neurons carrying luminance information. It seems that, especially at an early stage, form is processed by several, independent systems that interact with each other, each one having different tuning characteristics in color space. At later processing stages, mechanisms able to combine information coming from different sources emerge. A clear interaction between color and form is manifested by the fact that color-form contingencies can be observed in various perceptual phenomena such as adaptation aftereffects and illusions. Such an interaction suggests a possible early binding between these two attributes, something that has been verified by both electrophysiological and fMRI studies.

[1]  Hidehiko Komatsu,et al.  Target Selection in Area V4 during a Multidimensional Visual Search Task , 2004, The Journal of Neuroscience.

[2]  H. Komatsu,et al.  Relationships between color, shape, and pattern selectivities of neurons in the inferior temporal cortex of the monkey. , 1993, Journal of neurophysiology.

[3]  K R Gegenfurtner,et al.  Contrast detection in luminance and chromatic noise. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[4]  O E Favreau,et al.  Perceived velocity of moving chromatic gratings. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[5]  A. Roe,et al.  Cerebral Cortex Advance Access published June 18, 2007 Functional Organization of Color Domains in V1 and V2 of Macaque Monkey Revealed by Optical Imaging , 2022 .

[6]  P. Lennie Single Units and Visual Cortical Organization , 1998, Perception.

[7]  Wei Wang,et al.  Distinct Functional Organizations for Processing Different Motion Signals in V1, V2, and V4 of Macaque , 2012, The Journal of Neuroscience.

[8]  Edward Vul,et al.  Contingent aftereffects distinguish conscious and preconscious color processing , 2006, Nature Neuroscience.

[9]  J. Mollon "Tho' she kneel'd in that place where they grew..." The uses and origins of primate colour vision. , 1989, The Journal of experimental biology.

[10]  K. Mullen,et al.  The spatial tuning of chromatic mechanisms identified by simultaneous masking , 1994, Vision Research.

[11]  E. Switkes,et al.  Functional anatomy of macaque striate cortex. III. Color , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  Mathew Alpern,et al.  Relation between Brightness and Color Contrast , 1964 .

[13]  Semir Zeki,et al.  Feature binding in the feedback layers of area V2. , 2009, Cerebral cortex.

[14]  F. Kingdom,et al.  A comparison between colour and luminance contrast in a spatial linking task , 1992, Vision Research.

[15]  T D Albright,et al.  What happens if it changes color when it moves?: the nature of chromatic input to macaque visual area MT , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  K. Mullen,et al.  Evidence for the stochastic independence of the blue-yellow, red-green and luminance detection mechanisms revealed by subthreshold summation , 1999, Vision Research.

[17]  L. Glass Moiré Effect from Random Dots , 1969, Nature.

[18]  Karl R Gegenfurtner,et al.  Higher level chromatic mechanisms for image segmentation. , 2006, Journal of vision.

[19]  K. Mullen,et al.  Orientation selectivity in luminance and color vision assessed using 2-d band-pass filtered spatial noise , 2005, Vision Research.

[20]  Ryota Kanai,et al.  Discrete color filling beyond luminance gaps along perceptual surfaces. , 2006, Journal of vision.

[21]  S. Zeki Colour coding in the cerebral cortex: The responses of wavelength-selective and colour-coded cells in monkey visual cortex to changes in wavelength composition , 1983, Neuroscience.

[22]  U. Leonards,et al.  What makes cast shadows hard to see? , 2010, Journal of vision.

[23]  A. Bartels,et al.  Decoding the Yellow of a Gray Banana , 2013, Current Biology.

[24]  C. McCollough Color Adaptation of Edge-Detectors in the Human Visual System , 1965, Science.

[25]  Hong Zhou,et al.  The coding of uniform colour figures in monkey visual cortex , 2003, The Journal of physiology.

[26]  DH Hubel,et al.  Psychophysical evidence for separate channels for the perception of form, color, movement, and depth , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[27]  Kathy T Mullen,et al.  Comparison of color and luminance vision on a global shape discrimination task , 2002, Vision Research.

[28]  A Elsner,et al.  Hue difference contours can be used in processing orientation information , 1978, Perception & psychophysics.

[29]  G. Orban,et al.  Search for color 'center(s)' in macaque visual cortex. , 2004, Cerebral cortex.

[30]  Semir Zeki,et al.  Effect of background colors on the tuning of color-selective cells in monkey area V4. , 2006, Journal of neurophysiology.

[31]  J. Mollon,et al.  Dichromats detect colour-camouflaged objects that are not detected by trichromats , 1992, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[32]  A. Kohn Visual adaptation: physiology, mechanisms, and functional benefits. , 2007, Journal of neurophysiology.

[33]  Kathy T Mullen,et al.  Contour integration in color vision: a common process for the blue–yellow, red–green and luminance mechanisms? , 2000, Vision Research.

[34]  Masaaki Kawahashi,et al.  Renovation of Journal of Visualization , 2010, J. Vis..

[35]  Daniel C. Kiper,et al.  Relationship between neural response and adaptation selectivity to form and color: an ERP study , 2012, Front. Hum. Neurosci..

[36]  K. Gegenfurtner,et al.  Cortical mechanisms of colour vision , 2003, Nature Reviews Neuroscience.

[37]  J. Gibson,et al.  Adaptation, after-effect and contrast in the perception of tilted lines. I. Quantitative studies , 1937 .

[38]  J. Lederberg,et al.  Size Adaptation : A New Aftereffect , 1969 .

[39]  C. Blakemore,et al.  Size Adaptation: A New Aftereffect , 1969, Science.

[40]  Colin W G Clifford,et al.  Orientation-selective chromatic mechanisms in human visual cortex. , 2010, Journal of vision.

[41]  Anna W. Roe,et al.  A Map for Horizontal Disparity in Monkey V2 , 2008, Neuron.

[42]  J. Krauskopf Effect of retinal image stabilization on the appearance of heterochromatic targets. , 1963, Journal of the Optical Society of America.

[43]  Anisotropy in the chromatic channel: a horizontal-vertical effect. , 1988, Spatial vision.

[44]  B. Dow,et al.  Color, orientation and cytochrome oxidase reactivity in areas V1, V2 and V4 of macaque monkey visual cortex , 1996, Behavioural Brain Research.

[45]  M. Morrone,et al.  BOLD human responses to chromatic spatial features , 2013, The European journal of neuroscience.

[46]  A Bradley,et al.  Contrast dependence and mechanisms of masking interactions among chromatic and luminance gratings. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[47]  S. Zeki,et al.  Segregation of pathways leading from area V2 to areas V4 and V5 of macaque monkey visual cortex , 1985, Nature.

[48]  J. Samson Transmission Characteristics of Carbon in the Vacuum Ultraviolet , 1964 .

[49]  A. Hurlbert,et al.  Perception of three-dimensional shape influences colour perception through mutual illumination , 1999, Nature.

[50]  Graeme R. Cole,et al.  Texture segregation with luminance and chromatic contrast , 1990, Vision Research.

[51]  K. Gegenfurtner,et al.  Memory modulates color appearance , 2006, Nature Neuroscience.

[52]  S. Shipp,et al.  The functional logic of cortical connections , 1988, Nature.

[53]  D. Heeger,et al.  Decoding and Reconstructing Color from Responses in Human Visual Cortex , 2009, The Journal of Neuroscience.

[54]  D. Hubel,et al.  Anatomy and physiology of a color system in the primate visual cortex , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[55]  Colin W G Clifford,et al.  Rapid global form binding with loss of associated colors. , 2004, Journal of vision.

[56]  D. Hubel,et al.  Regular patchy distribution of cytochrome oxidase staining in primary visual cortex of macaque monkey , 1981, Nature.

[57]  F. Kingdom,et al.  Texture-orientation mechanisms pool colour and luminance contrast , 2002, Vision Research.

[58]  D. H. Kelly Spatiotemporal variation of chromatic and achromatic contrast thresholds. , 1983, Journal of the Optical Society of America.

[59]  Anitha Pasupathy,et al.  Equiluminance Cells in Visual Cortical Area V4 , 2011, The Journal of Neuroscience.

[60]  E. Marg A VISION OF THE BRAIN , 1994 .

[61]  Ilias Rentzeperis,et al.  Evidence for color and luminance invariance of global form mechanisms. , 2010, Journal of vision.

[62]  Karl R Gegenfurtner,et al.  Geometry in Nature , 1993 .

[63]  P. Lennie,et al.  Chromatic mechanisms in lateral geniculate nucleus of macaque. , 1984, The Journal of physiology.

[64]  K. D. Valois,et al.  Color-selective analysis of luminance-varying stimuli , 2002, Vision Research.

[65]  P. Lennie,et al.  Chromatic mechanisms in striate cortex of macaque , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[66]  D. Ts'o,et al.  Functional organization of primate visual cortex revealed by high resolution optical imaging. , 1990, Science.

[67]  Carl R Olson,et al.  Linearly additive shape and color signals in monkey inferotemporal cortex. , 2009, Journal of neurophysiology.

[68]  S. Zeki,et al.  The architecture of the colour centre in the human visual brain: new results and a review * , 2000, The European journal of neuroscience.

[69]  Nao Ninomiya,et al.  The 10th anniversary of journal of visualization , 2007, J. Vis..

[70]  M. Gur,et al.  Isoluminant stimuli may not expose the full contribution of color to visual functioning: Spatial contrast sensitivity measurements indicate interaction between color and luminance processing , 1992, Vision Research.

[71]  Andreas Bartels,et al.  Coding and binding of color and form in visual cortex. , 2010, Cerebral cortex.

[72]  K. Mullen,et al.  How long range is contour integration in human color vision? , 2003, Visual Neuroscience.

[73]  Colin W G Clifford,et al.  Interactions between color and luminance in the perception of orientation. , 2003, Journal of vision.

[74]  S. Zeki Functional organization of a visual area in the posterior bank of the superior temporal sulcus of the rhesus monkey , 1974, The Journal of physiology.

[75]  Arthur Bradley,et al.  Orientation and spatial frequency selectivity of adaptation to color and luminance gratings , 1988, Vision Research.

[76]  Takeo Watanabe,et al.  The primary visual cortex fills in color , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[77]  Marie-Juliette F Mandelli,et al.  The local and global processing of chromatic Glass patterns. , 2005, Journal of vision.

[78]  Patrick Cavanagh,et al.  Vision at equiluminance , 1991 .

[79]  S Grossberg,et al.  3-D vision and figure-ground separation by visual cortex , 2010, Perception & psychophysics.

[80]  Patrick Cavanagh,et al.  Independent orientation-selective mechanisms for the cardinal directions of colour space , 1990, Vision Research.

[81]  Richard C. Clarke,et al.  Seeing in colour , 2011, Nature.

[82]  A. Leventhal,et al.  Concomitant sensitivity to orientation, direction, and color of cells in layers 2, 3, and 4 of monkey striate cortex , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[83]  Annette Werner,et al.  The Influence of Depth Segmentation on Colour Constancy , 2006, Perception.

[84]  K. D. De Valois,et al.  Orientation and spatial-frequency discrimination for luminance and chromatic gratings. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[85]  K. Mullen The contrast sensitivity of human colour vision to red‐green and blue‐yellow chromatic gratings. , 1985, The Journal of physiology.

[86]  D. Ts'o,et al.  The organization of chromatic and spatial interactions in the primate striate cortex , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[87]  D. Burr,et al.  Visual aftereffects , 2009, Current Biology.

[88]  Victor A. F. Lamme,et al.  Contextual Modulation in Primary Visual Cortex , 1996, The Journal of Neuroscience.

[89]  K. Moutoussis,et al.  Functional segregation and temporal hierarchy of the visual perceptive systems , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[90]  Xiao-Jing Wang,et al.  The importance of mixed selectivity in complex cognitive tasks , 2013, Nature.

[91]  S. Zeki,et al.  Responses of spectrally selective cells in macaque area V2 to wavelengths and colors. , 2002, Journal of neurophysiology.

[92]  Stephen A Engel,et al.  Adaptation of Oriented and Unoriented Color-Selective Neurons in Human Visual Areas , 2005, Neuron.

[93]  Bevil R. Conway,et al.  Color Vision, Cones, and Color-Coding in the Cortex , 2009, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[94]  S. Zeki,et al.  The functional organization of area V2, I: Specialization across stripes and layers , 2002, Visual Neuroscience.

[95]  Bevil R. Conway,et al.  Specialized Color Modules in Macaque Extrastriate Cortex , 2007, Neuron.

[96]  Eugene Switkes,et al.  Integration of differing chromaticities in early and midlevel spatial vision. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[97]  R Held,et al.  Color- and Edge-Sensitive Channels in the Human Visual System: Tuning for Orientation , 1971, Science.

[98]  Kathy T. Mullen,et al.  Contour integration with colour and luminance contrast , 1996, Vision Research.

[99]  P. Lennie,et al.  Mechanisms Underlying Segmentation of Colored Textures , 1997, Vision Research.

[100]  K T Mullen,et al.  Evidence for separate pathways for color and luminance detection mechanisms. , 1994, Journal of the Optical Society of America. A, Optics, image science, and vision.

[101]  Hisashi Tanigawa,et al.  A Motion Direction Map in Macaque V2 , 2010, Neuron.

[102]  Bevil R. Conway,et al.  Parallel, multi-stage processing of colors, faces and shapes in macaque inferior temporal cortex , 2013, Nature Neuroscience.

[103]  S. Zeki,et al.  A direct demonstration of perceptual asynchrony in vision , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[104]  Branka Spehar,et al.  Colour and luminance selectivity of spatial and temporal interactions in orientation perception , 2003, Vision Research.

[105]  W. Lovegrove,et al.  Colour selectivity in the tilt after-effect: Comments upon Wade and Wenderoth , 1981, Vision Research.

[106]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[107]  D. Kiper,et al.  Chromatic properties of neurons in macaque area V2 , 1997, Visual Neuroscience.

[108]  R. Shapley,et al.  The Orientation Selectivity of Color-Responsive Neurons in Macaque V1 , 2008, The Journal of Neuroscience.

[109]  S. Shevell,et al.  Color in complex scenes. , 2008, Annual review of psychology.

[110]  Daniel C Kiper,et al.  The detection of colored Glass patterns. , 2003, Journal of vision.

[111]  P Cavanagh,et al.  Color and luminance: independent frequency shifts. , 1981, Science.

[112]  T. Albright,et al.  What happens if it changes color when it moves?: Psychophysical experiments on the nature of chromatic input to motion detectors , 1993, Vision Research.

[113]  S. Zeki,et al.  Colour coding in rhesus monkey prestriate cortex. , 1973, Brain research.

[114]  E. Switkes,et al.  Functional anatomy of macaque striate cortex. II. Retinotopic organization , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[115]  Geraint Rees,et al.  Combined orientation and colour information in human V1 for both L–M and S-cone chromatic axes , 2008, NeuroImage.

[116]  S. Zeki Colour coding in the cerebral cortex: The reaction of cells in monkey visual cortex to wavelengths and colours , 1983, Neuroscience.

[117]  Karl J. Friston,et al.  The colour centre in the cerebral cortex of man , 1989, Nature.

[118]  Angela M. Brown,et al.  Higher order color mechanisms , 1986, Vision Research.

[119]  C F Stromeyer,et al.  Spatial adaptation of short-wavelength pathways in humans. , 1980, Science.

[120]  K. Moutoussis Asynchrony in Visual Consciousness and the Possible Involvement of Attention , 2012, Front. Psychology.

[121]  R. Shapley,et al.  The spatial transformation of color in the primary visual cortex of the macaque monkey , 2001, Nature Neuroscience.

[122]  DH Hubel,et al.  Color and contrast sensitivity in the lateral geniculate body and primary visual cortex of the macaque monkey , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[123]  Masao Fukuhara On Feature Binding , 2016 .

[124]  Lawrence C. Sincich,et al.  Orientation Tuning of Cytochrome Oxidase Patches in Macaque Primary Visual Cortex , 2011, Nature Neuroscience.

[125]  E Switkes,et al.  Simultaneous masking interactions between chromatic and luminance gratings. , 1983, Journal of the Optical Society of America.

[126]  Tobias E. Reisbeck,et al.  PII: S0042-6989(97)00240-X , 2003 .

[127]  D. G. Albrecht,et al.  Spatial mapping of monkey VI cells with pure color and luminance stimuli , 1984, Vision Research.

[128]  Bevil R. Conway,et al.  Color signals through dorsal and ventral visual pathways , 2014, Visual Neuroscience.

[129]  D. Ts'o,et al.  Color processing in macaque striate cortex: relationships to ocular dominance, cytochrome oxidase, and orientation. , 2002, Journal of neurophysiology.

[130]  K. Mullen,et al.  Absence of Linear Subthreshold summation between Red-Green and Luminance Mechanisms over a Wide Range of Spatio-temporal Conditions , 1997, Vision Research.

[131]  Steven K Shevell,et al.  What kinds of contours bound the reach of filled-in color? , 2011, Journal of vision.

[132]  R. Shapley,et al.  Brightness contrast inhibits color induction: evidence for a new kind of color theory. , 2006, Spatial vision.

[133]  Anitha Pasupathy,et al.  Shape encoding consistency across colors in primate V4. , 2012, Journal of neurophysiology.

[134]  Colin W.G. Clifford,et al.  Inter-ocular transfer of the tilt illusion shows that monocular orientation mechanisms are colour selective , 2005, Vision Research.

[135]  Karl R Gegenfurtner,et al.  Higher order color mechanisms: evidence from noise-masking experiments in cone contrast space. , 2013, Journal of vision.