What's color got to do with it? The influence of color on visual attention in different categories.

Certain locations attract human gaze in natural visual scenes. Are there measurable features, which distinguish these locations from others? While there has been extensive research on luminance-defined features, only few studies have examined the influence of color on overt attention. In this study, we addressed this question by presenting color-calibrated stimuli and analyzing color features that are known to be relevant for the responses of LGN neurons. We recorded eye movements of 15 human subjects freely viewing colored and grayscale images of seven different categories. All images were also analyzed by the saliency map model (L. Itti, C. Koch, & E. Niebur, 1998). We find that human fixation locations differ between colored and grayscale versions of the same image much more than predicted by the saliency map. Examining the influence of various color features on overt attention, we find two extreme categories: while in rainforest images all color features are salient, none is salient in fractals. In all other categories, color features are selectively salient. This shows that the influence of color on overt attention depends on the type of image. Also, it is crucial to analyze neurophysiologically relevant color features for quantifying the influence of color on attention.

[1]  O. Meur,et al.  Predicting visual fixations on video based on low-level visual features , 2007, Vision Research.

[2]  P. Lennie,et al.  Chromatic mechanisms in lateral geniculate nucleus of macaque. , 1984, The Journal of physiology.

[3]  J. Nathans.  The Evolution and Physiology of Human Color Vision Insights from Molecular Genetic Studies of Visual Pigments , 1999, Neuron.

[4]  R. C. Langford.  How People Look at Pictures, A Study of the Psychology of Perception in Art. , 1936 .

[5]  D. S. Wooding,et al.  The relationship between the locations of spatial features and those of fixations made during visual examination of briefly presented images. , 1996, Spatial vision.

[6]  M. Goldberg,et al.  The representation of visual salience in monkey parietal cortex , 1998, Nature.

[7]  N. P. Bichot,et al.  Dissociation of visual discrimination from saccade programming in macaque frontal eye field. , 1997, Journal of neurophysiology.

[8]  Asha Iyer,et al.  Components of bottom-up gaze allocation in natural images , 2005, Vision Research.

[9]  S. Snyder,et al.  Separate Signals for Target Selection and Movement Specification in the Superior Colliculus , 2022 .

[10]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[11]  S. Zeki.  The distribution of wavelength and orientation selective cells in different areas of monkey visual cortex , 1983, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[12]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[13]  Huaiyu Zhu.  On Information and Sufficiency , 1997 .

[14]  P Lennie,et al.  Importance of color in the segmentation of variegated surfaces. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[15]  Andrew Zisserman,et al.  Advances in Neural Information Processing Systems (NIPS) , 2007 .

[16]  Christof Koch,et al.  Predicting human gaze using low-level saliency combined with face detection , 2007, NIPS.

[17]  Stefano F. Cappa,et al.  The integration of parallel and serial processing mechanisms in visual search: evidence from eye movement recording , 2001 .

[18]  P. König,et al.  The role of first- and second-order stimulus features for human overt attention , 2007, Perception & psychophysics.

[19]  P Reinagel,et al.  Natural scene statistics at the centre of gaze. , 1999, Network.

[20]  Roland J. Baddeley,et al.  Leaves, fruit, shadows and lighting in Kibale Forst, Uganda , 2003 .

[21]  Gidon Felsen,et al.  A natural approach to studying vision , 2005, Nature Neuroscience.

[22]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[23]  Stefano Cappa,et al.  The integration of parallel and serial processing mechanisms in visual search: evidence from eye movement recording , 2001, The European journal of neuroscience.

[24]  J. Hoffman,et al.  The role of visual attention in saccadic eye movements , 1995, Perception & psychophysics.

[25]  L. Itti,et al.  Visual causes versus correlates of attentional selection in dynamic scenes , 2006, Vision Research.

[26]  Iain D. Gilchrist,et al.  Visual correlates of fixation selection: effects of scale and time , 2005, Vision Research.

[27]  R. Reid,et al.  The koniocellular pathway in primate vision. , 2000, Annual review of neuroscience.

[28]  Bernhard Schölkopf,et al.  A Nonparametric Approach to Bottom-Up Visual Saliency , 2006, NIPS.

[29]  Derrick J. Parkhurst,et al.  Texture contrast attracts overt visual attention in natural scenes , 2004, The European journal of neuroscience.

[30]  P. König,et al.  Does luminance‐contrast contribute to a saliency map for overt visual attention? , 2003, The European journal of neuroscience.

[31]  R Kemp,et al.  Perception and Recognition of Normal and Negative Faces: The Role of Shape from Shading and Pigmentation Cues , 1996, Perception.

[32]  D. Robinson,et al.  Shared neural control of attentional shifts and eye movements , 1996, Nature.

[33]  S Yamane,et al.  Color selectivity of neurons in the inferior temporal cortex of the awake macaque monkey , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[34]  M. Posner,et al.  The attention system of the human brain. , 1990, Annual review of neuroscience.

[35]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[36]  J. Gallant,et al.  Goal-Related Activity in V4 during Free Viewing Visual Search Evidence for a Ventral Stream Visual Salience Map , 2003, Neuron.

[37]  J. Mollon.  Color vision. , 1982, Annual review of psychology.

[38]  S. Shimojo,et al.  Bare skin, blood and the evolution of primate colour vision , 2006, Biology Letters.

[39]  B. Reiser,et al.  Estimation of the area under the ROC curve , 2002, Statistics in medicine.

[40]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[41]  J D Mollon,et al.  Catarrhine photopigments are optimized for detecting targets against a foliage background. , 2000, The Journal of experimental biology.

[42]  Peter W Dicke,et al.  Neuron-specific contribution of the superior colliculus to overt and covert shifts of attention , 2004, Nature Neuroscience.

[43]  N. Dominy,et al.  Ecological importance of trichromatic vision to primates , 2001, Nature.

[44]  Robert Desimone,et al.  Parallel and Serial Neural Mechanisms for Visual Search in Macaque Area V4 , 2005, Science.

[45]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[46]  Leo Maurice Hurvich,et al.  Color vision , 1981 .