Some fingerprints of V1 mechanisms in the bottom up saliency for visual selection

Li Zhaoping, Keith A. May, Ansgar Koene Department of Computer Science, University College London, UK To appear as Chapter 7 in Computational modelling in behavioural neuroscience: closing the gap between neurophysiology and behaviour Editted by Dietmar Heinke and Eirini Mavritsaki, Psychology Press, 2009. Abstract: A unique vertical bar among horizontal bars is salient and pops out perceptually regardless of the observer’s goals. Physiological data have suggested that mechanisms in the primary visual cortex (V1) contribute to the high saliency of such a unique basic feature, but fail to indicate whether V1 plays an essential or peripheral role in inputdriven or bottom up saliency. Meanwhile a biologically based V1 model has suggested that V1 mechanisms can also explain bottom up saliencies beyond the pop out of basic features (Li 1999a, 2002). For instance the low saliency of a unique conjunction feature like a red-vertical bar among red-horizontal and green-vertical bars is explained, under the hypothesis that the bottom up saliency at any location is signalled by the activity of the most active cell responding to it regardless of the cell’s preferred features such as color and orientation. While some recent experimental data have provided support for this V1 saliency hypothesis, higher visual areas such as V2 and V4 also contain neurons tuned to similar basic features that can pop out in the bottom up manner. Furthermore, previous saliency models can capture much of the visual selection behavior using generic rather than V1 specific neural mechanisms. It is therefore important to ascertain V1’s role in saliency by identifying visual selection behavior that show specific identifying characteristics, i.e., fingerprints, of V1 or other cortical areas. In this paper, we present our recent findings on bottom-up saliency based behavior of visual search and segmentation that directly implicate V1 mechanisms. The three specific fingerprints are: (1) ocular singleton captures attention despite being elusive to awareness, (2) V1’s collinear facilitation manifested in texture segmentation, and (3) a match between the redundancy gains in double feature singleton search and V1’s conjunctive cells.

[1]  J. Allman,et al.  Stimulus specific responses from beyond the classical receptive field: neurophysiological mechanisms for local-global comparisons in visual neurons. , 1985, Annual review of neuroscience.

[2]  Zhaoping Li,et al.  A Neural Model of Contour Integration in the Primary Visual Cortex , 1998, Neural Computation.

[3]  S. Kastner,et al.  Stimulus context modulates competition in human extrastriate cortex , 2005, Nature Neuroscience.

[4]  E. J. Tehovnik,et al.  Saccadic eye movements evoked by microstimulation of striate cortex , 2003, The European journal of neuroscience.

[5]  D. Ts'o,et al.  The organization of chromatic and spatial interactions in the primate striate cortex , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  Steven C. Dakin,et al.  Flank facilitation and contour integration: Different sites , 2006, Vision Research.

[7]  K R Gegenfurtner,et al.  Processing of color, form, and motion in macaque area V2 , 1996, Visual Neuroscience.

[8]  P. Lennie,et al.  Early and Late Mechanisms of Surround Suppression in Striate Cortex of Macaque , 2005, The Journal of Neuroscience.

[9]  D. V. van Essen,et al.  Processing of color, form and disparity information in visual areas VP and V2 of ventral extrastriate cortex in the macaque monkey , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  H. Jones,et al.  Visual cortical mechanisms detecting focal orientation discontinuities , 1995, Nature.

[11]  Zhaoping Li,et al.  Psychophysical Tests of the Hypothesis of a Bottom-Up Saliency Map in Primary Visual Cortex , 2007, PLoS Comput. Biol..

[12]  Jochen Braun,et al.  Blindsight in normal observers , 1995, Nature.

[13]  Wieske van Zoest,et al.  Bottom-up and Top-down Control in Visual Search , 2004, Perception.

[14]  H. Müller,et al.  Visual search for dimensionally redundant pop-out targets: Evidence for parallel-coactive processing of dimensions , 2001, Perception & psychophysics.

[15]  Li Zhaoping Popout by unique eye of origin: A fingerprint of the role of primary visual cortex in bottom-up saliency , 2007 .

[16]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[17]  Susan L. Franzel,et al.  Binocularity and visual search , 1988, Perception & psychophysics.

[18]  C. J. Erkelens,et al.  PII: S0042-6989(97)00287-3 , 2003 .

[19]  Stefan Treue,et al.  Feature-based attention influences motion processing gain in macaque visual cortex , 1999, Nature.

[20]  Z Li,et al.  Contextual influences in V1 as a basis for pop out and asymmetry in visual search. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[21]  D. V. van Essen,et al.  Response modulation by texture surround in primate area V1: Correlates of “popout” under anesthesia , 1999, Visual Neuroscience.

[22]  John K. Tsotsos Analyzing vision at the complexity level , 1990, Behavioral and Brain Sciences.

[23]  S. Shipp The brain circuitry of attention , 2004, Trends in Cognitive Sciences.

[24]  Zhaoping Li V1 mechanisms and some figure-ground and border effects. , 2003, Journal of physiology, Paris.

[25]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[26]  D. V. van Essen,et al.  Neuronal responses to static texture patterns in area V1 of the alert macaque monkey. , 1992, Journal of neurophysiology.

[27]  T. Sejnowski,et al.  Representation of Color Stimuli in Awake Macaque Primary Visual Cortex , 2003, Neuron.

[28]  R. Desimone,et al.  Interacting Roles of Attention and Visual Salience in V4 , 2003, Neuron.

[29]  Peter Dayan,et al.  Pre-attentive visual selection , 2006, Neural Networks.

[30]  S. Yantis,et al.  Cortical mechanisms of space-based and object-based attentional control , 2003, Current Opinion in Neurobiology.

[31]  M. Morgan,et al.  Blindsight in normal subjects? , 1997, Nature.

[32]  Li Zhaoping,et al.  Theoretical understanding of the early visual processes by data compression and data selection , 2006, Network.

[33]  J. Duncan,et al.  Visual search and stimulus similarity. , 1989, Psychological review.

[34]  A. Sillito,et al.  Surround suppression in primate V1. , 2001, Journal of neurophysiology.

[35]  M. Goldberg,et al.  The representation of visual salience in monkey parietal cortex , 1998, Nature.

[36]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[37]  H. Nothdurft Salience from feature contrast: additivity across dimensions , 2000, Vision Research.

[38]  K. Nakayama,et al.  Sustained and transient components of focal visual attention , 1989, Vision Research.

[39]  L. Zhaoping,et al.  A theory of a saliency map in primary visual cortex (V1) tested by psychophysics of colour–orientation interference in texture segmentation , 2006 .

[40]  D. V. van Essen,et al.  Response profiles to texture border patterns in area V1 , 2000, Visual Neuroscience.

[41]  R. von der Heydt,et al.  Illusory contours and cortical neuron responses. , 1984, Science.

[42]  S. Yantis Control of visual attention. , 1998 .

[43]  Zhaoping Li,et al.  Feature-specific interactions in salience from combined feature contrasts: evidence for a bottom-up saliency map in V1. , 2007, Journal of vision.

[44]  J. Lund,et al.  Intrinsic laminar lattice connections in primate visual cortex , 1983, The Journal of comparative neurology.

[45]  J. B. Levitt,et al.  Functional properties of neurons in macaque area V3. , 1997, Journal of neurophysiology.

[46]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[47]  C. Li,et al.  Extensive integration field beyond the classical receptive field of cat's striate cortical neurons--classification and tuning properties. , 1994, Vision research.

[48]  Zhaoping Li A saliency map in primary visual cortex , 2002, Trends in Cognitive Sciences.

[49]  J. Jonides Voluntary versus automatic control over the mind's eye's movement , 1981 .

[50]  Gregory D Horwitz,et al.  Paucity of chromatic linear motion detectors in macaque V1. , 2005, Journal of vision.

[51]  J. Nelson,et al.  Intracortical facilitation among co-oriented, co-axially aligned simple cells in cat striate cortex , 2004, Experimental Brain Research.

[52]  J. Schall,et al.  Neural selection and control of visually guided eye movements. , 1999, Annual review of neuroscience.

[53]  C. Gilbert,et al.  Synaptic physiology of horizontal connections in the cat's visual cortex , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[54]  T. Wiesel,et al.  Clustered intrinsic connections in cat visual cortex , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[55]  Victor A. F. Lamme,et al.  Figure–ground activity in primary visual cortex (V1) of the monkey matches the speed of behavioral response , 2003, Neuroscience Letters.

[56]  John Duncan,et al.  A neural basis for visual search in inferior temporal cortex , 1993, Nature.

[57]  Jay Hegdé,et al.  How Selective Are V1 Cells for Pop-Out Stimuli? , 2003, The Journal of Neuroscience.

[58]  M. Landy,et al.  Discrimination of orientation-defined texture edges , 1995, Vision Research.

[59]  I. Ohzawa,et al.  Length and width tuning of neurons in the cat's primary visual cortex. , 1994, Journal of neurophysiology.

[60]  Nathalie Guyader,et al.  Interference with Bottom-Up Feature Detection by Higher-Level Object Recognition , 2007, Current Biology.

[61]  Z Li,et al.  Visual segmentation by contextual influences via intra-cortical interactions in the primary visual cortex. , 1999, Network.

[62]  L. Zhaoping Attention capture by eye of origin singletons even without awareness--a hallmark of a bottom-up saliency map in the primary visual cortex. , 2008, Journal of vision.

[63]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[64]  H. Tamura,et al.  Less Segregated Processing of Visual Information in V2 than in V1 of the Monkey Visual Cortex , 1996, The European journal of neuroscience.

[65]  D. Hubel,et al.  Anatomy and physiology of a color system in the primate visual cortex , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[66]  J. Bakin,et al.  Visual Responses in Monkey Areas V1 and V2 to Three-Dimensional Surface Configurations , 2000, The Journal of Neuroscience.

[67]  Susan L. Franzel,et al.  Guided search: an alternative to the feature integration model for visual search. , 1989, Journal of experimental psychology. Human perception and performance.

[68]  C. Koch,et al.  Are we aware of neural activity in primary visual cortex? , 1995, Nature.

[69]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[70]  D. Hubel,et al.  Receptive fields of single neurones in the cat's striate cortex , 1959, The Journal of physiology.

[71]  Z Li,et al.  Pre-attentive segmentation in the primary visual cortex. , 1998, Spatial vision.

[72]  H. Nothdurft Feature analysis and the role of similarity in preattentive vision , 1992, Perception & psychophysics.

[73]  Frank Tong,et al.  Cognitive neuroscience: Primary visual cortex and visual awareness , 2003, Nature Reviews Neuroscience.

[74]  C. Gilbert,et al.  Improvement in visual sensitivity by changes in local context: Parallel studies in human observers and in V1 of alert monkeys , 1995, Neuron.