From Knowing What to Knowing Where: Modeling Object-Based Attention with Feedback Disinhibition of Activation

We propose a neural model of visual object-based attention in which the identity of an object is used to select its location in an array of objects. The model is based on neural activity observed in visual search tasks performed by monkeys. In the model, the identity of the object (target) is selected in the higher areas of the ventral stream by means of a cue. Feedback activation from these higher areas carries information about the identity of the target to the (lower) retinotopic areas of the ventral stream. In these areas, the feedback activation interacts with feedforward activation produced by the object array. The interaction occurs in local microcircuits, and results in a selective activation on locations in the retinotopic areas of the visual stream that correspond to the location of the target in the object array. The selective activation consists of a form of gain control, produced by disinhibition. Transmitted to the dorsal stream, this activation directs spatial attention to the location of the target. In this way, an action directed at the target can be generated.

[1]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[2]  Y. Miyashita.  Neuronal correlate of visual associative long-term memory in the primate temporal cortex , 1988, Nature.

[3]  Richard A. Andersen,et al.  A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons , 1988, Nature.

[4]  Kevan A. C. Martin,et al.  A Canonical Microcircuit for Neocortex , 1989, Neural Computation.

[5]  Z. Kisvárday,et al.  GABAergic networks of basket cells in the visual cortex. , 1992, Progress in brain research.

[6]  Peter Ford Dominey,et al.  A cortico-subcortical model for generation of spatially accurate sequential saccades. , 1992, Cerebral cortex.

[7]  U. Eysel,et al.  Network of GABAergic large basket cells in cat visual cortex (area 18): Implication for lateral disinhibition , 1993, The Journal of comparative neurology.

[8]  John Duncan,et al.  A neural basis for visual search in inferior temporal cortex , 1993, Nature.

[9]  Glyn W. Humphreys,et al.  Object and face recognition , 1994 .

[10]  Keiji Tanaka,et al.  Neuronal selectivities to complex object features in the ventral visual pathway of the macaque cerebral cortex. , 1994, Journal of neurophysiology.

[11]  B. C. Motter,et al.  Neural correlates of feature selective memory and pop-out in extrastriate area V4 , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  Earl K. Miller,et al.  The interaction of neural systems for attention and memory , 1994 .

[13]  Leslie G. Ungerleider,et al.  Connections of inferior temporal areas TEO and TE with parietal and frontal cortex in macaque monkeys. , 1994, Cerebral cortex.

[14]  David I. Perrett,et al.  Modeling visual recognition from neurobiological constraints , 1994, Neural Networks.

[15]  B. Motter.  Neural correlates of attentive selection for color or luminance in extrastriate area V4 , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  Leslie G. Ungerleider,et al.  ‘What’ and ‘where’ in the human brain , 1994, Current Opinion in Neurobiology.

[17]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[18]  Minami Ito,et al.  Size and position invariance of neuronal responses in monkey inferotemporal cortex. , 1995, Journal of neurophysiology.

[19]  M. A. Steinmetz,et al.  Neurophysiological evidence for a role of posterior parietal cortex in redirecting visual attention. , 1995, Cerebral cortex.

[20]  M. Goldberg,et al.  Visual, presaccadic, and cognitive activation of single neurons in monkey lateral intraparietal area. , 1996, Journal of neurophysiology.

[21]  Nicolas Brunel,et al.  Hebbian Learning of Context in Recurrent Neural Networks , 1996, Neural Computation.

[22]  Keiji Tanaka,et al.  Representation of Visual Features of Objects in the Inferotemporal Cortex , 1996, Neural Networks.

[23]  E. Niebur,et al.  Modeling the Temporal Dynamics of IT Neurons in Visual Search: A Mechanism for Top-Down Selective Attention , 1996, Journal of Cognitive Neuroscience.

[24]  J. Duncan,et al.  Competitive brain activity in visual attention , 1997, Current Opinion in Neurobiology.

[25]  S C Rao,et al.  Integration of what and where in the primate prefrontal cortex. , 1997, Science.

[26]  T. Sejnowski,et al.  Spatial Transformations in the Parietal Cortex Using Basis Functions , 1997, Journal of Cognitive Neuroscience.

[27]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[28]  M. Goodale,et al.  The objects of action and perception , 1998, Cognition.

[29]  A P Batista,et al.  Posterior parietal areas specialized for eye movements (LIP) and reach (PRR) using a common coordinate frame. , 1998, Novartis Foundation symposium.

[30]  E. Zohary,et al.  Inter-trial neuronal activity in inferior temporal cortex: a putative vehicle to generate long-term visual associations , 1998, Nature Neuroscience.

[31]  Matthias M. Müller,et al.  The time course of cortical facilitation during cued shifts of spatial attention , 1998, Nature Neuroscience.

[32]  M. Goldberg,et al.  The representation of visual salience in monkey parietal cortex , 1998, Nature.

[33]  C. Koch,et al.  Consciousness and neuroscience. , 1998, Cerebral cortex.

[34]  A. Burkhalter,et al.  Connectivity of GABAergic calretinin-immunoreactive neurons in rat primary visual cortex. , 1999, Cerebral cortex.

[35]  A P Batista,et al.  Reach plans in eye-centered coordinates. , 1999, Science.

[36]  T. Poggio,et al.  Predicting the visual world: silence is golden , 1999, Nature Neuroscience.

[37]  C. Schroeder,et al.  Intermodal selective attention in monkeys. I: distribution and timing of effects across visual areas. , 2000, Cerebral cortex.

[38]  C. Schroeder,et al.  Intermodal selective attention in monkeys. II: physiological mechanisms of modulation. , 2000, Cerebral cortex.