Activity of Inferior Temporal Cortical Neurons Predicts Recognition Choice Behavior and Recognition Time during Visual Search

Although the selectivity for complex stimuli exhibited by neurons in inferior temporal cortex is often taken as evidence of their role in visual perception, few studies have directly tested this hypothesis. Here, we sought to create a relatively natural task with few behavioral constraints to test whether activity in inferior temporal cortex neurons predicts whether or not a monkey will recognize and respond to a complex visual object. Monkeys were trained to freely view an array of images and report the presence of one of many possible target images previously associated with a hand response. On certain trials, the identity of the target was swapped during the monkeys' targeting saccade. Furthermore, the response association of the preswap target and the postswap target differed (e.g., right-to-left target swap). Neural activity in cells selective for the preswap target was significantly higher when the monkeys' response matched the hand association of the preswap target. Furthermore, the monkeys' response time was predicted by the magnitude of the presaccadic firing rate on nonswap trials. Our results provide additional support for the role of inferior temporal cortex in object recognition during natural behavior.

[1]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[2]  D. B. Bender,et al.  Visual properties of neurons in inferotemporal cortex of the Macaque. , 1972, Journal of neurophysiology.

[3]  C. Gross Visual Functions of Inferotemporal Cortex , 1973 .

[4]  E. Matin Saccadic suppression: a review and an analysis. , 1974, Psychological bulletin.

[5]  P. Dean The effect of inferotemporal lesions on memory for visual stimuli in rhesus monkeys. , 1974, Brain research.

[6]  M. Goldberg,et al.  Behavioral enhancement of visual responses in monkey cerebral cortex. II. Modulation in frontal eye fields specifically related to saccades. , 1981, Journal of neurophysiology.

[7]  M. Mishkin A memory system in the monkey. , 1982, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[8]  R. Desimone,et al.  Stimulus-selective properties of inferior temporal neurons in the macaque , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  W. E. Collins,et al.  Integrating pictorial information across eye movements. , 1984, Journal of experimental psychology. General.

[10]  R. Desimone,et al.  Selective attention gates visual processing in the extrastriate cortex. , 1985, Science.

[11]  A Pollatsek,et al.  Role of spatial location in integration of pictorial information across saccades. , 1990, Journal of experimental psychology. Human perception and performance.

[12]  Keiji Tanaka,et al.  Coding visual images of objects in the inferotemporal cortex of the macaque monkey. , 1991, Journal of neurophysiology.

[13]  J. Movshon,et al.  The analysis of visual motion: a comparison of neuronal and psychophysical performance , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  John Duncan,et al.  A neural basis for visual search in inferior temporal cortex , 1993, Nature.

[15]  W. Newsome,et al.  Neuronal and psychophysical sensitivity to motion signals in extrastriate area MST of the macaque monkey , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  B. Dosher,et al.  The role of attention in the programming of saccades , 1995, Vision Research.

[17]  M. Goldberg,et al.  Visual, presaccadic, and cognitive activation of single neurons in monkey lateral intraparietal area. , 1996, Journal of neurophysiology.

[18]  Keiji Tanaka,et al.  Inferotemporal cortex and object vision. , 1996, Annual review of neuroscience.

[19]  John A. Swets,et al.  Signal Detection Theory and ROC Analysis in Psychology and Diagnostics: Collected Papers , 1996 .

[20]  K. H. Britten,et al.  A relationship between behavioral choice and the visual responses of neurons in macaque MT , 1996, Visual Neuroscience.

[21]  David L. Sheinberg,et al.  The role of temporal cortical areas in perceptual organization. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[22]  S L Moody,et al.  A Model That Accounts for Activity in Primate Frontal Cortex during a Delayed Matching-to-Sample Task , 1998, The Journal of Neuroscience.

[23]  P H Schiller,et al.  Visual representations during saccadic eye movements. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[24]  B. C. Motter,et al.  The zone of focal attention during active visual search , 1998, Vision Research.

[25]  T Moore,et al.  Shape representations and visual guidance of saccadic eye movements. , 1999, Science.

[26]  E. Miller,et al.  Effects of Visual Experience on the Representation of Objects in the Prefrontal Cortex , 2000, Neuron.

[27]  R. Vogels,et al.  Spatial sensitivity of macaque inferior temporal neurons , 2000, The Journal of comparative neurology.

[28]  Tomaso Poggio,et al.  Models of object recognition , 2000, Nature Neuroscience.

[29]  A. Parker,et al.  Perceptually Bistable Three-Dimensional Figures Evoke High Choice Probabilities in Cortical Area MT , 2001, The Journal of Neuroscience.

[30]  J Duncan,et al.  Responses of neurons in macaque area V4 during memory-guided visual search. , 2001, Cerebral cortex.

[31]  David L. Sheinberg,et al.  Noticing Familiar Objects in Real World Scenes: The Role of Temporal Cortical Neurons in Natural Vision , 2001, The Journal of Neuroscience.

[32]  J. Findlay,et al.  Saccade target selection in visual search: the effect of information from the previous fixation , 2001, Vision Research.

[33]  Y. Yamane,et al.  Complex objects are represented in macaque inferotemporal cortex by the combination of feature columns , 2001, Nature Neuroscience.

[34]  J. Maunsell,et al.  Attentional Modulation of Behavioral Performance and Neuronal Responses in Middle Temporal and Ventral Intraparietal Areas of Macaque Monkey , 2002, The Journal of Neuroscience.

[35]  M. Tarr,et al.  Visual Object Recognition , 1996, ISTCS.

[36]  J. Maunsell,et al.  Anterior inferotemporal neurons of monkeys engaged in object recognition can be highly sensitive to object retinal position. , 2003, Journal of neurophysiology.

[37]  David A. Leopold,et al.  Measuring subjective visual perception in the nonhuman primate , 2003 .

[38]  K. Krug A common neuronal code for perceptual processes in visual cortex? Comparing choice and attentional correlates in V5/MT. , 2004, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[39]  G. DeAngelis,et al.  Contribution of Area MT to Stereoscopic Depth Perception Choice-Related Response Modulations Reflect Task Strategy , 2004, Neuron.

[40]  B. Fischer,et al.  Selection of visual targets activates prelunate cortical cells in trained rhesus monkey , 2004, Experimental Brain Research.

[41]  Hisao Nishijo,et al.  Neuronal correlates of face identification in the monkey anterior temporal cortical areas. , 2004, Journal of neurophysiology.

[42]  D. Perrett,et al.  Visual neurones responsive to faces in the monkey temporal cortex , 2004, Experimental Brain Research.

[43]  Charles E Connor,et al.  Underlying principles of visual shape selectivity in posterior inferotemporal cortex , 2004, Nature Neuroscience.

[44]  James J DiCarlo,et al.  Using neuronal latency to determine sensory-motor processing pathways in reaction time tasks. , 2005, Journal of neurophysiology.

[45]  Julia Kastner,et al.  Introduction to Robust Estimation and Hypothesis Testing , 2005 .

[46]  M. Shadlen,et al.  Neural Activity in Macaque Parietal Cortex Reflects Temporal Integration of Visual Motion Signals during Perceptual Decision Making , 2005, The Journal of Neuroscience.

[47]  W. Newsome,et al.  Correlation between Speed Perception and Neural Activity in the Middle Temporal Visual Area , 2005, The Journal of Neuroscience.

[48]  Ichiro Fujita,et al.  Neural Correlates of Fine Depth Discrimination in Monkey Inferior Temporal Cortex , 2005, The Journal of Neuroscience.

[49]  B. Cumming,et al.  Macaque V2 Neurons, But Not V1 Neurons, Show Choice-Related Activity , 2006, The Journal of Neuroscience.

[50]  R. Kiani,et al.  Microstimulation of inferotemporal cortex influences face categorization , 2006, Nature.

[51]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .