A Comparison of Primate Prefrontal and Inferior Temporal Cortices during Visual Categorization

Previous studies have suggested that both the prefrontal cortex (PFC) and inferior temporal cortex (ITC) are involved in high-level visual processing and categorization, but their respective roles are not known. To address this, we trained monkeys to categorize a continuous set of visual stimuli into two categories, “cats” and “dogs.” The stimuli were parametrically generated using a computer graphics morphing system (Sheltonelton, 2000) that allowed precise control over stimulus shape. After training, we recorded neural activity from the PFC and the ITC of monkeys while they performed a category-matching task. We found that the PFC and the ITC play distinct roles in category-based behaviors: the ITC seems more involved in the analysis of currently viewed shapes, whereas the PFC showed stronger category signals, memory effects, and a greater tendency to encode information in terms of its behavioral meaning.

[1]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[2]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[3]  C. Gross.  Visual Functions of Inferotemporal Cortex , 1973 .

[4]  M. Sanders.  Handbook of Sensory Physiology , 1975 .

[5]  R. Desimone,et al.  Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. , 1981, Journal of neurophysiology.

[6]  J. Movshon,et al.  The statistical reliability of signals in single neurons in cat and monkey visual cortex , 1983, Vision Research.

[7]  R. Desimone,et al.  Stimulus-selective properties of inferior temporal neurons in the macaque , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[8]  Y. Miyashita.  Neuronal correlate of visual associative long-term memory in the primate temporal cortex , 1988, Nature.

[9]  J. Fuster,et al.  Prefrontal Cortex and the Bridging of Temporal Gaps in the Perception‐Action Cycle , 1990, Annals of the New York Academy of Sciences.

[10]  R. Desimone,et al.  A neural mechanism for working and recognition memory in inferior temporal cortex. , 1991, Science.

[11]  R. Desimone,et al.  Activity of neurons in anterior inferior temporal cortex during a short- term memory task , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  David I. Perrett,et al.  Neurophysiology of shape processing , 1993, Image Vis. Comput..

[13]  R. Desimone,et al.  Parallel neuronal mechanisms for short-term memory. , 1994, Science.

[14]  Leslie G. Ungerleider,et al.  Connections of inferior temporal areas TEO and TE with parietal and frontal cortex in macaque monkeys. , 1994, Cerebral cortex.

[15]  N. Logothetis,et al.  Shape representation in the inferior temporal cortex of monkeys , 1995, Current Biology.

[16]  Keiji Tanaka,et al.  Inferotemporal cortex and object vision. , 1996, Annual review of neuroscience.

[17]  R. Desimone,et al.  Neural Mechanisms of Visual Working Memory in Prefrontal Cortex of the Macaque , 1996, The Journal of Neuroscience.

[18]  J. Duncan,et al.  Intelligence and the Frontal Lobe: The Organization of Goal-Directed Behavior , 1996, Cognitive Psychology.

[19]  E. Rolls,et al.  INVARIANT FACE AND OBJECT RECOGNITION IN THE VISUAL SYSTEM , 1997, Progress in Neurobiology.

[20]  Keiji Tanaka,et al.  Effects of shape-discrimination training on the selectivity of inferotemporal cells in adult monkeys. , 1998, Journal of neurophysiology.

[21]  E. Rolls,et al.  View-invariant representations of familiar objects by neurons in the inferior temporal visual cortex. , 1998, Cerebral cortex.

[22]  E. Miller,et al.  Neural Activity in the Primate Prefrontal Cortex during Associative Learning , 1998, Neuron.

[23]  Earl K. Miller,et al.  Selective representation of relevant information by neurons in the primate prefrontal cortex , 1998, Nature.

[24]  A. Toga,et al.  The Rhesus Monkey Brain in Stereotaxic Coordinates , 1999 .

[25]  R. Romo,et al.  Neuronal correlates of parametric working memory in the prefrontal cortex , 1999, Nature.

[26]  S. Wise,et al.  Rule-dependent neuronal activity in the prefrontal cortex , 1999, Experimental Brain Research.

[27]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[28]  R. Vogels.  Categorization of complex visual images by rhesus monkeys. Part 1: behavioural study , 1999, The European journal of neuroscience.

[29]  M. Shadlen,et al.  Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque , 1999, Nature Neuroscience.

[30]  N. P. Bichot,et al.  Effects of similarity and history on neural mechanisms of visual selection , 1999, Nature Neuroscience.

[31]  Y. Miyashita,et al.  Top-down signal from prefrontal cortex in executive control of memory retrieval , 1999, Nature.

[32]  E. Miller,et al.  Effects of Visual Experience on the Representation of Objects in the Prefrontal Cortex , 2000, Neuron.

[33]  E. Miller,et al.  THE PREFRONTAL CORTEX AND COGNITIVE CONTROL , 2000 .

[34]  E. Miller,et al.  Task-specific neural activity in the primate prefrontal cortex. , 2000, Journal of neurophysiology.

[35]  James K. Kroger,et al.  Cross-modal and cross-temporal association in neurons of frontal cortex , 2000, Nature.

[36]  Tomaso Poggio,et al.  Models of object recognition , 2000, Nature Neuroscience.

[37]  R. Romo,et al.  Neuronal correlates of sensory discrimination in the somatosensory cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[38]  E. Miller,et al.  The prefontral cortex and cognitive control , 2000, Nature Reviews Neuroscience.

[39]  N. Kanwisher.  Domain specificity in face perception , 2000, Nature Neuroscience.

[40]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[41]  R. Vogels,et al.  Inferotemporal neurons represent low-dimensional configurations of parameterized shapes , 2001, Nature Neuroscience.

[42]  David J. Freedman,et al.  Categorical representation of visual stimuli in the primate prefrontal cortex. , 2001, Science.

[43]  M. V. Van Hulle,et al.  Encoding of Categories by Noncategory-Specific Neurons in the Inferior Temporal Cortex , 2001, Journal of Cognitive Neuroscience.

[44]  K. C. Anderson,et al.  Single neurons in prefrontal cortex encode abstract rules , 2001, Nature.

[45]  T. Poggio,et al.  Neural mechanisms of object recognition , 2002, Current Opinion in Neurobiology.

[46]  N. Sigala,et al.  Visual categorization shapes feature selectivity in the primate temporal cortex , 2002, Nature.

[47]  M. Riesenhuber,et al.  Categorization in IT and PFC: Model and Experiments , 2002 .

[48]  B. Cohen,et al.  Spatial orientation of caloric nystagmus in semicircular canal-plugged monkeys. , 2002, Journal of neurophysiology.

[49]  David J. Freedman,et al.  Representation of the Quantity of Visual Items in the Primate Prefrontal Cortex , 2002, Science.

[50]  R. Romo,et al.  Temporal Evolution of a Decision-Making Process in Medial Premotor Cortex , 2002, Neuron.

[51]  R. Romo,et al.  Neuronal correlates of decision-making in secondary somatosensory cortex , 2002, Nature Neuroscience.

[52]  David J. Freedman,et al.  Visual categorization and the primate prefrontal cortex: neurophysiology and behavior. , 2002, Journal of neurophysiology.

[53]  M. Tarr,et al.  Visual Object Recognition , 1996, ISTCS.

[54]  M. Behrmann,et al.  Impact of learning on representation of parts and wholes in monkey inferotemporal cortex , 2002, Nature Neuroscience.

[55]  Leslie G. Ungerleider,et al.  Projections from inferior temporal cortex to prefrontal cortex via the uncinate fascicle in rhesus monkeys , 2004, Experimental Brain Research.

[56]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[57]  D. Perrett,et al.  Visual neurones responsive to faces in the monkey temporal cortex , 2004, Experimental Brain Research.

[58]  Christian R. Shelton,et al.  Morphable Surface Models , 2000, International Journal of Computer Vision.