Basic Level Category Structure Emerges Gradually across Human Ventral Visual Cortex

Objects can be simultaneously categorized at multiple levels of specificity ranging from very broad (“natural object”) to very distinct (“Mr. Woof”), with a mid-level of generality (basic level: “dog”) often providing the most cognitively useful distinction between categories. It is unknown, however, how this hierarchical representation is achieved in the brain. Using multivoxel pattern analyses, we examined how well each taxonomic level (superordinate, basic, and subordinate) of real-world object categories is represented across occipitotemporal cortex. We found that, although in early visual cortex objects are best represented at the subordinate level (an effect mostly driven by low-level feature overlap between objects in the same category), this advantage diminishes compared to the basic level as we move up the visual hierarchy, disappearing in object-selective regions of occipitotemporal cortex. This pattern stems from a combined increase in within-category similarity (category cohesion) and between-category dissimilarity (category distinctiveness) of neural activity patterns at the basic level, relative to both subordinate and superordinate levels, suggesting that successive visual areas may be optimizing basic level representations.

[1]  R. Brown How shall a thing be called. , 1958, Psychological review.

[2]  Wayne D. Gray,et al.  Basic objects in natural categories , 1976, Cognitive Psychology.

[3]  J. M. Anglin,et al.  Word, object, and conceptual development , 1977 .

[4]  Eleanor Rosch,et al.  Principles of Categorization , 1978 .

[5]  E. Markman,et al.  Developmental differences in the acquisition of basic and superordinate categories. , 1980 .

[6]  C. Mervis,et al.  Order of acquisition of subordinate-, basic-, and superordinate-level categories. , 1982 .

[7]  Stephen M. Kosslyn,et al.  Pictures and names: Making the connection , 1984, Cognitive Psychology.

[8]  J. Fodor,et al.  The Modularity of Mind: An Essay on Faculty Psychology , 1984 .

[9]  H. Brownell,et al.  Category differentiation in object recognition: typicality constraints on the basic category advantage. , 1985, Journal of experimental psychology. Learning, memory, and cognition.

[10]  J. Fodor The Modularity of mind. An essay on faculty psychology , 1986 .

[11]  G. Murphy,et al.  Categorizing objects in isolation and in scenes: what a superordinate is good for. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[12]  J. Tanaka,et al.  Object categories and expertise: Is the basic level in the eye of the beholder? , 1991, Cognitive Psychology.

[13]  R. Malach,et al.  Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[14]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[15]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[16]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[17]  Nancy Kanwisher,et al.  A cortical representation of the local visual environment , 1998, Nature.

[18]  J. Haxby,et al.  Attribute-based neural substrates in temporal cortex for perceiving and knowing about objects , 1999, Nature Neuroscience.

[19]  Z. Pylyshyn Is vision continuous with cognition? The case for cognitive impenetrability of visual perception. , 1999, The Behavioral and brain sciences.

[20]  A. A. Wijers,et al.  Visual semantic features are activated during the processing of concrete words: event-related potential evidence for perceptual semantic priming. , 2000, Brain research. Cognitive brain research.

[21]  Tomaso Poggio,et al.  Models of object recognition , 2000, Nature Neuroscience.

[22]  D. Schacter,et al.  Perceptual specificity in visual object priming: functional magnetic resonance imaging evidence for a laterality difference in fusiform cortex , 2001, Neuropsychologia.

[23]  N. Kanwisher,et al.  The Human Body , 2001 .

[24]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[25]  David J. Freedman,et al.  The prefrontal cortex: categories, concepts and cognition. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[26]  James L. McClelland,et al.  The parallel distributed processing approach to semantic cognition , 2003, Nature Reviews Neuroscience.

[27]  David D. Cox,et al.  Functional magnetic resonance imaging (fMRI) “brain reading”: detecting and classifying distributed patterns of fMRI activity in human visual cortex , 2003, NeuroImage.

[28]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[29]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[30]  G. Rees,et al.  Predicting the Stream of Consciousness from Activity in Human Visual Cortex , 2005, Current Biology.

[31]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[32]  P. Kay,et al.  Whorf hypothesis is supported in the right visual field but not the left. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[33]  K. Grill-Spector,et al.  Differential development of high-level visual cortex correlates with category-specific recognition memory , 2007, Nature Neuroscience.

[34]  Raymond J. Dolan,et al.  fMRI Activity Patterns in Human LOC Carry Information about Object Exemplars within Category , 2008, Journal of Cognitive Neuroscience.

[35]  K. Grill-Spector,et al.  Relating retinotopic and object-selective responses in human lateral occipital cortex. , 2008, Journal of neurophysiology.

[36]  A. Kleinschmidt,et al.  Graded size sensitivity of object-exemplar-evoked activity patterns within human LOC subregions. , 2008, Journal of neurophysiology.

[37]  David J. Freedman,et al.  Neural mechanisms of visual categorization: Insights from neurophysiology , 2008, Neuroscience & Biobehavioral Reviews.

[38]  Keiji Tanaka,et al.  Matching Categorical Object Representations in Inferior Temporal Cortex of Man and Monkey , 2008, Neuron.

[39]  Dirk B. Walther,et al.  Natural Scene Categories Revealed in Distributed Patterns of Activity in the Human Brain , 2009, The Journal of Neuroscience.

[40]  Michael L. Mack,et al.  Time course of visual object categorization: Fastest does not necessarily mean first , 2009, Vision Research.

[41]  Olivier R. Joubert,et al.  The Time-Course of Visual Categorizations: You Spot the Animal Faster than the Bird , 2009, PloS one.

[42]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[43]  S. Thompson-Schill,et al.  Conceptual Penetration of Visual Processing , 2010, Psychological science.

[44]  Petra E. Pajtas,et al.  Concordance between perceptual and categorical repetition effects in the ventral visual stream. , 2011, Journal of neurophysiology.

[45]  Yi Chen,et al.  Encoding the identity and location of objects in human LOC , 2011, NeuroImage.

[46]  J. S. Guntupalli,et al.  The Representation of Biological Classes in the Human Brain , 2012, The Journal of Neuroscience.

[47]  L. Tyler,et al.  Contrasting effects of feature-based statistics on the categorisation and basic-level identification of visual objects , 2012, Cognition.

[48]  A. Oliva,et al.  A Real-World Size Organization of Object Responses in Occipitotemporal Cortex , 2012, Neuron.

[49]  Jack L. Gallant,et al.  A Continuous Semantic Space Describes the Representation of Thousands of Object and Action Categories across the Human Brain , 2012, Neuron.

[50]  A. Caramazza,et al.  Brain Regions That Represent Amodal Conceptual Knowledge , 2013, The Journal of Neuroscience.

[51]  A. Caramazza,et al.  Tripartite Organization of the Ventral Stream by Animacy and Object Size , 2013, The Journal of Neuroscience.

[52]  P. Dupont,et al.  Similarity of fMRI Activity Patterns in Left Perirhinal Cortex Reflects Semantic Similarity between Words , 2013, The Journal of Neuroscience.

[53]  L. Tyler,et al.  Object-Specific Semantic Coding in Human Perirhinal Cortex , 2014, The Journal of Neuroscience.

[54]  Dwight J. Kravitz,et al.  Task context impacts visual object processing differentially across the cortex , 2014, Proceedings of the National Academy of Sciences.