Beyond perceptual expertise: revisiting the neural substrates of expert object recognition

Real-world expertise provides a valuable opportunity to understand how experience shapes human behavior and neural function. In the visual domain, the study of expert object recognition, such as in car enthusiasts or bird watchers, has produced a large, growing, and often-controversial literature. Here, we synthesize this literature, focusing primarily on results from functional brain imaging, and propose an interactive framework that incorporates the impact of high-level factors, such as attention and conceptual knowledge, in supporting expertise. This framework contrasts with the perceptual view of object expertise that has concentrated largely on stimulus-driven processing in visual cortex. One prominent version of this perceptual account has almost exclusively focused on the relation of expertise to face processing and, in terms of the neural substrates, has centered on face-selective cortical regions such as the Fusiform Face Area (FFA). We discuss the limitations of this face-centric approach as well as the more general perceptual view, and highlight that expert related activity is: (i) found throughout visual cortex, not just FFA, with a strong relationship between neural response and behavioral expertise even in the earliest stages of visual processing, (ii) found outside visual cortex in areas such as parietal and prefrontal cortices, and (iii) modulated by the attentional engagement of the observer suggesting that it is neither automatic nor driven solely by stimulus properties. These findings strongly support a framework in which object expertise emerges from extensive interactions within and between the visual system and other cognitive systems, resulting in widespread, distributed patterns of expertise-related activity across the entire cortex.

[1]  G. Orban,et al.  Neuronal Mechanisms of Perceptual Learning: Changes in Human Brain Activity with Training in Orientation Discrimination , 1999, NeuroImage.

[2]  Daniel C. Krawczyk,et al.  The neural organization of perception in chess experts , 2011, Neuroscience Letters.

[3]  J. Tanaka,et al.  A Neural Basis for Expert Object Recognition , 2001, Psychological science.

[4]  Cathy J. Price,et al.  A review and synthesis of the first 20 years of PET and fMRI studies of heard speech, spoken language and reading , 2012, NeuroImage.

[5]  N. Kanwisher Functional specificity in the human brain: A window into the functional architecture of the mind , 2010, Proceedings of the National Academy of Sciences.

[6]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[7]  Kathy E. Johnson,et al.  Impact of varying levels of expertise on decisions of category typicality , 2001, Memory & cognition.

[8]  P. Maquet,et al.  Neural correlates of perceptual learning: A functional MRI study of visual texture discrimination , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[9]  R. Malach,et al.  Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[10]  I. Gauthier,et al.  Expertise for cars and birds recruits brain areas involved in face recognition , 2000, Nature Neuroscience.

[11]  Andrew D. Engell,et al.  Distributed representations of dynamic facial expressions in the superior temporal sulcus. , 2010, Journal of vision.

[12]  Shaul Hochstein,et al.  The importance of being expert: Top-down attentional control in visual search with photographs , 2009, Attention, perception & psychophysics.

[13]  F. Gobet,et al.  The Cambridge handbook of expertise and expert performance , 2006 .

[14]  M. Riesenhuber,et al.  Categorization Training Results in Shape- and Category-Selective Human Neural Plasticity , 2007, Neuron.

[15]  Bradford Z. Mahon,et al.  Action-Related Properties Shape Object Representations in the Ventral Stream , 2007, Neuron.

[16]  Stephen M. Kosslyn,et al.  Pictures and names: Making the connection , 1984, Cognitive Psychology.

[17]  Nancy Kanwisher,et al.  A cortical representation of the local visual environment , 1998, Nature.

[18]  C. Urgesi,et al.  Action anticipation and motor resonance in elite basketball players , 2008, Nature Neuroscience.

[19]  Z. Pylyshyn Is vision continuous with cognition? The case for cognitive impenetrability of visual perception. , 1999, The Behavioral and brain sciences.

[20]  R. Yin Looking at Upside-down Faces , 1969 .

[21]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[22]  C. Baker,et al.  The neural basis of visual object learning , 2010, Trends in Cognitive Sciences.

[23]  J. Downar,et al.  The Effect of Task Relevance on the Cortical Response to Changes in Visual and Auditory Stimuli: An Event-Related fMRI Study , 2001, NeuroImage.

[24]  Z. Kourtzi,et al.  Learning Alters the Tuning of Functional Magnetic Resonance Imaging Patterns for Visual Forms , 2010, The Journal of Neuroscience.

[25]  D Sagi,et al.  Where practice makes perfect in texture discrimination: evidence for primary visual cortex plasticity. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[26]  Michael X. Cohen,et al.  Neural Mechanisms of Expert Skills in Visual Working Memory , 2006, The Journal of Neuroscience.

[27]  Eleanor A. Maguire,et al.  Thoughts, behaviour, and brain dynamics during navigation in the real world , 2006, NeuroImage.

[28]  N. Kanwisher,et al.  Can generic expertise explain special processing for faces? , 2007, Trends in Cognitive Sciences.

[29]  Bruno Rossion,et al.  Visual Expertise with Pictures of Cars Correlates with RT Magnitude of the Car Inversion Effect , 2010, Perception.

[30]  Marlene Behrmann,et al.  The joint development of hemispheric lateralization for words and faces. , 2012, Journal of experimental psychology. General.

[31]  Gui Xue,et al.  Language experience shapes fusiform activation when processing a logographic artificial language: An fMRI training study , 2006, NeuroImage.

[32]  Done-Sik Yoo,et al.  Neural correlates related to action observation in expert archers , 2011, Behavioural Brain Research.

[33]  David L. Sheinberg,et al.  The Training and Transfer of Real-World Perceptual Expertise , 2005, Psychological science.

[34]  P. Downing,et al.  Human Neuroscience , 2022 .

[35]  C. A. Rovira Acquiring knowledge , 1990 .

[36]  Scott D. Slotnick,et al.  The Fusiform Face Area , 2013 .

[37]  A. Young,et al.  ARE FACES SPECIAL , 1989 .

[38]  J. Haxby,et al.  Distributed Neural Systems for Face Perception , 2011 .

[39]  J. Maunsell,et al.  The Effect of Perceptual Learning on Neuronal Responses in Monkey Visual Area V4 , 2004, The Journal of Neuroscience.

[40]  Alex Martin,et al.  A neural system for learning about object function. , 2006, Cerebral cortex.

[41]  anonymous,et al.  Visual agnosia , 2012, BMJ : British Medical Journal.

[42]  Isabel Gauthier,et al.  Measurement of visual and semantic knowledge for cars and estimation of experience , 2013 .

[43]  Daniel D. Dilks,et al.  Differential selectivity for dynamic versus static information in face-selective cortical regions , 2011, NeuroImage.

[44]  S. Hochstein,et al.  The reverse hierarchy theory of visual perceptual learning , 2004, Trends in Cognitive Sciences.

[45]  E. Warrington,et al.  Visual associative agnosia: a clinico-anatomical study of a single case. , 1986, Journal of neurology, neurosurgery, and psychiatry.

[46]  C. Baker,et al.  Informativeness and learning: Response to Gauthier and colleagues , 2010, Trends in Cognitive Sciences.

[47]  Yetta Kwailing Wong,et al.  A Multimodal Neural Network Recruited by Expertise with Musical Notation , 2010, Journal of Cognitive Neuroscience.

[48]  Kathy E. Johnson,et al.  Effects of varying levels of expertise on the basic level of categorization. , 1997, Journal of experimental psychology. General.

[49]  Shlomo Bentin,et al.  Are All Types of Expertise Created Equal? Car Experts Use Different Spatial Frequency Scales for Subordinate Categorization of Cars and Faces , 2013, PloS one.

[50]  Michel Vidal-Naquet,et al.  Visual features of intermediate complexity and their use in classification , 2002, Nature Neuroscience.

[51]  T. Busey,et al.  Behavioral and electrophysiological evidence for configural processing in fingerprint experts , 2005, Vision Research.

[52]  R. Malach,et al.  Top-down engagement modulates the neural expressions of visual expertise. , 2010, Cerebral cortex.

[53]  D. Medin,et al.  The native mind: biological categorization and reasoning in development and across cultures. , 2004, Psychological review.

[54]  Thomas W. James,et al.  Expert individuation of objects increases activation in the fusiform face area of children , 2013, NeuroImage.

[55]  Richard S. J. Frackowiak,et al.  Navigation-related structural change in the hippocampi of taxi drivers. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[56]  E. Maguire,et al.  London taxi drivers and bus drivers: A structural MRI and neuropsychological analysis , 2006, Hippocampus.

[57]  Nancy Kanwisher,et al.  Heritability of the Specific Cognitive Ability of Face Perception , 2010, Current Biology.

[58]  M. Behrmann,et al.  Impact of learning on representation of parts and wholes in monkey inferotemporal cortex , 2002, Nature Neuroscience.

[59]  Alexander M. Harner,et al.  Task-dependent influences of attention on the activation of human primary visual cortex. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[60]  Michael Erb,et al.  Mechanisms and neural basis of object and pattern recognition: a study with chess experts. , 2010, Journal of experimental psychology. General.

[61]  Peter Indefrey,et al.  Formation of Category Representations in Superior Temporal Sulcus , 2010, Journal of Cognitive Neuroscience.

[62]  N. Kanwisher,et al.  Does the human brain process objects of expertise like faces? A review of the evidence , 2005 .

[63]  Guillén Fernández,et al.  Task- and Experience-dependent Cortical Selectivity to Features Informative for Categorization , 2014, Journal of Cognitive Neuroscience.

[64]  Wayne D. Gray,et al.  Basic objects in natural categories , 1976, Cognitive Psychology.

[65]  Isabel Gauthier,et al.  Expertise with characters in alphabetic and nonalphabetic writing systems engage overlapping occipito-temporal areas , 2009, Cognitive neuropsychology.

[66]  N. Kanwisher,et al.  The Human Body , 2001 .

[67]  M. Tarr,et al.  FFA: a flexible fusiform area for subordinate-level visual processing automatized by expertise , 2000, Nature Neuroscience.

[68]  E Macaluso,et al.  Action anticipation beyond the action observation network: a functional magnetic resonance imaging study in expert basketball players , 2012, The European journal of neuroscience.

[69]  C. Koch,et al.  Invariant visual representation by single neurons in the human brain , 2005, Nature.

[70]  S. Carey Becoming a face expert. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[71]  Cindy M. Bukach,et al.  Beyond faces and modularity: the power of an expertise framework , 2006, Trends in Cognitive Sciences.

[72]  A. Chan,et al.  Functional organization and visual representations of human ventral lateral prefrontal cortex , 2013, Front. Psychol..

[73]  I. Gauthier,et al.  Beyond Shape: How You Learn about Objects Affects How They Are Represented in Visual Cortex , 2009, PloS one.

[74]  I. Gauthier,et al.  Computational approaches to the development of perceptual expertise , 2004, Trends in Cognitive Sciences.

[75]  I. Gauthier,et al.  Visual object understanding , 2004, Nature Reviews Neuroscience.

[76]  R. Vogels,et al.  Inferotemporal neurons represent low-dimensional configurations of parameterized shapes , 2001, Nature Neuroscience.

[77]  Rankin W. McGugin,et al.  High-resolution imaging of expertise reveals reliable object selectivity in the fusiform face area related to perceptual performance , 2012, Proceedings of the National Academy of Sciences.

[78]  N. Kanwisher,et al.  Visual word processing and experiential origins of functional selectivity in human extrastriate cortex , 2007, Proceedings of the National Academy of Sciences.

[79]  David L. Sheinberg,et al.  The role of category learning in the acquisition and retention of perceptual expertise: A behavioral and neurophysiological study , 2008, Brain Research.

[80]  N. Kanwisher Domain specificity in face perception , 2000, Nature Neuroscience.

[81]  D. Maurer,et al.  The many faces of configural processing , 2002, Trends in Cognitive Sciences.

[82]  Geraint Rees,et al.  Neuroanatomical correlates of visual car expertise , 2012, NeuroImage.

[83]  Paul J. Feltovich,et al.  The Cambridge handbook of expertise and expert performance , 2006 .

[84]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[85]  Rachel A Robbins,et al.  No face-like processing for objects-of-expertise in three behavioural tasks , 2007, Cognition.

[86]  S. Dehaene,et al.  How Learning to Read Changes the Cortical Networks for Vision and Language , 2010, Science.

[87]  Chris I. Baker,et al.  Beyond perceptual expertise: Revisiting the neural substrates of expert object recognition , 2014 .

[88]  Rankin W. McGugin,et al.  The Vanderbilt Expertise Test reveals domain-general and domain-specific sex effects in object recognition , 2012, Vision Research.

[89]  David L. Sheinberg,et al.  Effects of Long-Term Visual Experience on Responses of Distinct Classes of Single Units in Inferior Temporal Cortex , 2012, Neuron.

[90]  B. Duchaine,et al.  The Cambridge Car Memory Test: A task matched in format to the Cambridge Face Memory Test, with norms, reliability, sex differences, dissociations from face memory, and expertise effects , 2012, Behavior research methods.

[91]  Nikolaus Kriegeskorte,et al.  The Emergence of Semantic Meaning in the Ventral Temporal Pathway , 2014, Journal of Cognitive Neuroscience.

[92]  S. Thompson-Schill,et al.  Conceptual Penetration of Visual Processing , 2010, Psychological science.

[93]  P. Mcmullen,et al.  Effects of orientation on the identification of rotated objects depend on the level of identity. , 1998, Journal of experimental psychology. Human perception and performance.

[94]  Stephen A. Engel,et al.  Engagement of Fusiform Cortex and Disengagement of Lateral Occipital Cortex in the Acquisition of Radiological Expertise , 2009, Cerebral cortex.

[95]  N. Kanwisher,et al.  The fusiform face area subserves face perception, not generic within-category identification , 2004, Nature Neuroscience.

[96]  C. Furmanski,et al.  Learning Strengthens the Response of Primary Visual Cortex to Simple Patterns , 2004, Current Biology.

[97]  E. Maguire,et al.  Acquiring “the Knowledge” of London's Layout Drives Structural Brain Changes , 2011, Current Biology.

[98]  D. Plaut,et al.  Distributed circuits, not circumscribed centers, mediate visual recognition , 2013, Trends in Cognitive Sciences.

[99]  Cindy M. Bukach,et al.  Limits of generalization between categories and implications for theories of category specificity , 2010, Attention, perception & psychophysics.

[100]  Russell A. Epstein Parahippocampal and retrosplenial contributions to human spatial navigation , 2008, Trends in Cognitive Sciences.

[101]  Dwight J. Kravitz,et al.  The ventral visual pathway: an expanded neural framework for the processing of object quality , 2013, Trends in Cognitive Sciences.

[102]  G. Yovel,et al.  Diagnosing prosopagnosia: Effects of ageing, sex, and participant–stimulus ethnic match on the Cambridge Face Memory Test and Cambridge Face Perception Test , 2009, Cognitive neuropsychology.

[103]  Neil Charness,et al.  Expertise in chess , 2006 .

[104]  Ken Nakayama,et al.  Capturing specific abilities as a window into human individuality: The example of face recognition , 2012, Cognitive neuropsychology.

[105]  G. Orban,et al.  Practising orientation identification improves orientation coding in V1 neurons , 2001, Nature.

[106]  Shimon Ullman,et al.  Mutual information of image fragments predicts categorization in humans: Electrophysiological and behavioral evidence , 2007, Vision Research.

[107]  Yaoda Xu Revisiting the role of the fusiform face area in visual expertise. , 2005, Cerebral cortex.

[108]  Johan Wagemans,et al.  Activation of Fusiform Face Area by Greebles Is Related to Face Similarity but Not Expertise , 2011, Journal of Cognitive Neuroscience.

[109]  L. Liversedge THE NATURE OF EXPERIENCE , 1959 .

[110]  I. Biederman,et al.  What makes faces special? , 2006, Vision Research.

[111]  Isabel Gauthier,et al.  Individual differences in FFA activity suggest independent processing at different spatial scales , 2005, Cognitive, affective & behavioral neuroscience.

[112]  Dwight J. Kravitz,et al.  A new neural framework for visuospatial processing , 2011, Nature Reviews Neuroscience.

[113]  I. Gauthier,et al.  Perceptual interference supports a non-modular account of face processing , 2003, Nature Neuroscience.

[114]  E. McKone,et al.  Solving the upside-down puzzle: Why do upright and inverted face aftereffects look alike? , 2010, Journal of vision.

[115]  S. Bentin,et al.  Domain specificity versus expertise: factors influencing distinct processing of faces , 2002, Cognition.

[116]  Bruno Rossion,et al.  Long-term Expertise with Artificial Objects Increases Visual Competition with Early Face Categorization Processes , 2007, Journal of Cognitive Neuroscience.

[117]  Shimon Ullman,et al.  Basic-level categorization of intermediate complexity fragments reveals top-down effects of expertise in visual perception. , 2011, Journal of vision.

[118]  W. Grodd,et al.  Many Faces of Expertise: Fusiform Face Area in Chess Experts and Novices , 2011, The Journal of Neuroscience.

[119]  A. Harel,et al.  Association and dissociation between detection and discrimination of objects of expertise: Evidence from visual search , 2014, Attention, perception & psychophysics.

[120]  Shlomo Bentin,et al.  Stimulus type, level of categorization, and spatial-frequencies utilization: implications for perceptual categorization hierarchies. , 2009, Journal of experimental psychology. Human perception and performance.

[121]  J. Tanaka The entry point of face recognition: evidence for face expertise. , 2001, Journal of experimental psychology. General.

[122]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[123]  Hashim Hanif,et al.  Relating visual to verbal semantic knowledge: the evaluation of object recognition in prosopagnosia. , 2009, Brain : a journal of neurology.

[124]  S. Carey,et al.  Why faces are and are not special: an effect of expertise. , 1986, Journal of experimental psychology. General.

[125]  Philippe G Schyns,et al.  Diagnostic recognition: task constraints, object information, and their interactions , 1998, Cognition.

[126]  M. Tarr,et al.  Becoming a “Greeble” Expert: Exploring Mechanisms for Face Recognition , 1997, Vision Research.

[127]  S. Dehaene,et al.  The unique role of the visual word form area in reading , 2011, Trends in Cognitive Sciences.

[128]  Martin Skov,et al.  Brain correlates of aesthetic expertise: A parametric fMRI study , 2009, Brain and Cognition.

[129]  Keiji Tanaka,et al.  Effects of shape-discrimination training on the selectivity of inferotemporal cells in adult monkeys. , 1998, Journal of neurophysiology.

[130]  M. Tarr,et al.  Activation of the middle fusiform 'face area' increases with expertise in recognizing novel objects , 1999, Nature Neuroscience.

[131]  N. Kanwisher,et al.  The M170 is selective for faces, not for expertise , 2005, Neuropsychologia.

[132]  N. Kanwisher,et al.  Discrimination Training Alters Object Representations in Human Extrastriate Cortex , 2006, The Journal of Neuroscience.

[133]  K. A. Ericsson,et al.  Expert and exceptional performance: evidence of maximal adaptation to task constraints. , 1996, Annual review of psychology.

[134]  M. Tarr,et al.  Unraveling mechanisms for expert object recognition: bridging brain activity and behavior. , 2002, Journal of experimental psychology. Human perception and performance.

[135]  M. Tarr,et al.  Expertise Training with Novel Objects Leads to Left-Lateralized Facelike Electrophysiological Responses , 2002, Psychological science.

[136]  Hugo J Spiers,et al.  Talent in the taxi: a model system for exploring expertise , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[137]  Michael Erb,et al.  Expertise modulates the neural basis of context dependent recognition of objects and their relations , 2012, Human brain mapping.

[138]  Zhongzhi Shi,et al.  Visual Perceptual Learning , 2005, 2005 International Conference on Neural Networks and Brain.

[139]  W. K. Simmons,et al.  The Selectivity and Functional Connectivity of the Anterior Temporal Lobes , 2009, Cerebral cortex.

[140]  Michael J. Tarr,et al.  Objects of Expertise , 2009 .

[141]  Jonathan R. Folstein,et al.  The nature of experience determines object representations in the visual system. , 2012, Journal of experimental psychology. General.

[142]  Yuka Sasaki,et al.  Different Dynamics of Performance and Brain Activation in the Time Course of Perceptual Learning , 2008, Neuron.

[143]  Shaul Hochstein,et al.  At first sight: A high-level pop out effect for faces , 2005, Vision Research.

[144]  G. Rhodes,et al.  Is the Fusiform Face Area Specialized for Faces, Individuation, or Expert Individuation? , 2004, Journal of Cognitive Neuroscience.