Dissociable Neural Patterns of Facial Identity across Changes in Viewpoint

We examined the neural response patterns for facial identity independent of viewpoint and for viewpoint independent of identity. Neural activation patterns for identity and viewpoint were collected in an fMRI experiment. Faces appeared in identity-constant blocks, with variable viewpoint, and in viewpoint-constant blocks, with variable identity. Pattern-based classifiers were used to discriminate neural response patterns for all possible pairs of identities and viewpoints. To increase the likelihood of detecting distinct neural activation patterns for identity, we tested maximally dissimilar “face”–“antiface” pairs and normal face pairs. Neural response patterns for four of six identity pairs, including the “face”–“antiface” pairs, were discriminated at levels above chance. A behavioral experiment showed accord between perceptual and neural discrimination, indicating that the classifier tapped a high-level visual identity code. Neural activity patterns across a broad span of ventral temporal (VT) cortex, including fusiform gyrus and lateral occipital areas (LOC), were required for identity discrimination. For viewpoint, five of six viewpoint pairs were discriminated neurally. Viewpoint discrimination was most accurate with a broad span of VT cortex, but the neural and perceptual discrimination patterns differed. Less accurate discrimination of viewpoint, more consistent with human perception, was found in right posterior superior temporal sulcus, suggesting redundant viewpoint codes optimized for different functions. This study provides the first evidence that it is possible to dissociate neural activation patterns for identity and viewpoint independently.

[1]  R. Goebel,et al.  Individual faces elicit distinct response patterns in human anterior temporal cortex , 2007, Proceedings of the National Academy of Sciences.

[2]  Nikolaus F. Troje,et al.  Separation of texture and shape in images of faces for image coding and synthesis , 1997 .

[3]  G. Paxinos,et al.  Atlas of the Human Brain , 2000 .

[4]  Geraint Rees,et al.  Decoding the neural correlates of consciousness. , 2010, Current opinion in neurology.

[5]  Bruno Rossion,et al.  The roles of “face” and “non-face” areas during individual face perception: Evidence by fMRI adaptation in a brain-damaged prosopagnosic patient , 2008, NeuroImage.

[6]  V. Bruce,et al.  Recognition of unfamiliar faces , 2000, Trends in Cognitive Sciences.

[7]  A. O'Toole,et al.  Prototype-referenced shape encoding revealed by high-level aftereffects , 2001, Nature Neuroscience.

[8]  Marlene Behrmann,et al.  Unraveling the distributed neural code of facial identity through spatiotemporal pattern analysis , 2011, Proceedings of the National Academy of Sciences.

[9]  G. V. Van Hoesen,et al.  Prosopagnosia , 1982, Neurology.

[10]  R. Malach,et al.  Sub-exemplar shape tuning in human face-related areas. , 2007, Cerebral cortex.

[11]  T. Carlson,et al.  Patterns of Activity in the Categorical Representations of Objects , 2003 .

[12]  Alice J. O'Toole,et al.  Partially Distributed Representations of Objects and Faces in Ventral Temporal Cortex , 2005, Journal of Cognitive Neuroscience.

[13]  Stephen José Hanson,et al.  Combinatorial codes in ventral temporal lobe for object recognition: Haxby (2001) revisited: is there a “face” area? , 2004, NeuroImage.

[14]  N. Kanwisher,et al.  The fusiform face area subserves face perception, not generic within-category identification , 2004, Nature Neuroscience.

[15]  Giuseppe Iaria,et al.  The correlates of subjective perception of identity and expression in the face network: An fMRI adaptation study , 2009, NeuroImage.

[16]  Geraint Rees,et al.  Pattern classification using functional magnetic resonance imaging. , 2011, Wiley interdisciplinary reviews. Cognitive science.

[17]  Raymond J. Dolan,et al.  Familiarity enhances invariance of face representations in human ventral visual cortex: fMRI evidence , 2005, NeuroImage.

[18]  G. Pourtois,et al.  Object representations for multiple visual categories overlap in lateral occipital and medial fusiform cortex. , 2009, Cerebral cortex.

[19]  Gilles Pourtois,et al.  Portraits or People? Distinct Representations of Face Identity in the Human Visual Cortex , 2005, Journal of Cognitive Neuroscience.

[20]  N. Kanwisher,et al.  Face perception: domain specific, not process specific. , 2004, Neuron.

[21]  M. Young,et al.  Sparse population coding of faces in the inferotemporal cortex. , 1992, Science.

[22]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[23]  Timothy J. Andrews,et al.  Differential sensitivity for viewpoint between familiar and unfamiliar faces in human visual cortex , 2008, NeuroImage.

[24]  Michael S. Pratte,et al.  Decoding patterns of human brain activity. , 2012, Annual review of psychology.

[25]  H. Bülthoff,et al.  Face recognition under varying poses: The role of texture and shape , 1996, Vision Research.

[26]  Alice J. O'Toole,et al.  Neural correlates of own- and other-race face perception: Spatial and temporal response differences , 2011, NeuroImage.

[27]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[28]  Nouchine Hadjikhani,et al.  Neural basis of prosopagnosia: An fMRI study , 2002, Human brain mapping.

[29]  J. Haxby,et al.  Distinct representations of eye gaze and identity in the distributed human neural system for face perception , 2000, Nature Neuroscience.

[30]  David D. Cox,et al.  Functional magnetic resonance imaging (fMRI) “brain reading”: detecting and classifying distributed patterns of fMRI activity in human visual cortex , 2003, NeuroImage.

[31]  Tzvi Ganel,et al.  Effects of familiarity on the perceptual integrality of the identity and expression of faces: the parallel-route hypothesis revisited. , 2004, Journal of experimental psychology. Human perception and performance.

[32]  J. Keenan,et al.  Lesions of the fusiform face area impair perception of facial configuration in prosopagnosia , 2002, Neurology.

[33]  Vaidehi S. Natu,et al.  The neural processing of familiar and unfamiliar faces: a review and synopsis. , 2011, British journal of psychology.

[34]  Johan D. Carlin,et al.  Direction-Sensitive Codes for Observed Head Turns in Human Superior Temporal Sulcus , 2011, Cerebral cortex.

[35]  Stephan Eliez,et al.  Effect of head orientation on gaze processing in fusiform gyrus and superior temporal sulcus , 2003, NeuroImage.

[36]  J. Haxby,et al.  Human neural systems for face recognition and social communication , 2002, Biological Psychiatry.

[37]  F. Fang,et al.  Duration-dependent FMRI adaptation and distributed viewer-centered face representation in human visual cortex. , 2007, Cerebral cortex.

[38]  N. Kanwisher,et al.  Multivariate Patterns in Object-Selective Cortex Dissociate Perceptual and Physical Shape Similarity , 2008, PLoS biology.

[39]  Gilles Pourtois,et al.  View-independent coding of face identity in frontal and temporal cortices is modulated by familiarity: an event-related fMRI study , 2005, NeuroImage.

[40]  Alice J. O'Toole,et al.  CATEGORIZATION AND IDENTIFICATION OF HUMAN FACE IMAGES BY NEURAL NETWORKS: A REVIEW OF THE LINEAR AUTOASSOCIATIVE AND PRINCIPAL COMPONENT APPROACHES , 1994 .

[41]  Raymond J. Dolan,et al.  fMRI Activity Patterns in Human LOC Carry Information about Object Exemplars within Category , 2008, Journal of Cognitive Neuroscience.

[42]  Johan D. Carlin,et al.  A Head View-Invariant Representation of Gaze Direction in Anterior Superior Temporal Sulcus , 2011, Current Biology.

[43]  R. Vogels,et al.  Inferotemporal neurons represent low-dimensional configurations of parameterized shapes , 2001, Nature Neuroscience.

[44]  A. Treves,et al.  Morphing Marilyn into Maggie dissociates physical and identity face representations in the brain , 2005, Nature Neuroscience.

[45]  R. Savoy.  Functional Magnetic Resonance Imaging (fMRI) , 2002 .

[46]  Christopher J. Fox,et al.  Defining the face processing network: Optimization of the functional localizer in fMRI , 2009, Human brain mapping.

[47]  N. Kanwisher,et al.  The Neural Basis of the Behavioral Face-Inversion Effect , 2005, Current Biology.

[48]  A. Yuille,et al.  Opinion TRENDS in Cognitive Sciences Vol.10 No.7 July 2006 Special Issue: Probabilistic models of cognition Vision as Bayesian inference: analysis by synthesis? , 2022 .

[49]  S. Edelman,et al.  Toward direct visualization of the internal shape representation space by fMRI , 1998, Psychobiology.

[50]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[51]  G. McCarthy,et al.  When Strangers Pass , 2004, Psychological science.

[52]  S. Edelman,et al.  Differential Processing of Objects under Various Viewing Conditions in the Human Lateral Occipital Complex , 1999, Neuron.

[53]  N. Kanwisher,et al.  How Distributed Is Visual Category Information in Human Occipito-Temporal Cortex? An fMRI Study , 2002, Neuron.

[54]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[55]  T. Shallice,et al.  Neuroimaging evidence for dissociable forms of repetition priming. , 2000, Science.

[56]  Timothy J. Andrews,et al.  Distinct representations for facial identity and changeable aspects of faces in the human temporal lobe , 2004, NeuroImage.