A face is more than just the eyes, nose, and mouth: fMRI evidence that face-selective cortex represents external features

&NA; What is a face? Intuition, along with abundant behavioral and neural evidence, indicates that internal features (e.g., eyes, nose, mouth) are critical for face recognition, yet some behavioral and neural findings suggest that external features (e.g., hair, head outline, neck and shoulders) may likewise be processed as a face. Here we directly test this hypothesis by investigating how external (and internal) features are represented in the brain. Using fMRI, we found highly selective responses to external features (relative to objects and scenes) within the face processing system in particular, rivaling that observed for internal features. We then further asked how external and internal features are represented in regions of the cortical face processing system, and found a similar division of labor for both kinds of features, with the occipital face area and posterior superior temporal sulcus representing the parts of both internal and external features, and the fusiform face area representing the coherent arrangement of both internal and external features. Taken together, these results provide strong neural evidence that a “face” is composed of both internal and external features. HighlightsFace regions represent external features (hair, head outline, neck and shoulders).Selectivity for external features rivals that for internal features.OFA and pSTS represent the parts of both internal and external features.FFA represents the coherent arrangement of both internal and external features.A “face” is composed of both internal and external features.

[1]  Nancy Kanwisher,et al.  An algorithmic method for functionally defining regions of interest in the ventral visual pathway , 2012, NeuroImage.

[2]  Alison Harris,et al.  The Representation of Parts and Wholes in Face-selective Cortex , 2008, Journal of Cognitive Neuroscience.

[3]  David E. Osher,et al.  Innate connectivity patterns drive the development of the visual word form area , 2020, Scientific Reports.

[5]  Timothy J. Andrews,et al.  Internal and External Features of the Face Are Represented Holistically in Face-Selective Regions of Visual Cortex , 2010, The Journal of Neuroscience.

[6]  K. Nakayama,et al.  RESPONSE PROPERTIES OF THE HUMAN FUSIFORM FACE AREA , 2000, Cognitive neuropsychology.

[7]  G. Winocur,et al.  What Is Special about Face Recognition? Nineteen Experiments on a Person with Visual Object Agnosia and Dyslexia but Normal Face Recognition , 1997, Journal of Cognitive Neuroscience.

[8]  Leslie G. Ungerleider,et al.  Visual Imagery of Famous Faces: Effects of Memory and Attention Revealed by fMRI , 2002, NeuroImage.

[9]  N. Kanwisher,et al.  Mental Imagery of Faces and Places Activates Corresponding Stimulus-Specific Brain Regions , 2000, Journal of Cognitive Neuroscience.

[10]  Alison J. Wiggett,et al.  Functional MRI analysis of body and body part representations in the extrastriate and fusiform body areas. , 2007, Journal of neurophysiology.

[11]  H. Ellis,et al.  Identification of Familiar and Unfamiliar Faces from Internal and External Features: Some Implications for Theories of Face Recognition , 1979, Perception.

[12]  J. Tanaka,et al.  Features and their configuration in face recognition , 1997, Memory & cognition.

[13]  Radoslaw Martin Cichy,et al.  Imagery and perception share cortical representations of content and location. , 2012, Cerebral Cortex.

[14]  Rebecca F. Schwarzlose,et al.  Separate Face and Body Selectivity on the Fusiform Gyrus , 2005, The Journal of Neuroscience.

[15]  Doris Y. Tsao,et al.  The Code for Facial Identity in the Primate Brain , 2017, Cell.

[16]  Jia Liu,et al.  Perception of Face Parts and Face Configurations: An fMRI Study , 2010, Journal of Cognitive Neuroscience.

[17]  Anders M. Dale,et al.  An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest , 2006, NeuroImage.

[18]  Scott P. Johnson,et al.  Newborn Infants' Preference for Attractive Faces: The Role of Internal and External Facial Features. , 2000, Infancy : the official journal of the International Society on Infant Studies.

[19]  Mark Blades,et al.  Recognizing people from the inner or outer parts of their faces , 2003 .

[20]  A. Ishai,et al.  Distributed neural systems for the generation of visual images , 2000, NeuroImage.

[21]  Nancy Kanwisher,et al.  Connectivity precedes function in the development of the visual word form area , 2016, Nature Neuroscience.

[22]  M. Seghier,et al.  A network of occipito-temporal face-sensitive areas besides the right middle fusiform gyrus is necessary for normal face processing. , 2003, Brain : a journal of neurology.

[23]  N. Kanwisher,et al.  Domain specificity in visual cortex. , 2006, Cerebral cortex.

[24]  Galit Yovel,et al.  External facial features modify the representation of internal facial features in the fusiform face area , 2010, NeuroImage.

[25]  Daniel D. Dilks,et al.  Perceived egocentric distance sensitivity and invariance across scene-selective cortex , 2016, Cortex.

[26]  D. Maurer,et al.  Neural correlates of processing facial identity based on features versus their spacing , 2007, Neuropsychologia.

[27]  Daniel D. Dilks,et al.  Differential selectivity for dynamic versus static information in face-selective cortical regions , 2011, NeuroImage.

[28]  Z Kourtzi,et al.  Representation of Perceived Object Shape by the Human Lateral Occipital Complex , 2001, Science.

[29]  G. Yovel,et al.  TMS Evidence for the Involvement of the Right Occipital Face Area in Early Face Processing , 2007, Current Biology.

[30]  Geraint Rees,et al.  Perception and Processing of Faces in the Human Brain Is Tuned to Typical Feature Locations , 2016, The Journal of Neuroscience.

[31]  John T. Clark,et al.  Contextually Evoked Object-Specific Responses in Human Visual Cortex , 2004 .

[32]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  J. Barton,et al.  Neuroanatomic correlates of the feature-salience hierarchy in face processing: An fMRI -adaptation study , 2014, Neuropsychologia.

[34]  Naphtali Abudarham,et al.  Reverse engineering the face space: Discovering the critical features for face identification. , 2014, Journal of vision.

[35]  M. Eimer The face‐specific N170 component reflects late stages in the structural encoding of faces , 2000, Neuroreport.

[36]  Nancy Kanwisher,et al.  The occipital place area represents the local elements of scenes. , 2015, Journal of vision.

[37]  Daniel D. Dilks,et al.  Organization of high-level visual cortex in human infants , 2017, Nature Communications.

[38]  Bruno Rossion,et al.  Faces are represented holistically in the human occipito-temporal cortex , 2006, NeuroImage.

[39]  Jason M. Gold,et al.  The response of face-selective cortex with single face parts and part combinations , 2012, Neuropsychologia.

[40]  R W Cox,et al.  Real‐time 3D image registration for functional MRI , 1999, Magnetic resonance in medicine.

[41]  Marlene Behrmann,et al.  Feature-based face representations and image reconstruction from behavioral and neural data , 2015, Proceedings of the National Academy of Sciences.

[42]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.

[43]  M. Farah,et al.  What is "special" about face perception? , 1998, Psychological review.

[44]  Galit Yovel,et al.  Nonpreferred Stimuli Modify the Representation of Faces in the Fusiform Face Area , 2011, Journal of Cognitive Neuroscience.

[45]  M Moscovitch,et al.  SUPER FACE-INVERSION EFFECTS FOR ISOLATED INTERNAL OR EXTERNAL FEATURES, AND FOR FRACTURED FACES , 2000, Cognitive neuropsychology.

[46]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[47]  N. Kanwisher,et al.  The Human Body , 2001 .

[48]  A. O'Toole,et al.  The Role of the Face and Body in Unfamiliar Person Identification , 2013 .

[49]  Alice J. O'Toole,et al.  Person recognition: Qualitative differences in how forensic face examiners and untrained people rely on the face versus the body for identification , 2017 .

[50]  T. Poggio,et al.  I think I know that face... , 1996, Nature.

[51]  Simon Baron-Cohen,et al.  The Development of Differential Use of Inner and Outer Face Features in Familiar Face Identification. , 1995 .

[52]  Rebecca F. Schwarzlose,et al.  Separate face and body selectivity on the fusiform gyrus. , 2010, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[53]  Skyler T. Hawk,et al.  Presentation and validation of the Radboud Faces Database , 2010 .

[54]  Alison Harris,et al.  Neural tuning for face wholes and parts in human fusiform gyrus revealed by FMRI adaptation. , 2010, Journal of neurophysiology.

[55]  Tom Hartley,et al.  A data driven approach to understanding the organization of high-level visual cortex , 2017, Scientific Reports.

[56]  Nancy Kanwisher,et al.  Connectivity precedes function in the development of the visual word form area , 2016, Nature Neuroscience.

[57]  Doris Y. Tsao,et al.  A face feature space in the macaque temporal lobe , 2009, Nature Neuroscience.

[58]  Jason M. Gold,et al.  Inversion Effects in Face-selective Cortex with Combinations of Face Parts , 2013, Journal of Cognitive Neuroscience.

[59]  P. Downing,et al.  Selectivity for the human body in the fusiform gyrus. , 2005, Journal of neurophysiology.

[60]  Nancy Kanwisher,et al.  A cortical representation of the local visual environment , 1998, Nature.

[61]  Xiaobai Li,et al.  The Fusiform Face Area Is Engaged in Holistic, Not Parts-Based, Representation of Faces , 2012, PloS one.

[62]  Barbara Tillmann,et al.  Pitch-Responsive Cortical Regions in Congenital Amusia , 2016, The Journal of Neuroscience.

[63]  Sing-Hang Cheung,et al.  Processing of configural and componential information in face-selective cortical areas , 2014, Cognitive neuroscience.

[64]  Pawan Sinha,et al.  Relative Contributions of Internal and External Features to Face Recognition , 2003 .

[65]  A face inversion effect without a face , 2012 .

[66]  Hugh R. Wilson,et al.  Heterogeneous Structure in Face-selective Human Occipito-temporal Cortex , 2010, Journal of Cognitive Neuroscience.

[67]  N. Kanwisher,et al.  Face perception: domain specific, not process specific. , 2004, Neuron.

[68]  Galit Yovel,et al.  An Integrated Face–Body Representation in the Fusiform Gyrus but Not the Lateral Occipital Cortex , 2014, Journal of Cognitive Neuroscience.

[69]  S. Edelman,et al.  Human Brain Mapping 6:316–328(1998) � A Sequence of Object-Processing Stages Revealed by fMRI in the Human Occipital Lobe , 2022 .

[70]  V Bruce,et al.  Familiarisation with Faces Selectively Enhances Sensitivity to Changes Made to the Eyes , 2001, Perception.

[71]  R. Goebel,et al.  Holistic perception of individual faces in the right middle fusiform gyrus as evidenced by the composite face illusion. , 2010, Journal of vision.

[72]  Daniel D. Dilks,et al.  The occipital place area represents the local elements of scenes , 2016, NeuroImage.

[73]  A. Young,et al.  Configurational Information in Face Perception , 1987, Perception.

[74]  Irene Leo,et al.  Newborns' face recognition: role of inner and outer facial features. , 2006, Child development.

[75]  Bruno Rossion,et al.  Does Prosopagnosia Take the Eyes Out of Face Representations? Evidence for a Defect in Representing Diagnostic Facial Information following Brain Damage , 2005, Journal of Cognitive Neuroscience.

[76]  R. Campbell,et al.  Recognition of Parts of Famous-Face Photographs by Children: An Experimental Note , 1995, Perception.

[77]  K. Grill-Spector The neural basis of object perception , 2003, Current Opinion in Neurobiology.