Neural microgenesis of personally familiar face recognition

Significance We addressed the open question of how the human brain recognizes personally familiar faces. A dynamic visual-stimulation paradigm revealed that familiar face recognition is achieved first and foremost in medial and anterior temporal regions of the extended face-processing system. These regions, including the amygdala, respond categorically to individual familiar faces. In contrast, activation in posterior core face-preferential regions is associated with the amount of visual information available, irrespective of familiarity. Through integration of core and extended face-processing systems, these observations provide a common framework for understanding the neural basis of familiar face recognition. Despite a wealth of information provided by neuroimaging research, the neural basis of familiar face recognition in humans remains largely unknown. Here, we isolated the discriminative neural responses to unfamiliar and familiar faces by slowly increasing visual information (i.e., high-spatial frequencies) to progressively reveal faces of unfamiliar or personally familiar individuals. Activation in ventral occipitotemporal face-preferential regions increased with visual information, independently of long-term face familiarity. In contrast, medial temporal lobe structures (perirhinal cortex, amygdala, hippocampus) and anterior inferior temporal cortex responded abruptly when sufficient information for familiar face recognition was accumulated. These observations suggest that following detailed analysis of individual faces in core posterior areas of the face-processing network, familiar face recognition emerges categorically in medial temporal and anterior regions of the extended cortical face network.

[1]  J. Hegdé Time course of visual perception: Coarse-to-fine processing and beyond , 2008, Progress in Neurobiology.

[2]  Morgan D. Barense,et al.  Cerebral Cortex doi:10.1093/cercor/bhq004 Influence of Conceptual Knowledge on Visual Object Discrimination: Insights from , 2010 .

[3]  J. Haxby,et al.  Human neural systems for face recognition and social communication , 2002, Biological Psychiatry.

[4]  R. Goebel,et al.  Individual faces elicit distinct response patterns in human anterior temporal cortex , 2007, Proceedings of the National Academy of Sciences.

[5]  Keiji Tanaka,et al.  Matching Categorical Object Representations in Inferior Temporal Cortex of Man and Monkey , 2008, Neuron.

[6]  Andy C. H. Lee,et al.  Medial temporal lobe activity during complex discrimination of faces, objects, and scenes: Effects of viewpoint , 2009, Hippocampus.

[7]  I. Olson,et al.  The Enigmatic temporal pole: a review of findings on social and emotional processing. , 2007, Brain : a journal of neurology.

[8]  Hisao Nishijo,et al.  Neuronal correlates of face identification in the monkey anterior temporal cortical areas. , 2004, Journal of neurophysiology.

[9]  S. Levine,et al.  Right hemisphere superiority in the recognition of famous faces , 1982, Brain and Cognition.

[10]  Nikolaus F Troje,et al.  Face recognition is affected by similarity in spatial frequency range to a greater degree than within-category object recognition. , 2004, Journal of experimental psychology. Human perception and performance.

[11]  Aaron C. Koralek,et al.  Two Takes on the Social Brain: A Comparison of Theory of Mind Tasks , 2007, Journal of Cognitive Neuroscience.

[12]  L. Squire,et al.  When recognition memory is independent of hippocampal function , 2014, Proceedings of the National Academy of Sciences.

[13]  R. Watt Scanning from coarse to fine spatial scales in the human visual system after the onset of a stimulus. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[14]  Rainer Goebel,et al.  From Coarse to Fine? Spatial and Temporal Dynamics of Cortical Face Processing , 2010, Cerebral cortex.

[15]  Edward B. O'Neil,et al.  Perirhinal Cortex Contributes to Accuracy in Recognition Memory and Perceptual Discriminations , 2009, The Journal of Neuroscience.

[16]  Andreas Bartels,et al.  The neural correlates of maternal and romantic love , 2004, NeuroImage.

[17]  Bruno Rossion,et al.  Face Familiarity Decisions Take 200 msec in the Human Brain: Electrophysiological Evidence from a Go/No-go Speeded Task , 2014, Journal of Cognitive Neuroscience.

[18]  Ingrid R. Olson,et al.  Social cognition and the anterior temporal lobes , 2010, NeuroImage.

[19]  Rodrigo Quian Quiroga,et al.  Human medial temporal lobe neurons respond preferentially to personally relevant images , 2009, Proceedings of the National Academy of Sciences.

[20]  B. Rossion,et al.  Defining face perception areas in the human brain: A large-scale factorial fMRI face localizer analysis , 2012, Brain and Cognition.

[21]  J. Rodd,et al.  Anteromedial temporal cortex supports fine-grained differentiation among objects. , 2005, Cerebral cortex.

[22]  R. Maddock The retrosplenial cortex and emotion: new insights from functional neuroimaging of the human brain , 1999, Trends in Neurosciences.

[23]  J. Haxby,et al.  Neural systems for recognition of familiar faces , 2007, Neuropsychologia.

[24]  Rosemary A. Cowell,et al.  Components of recognition memory: Dissociable cognitive processes or just differences in representational complexity? , 2010, Hippocampus.

[25]  Andy C. H. Lee,et al.  Going beyond LTM in the MTL: A synthesis of neuropsychological and neuroimaging findings on the role of the medial temporal lobe in memory and perception , 2010, Neuropsychologia.

[26]  R. Wilcox Introduction to Robust Estimation and Hypothesis Testing , 1997 .

[27]  Marlene Behrmann,et al.  Unraveling the distributed neural code of facial identity through spatiotemporal pattern analysis , 2011, Proceedings of the National Academy of Sciences.

[28]  Kalanit Grill-Spector,et al.  Sparsely-distributed organization of face and limb activations in human ventral temporal cortex , 2010, NeuroImage.

[29]  G. Ojemann,et al.  Famous face identification in temporal lobe epilepsy: Support for a multimodal integration model of semantic memory , 2013, Cortex.

[30]  R. Henson,et al.  Neural activity associated with episodic memory for emotional context , 2001, Neuropsychologia.

[31]  W. Suzuki,et al.  Topographic organization of the reciprocal connections between the monkey entorhinal cortex and the perirhinal and parahippocampal cortices , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[32]  Takashi Tsukiura,et al.  Differential contributions of the anterior temporal and medial temporal lobe to the retrieval of memory for person identity information , 2008, Human brain mapping.

[33]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[34]  B. Rossion,et al.  The Speed of Recognition of Personally Familiar Faces , 2011, Perception.

[35]  L. Pessoa Emotion and cognition and the amygdala: From “what is it?” to “what's to be done?” , 2010, Neuropsychologia.

[36]  L. Saksida,et al.  Perirhinal cortex resolves feature ambiguity in complex visual discriminations , 2002, The European journal of neuroscience.

[37]  Andy C. H. Lee,et al.  Activating the medial temporal lobe during oddity judgment for faces and scenes. , 2008, Cerebral cortex.

[38]  Justin L. Vincent,et al.  Distinct cortical anatomy linked to subregions of the medial temporal lobe revealed by intrinsic functional connectivity. , 2008, Journal of neurophysiology.

[39]  Paul Wright,et al.  Objects and Categories: Feature Statistics and Object Processing in the Ventral Stream , 2013, Journal of Cognitive Neuroscience.

[40]  Tim Shallice,et al.  Recollection and familiarity in dense hippocampal amnesia: A case study , 2006, Neuropsychologia.

[41]  R N Henson,et al.  Mechanisms of top-down facilitation in perception of visual objects studied by FMRI. , 2007, Cerebral cortex.

[42]  Richard N. A. Henson,et al.  Recognition memory for faces and scenes in amnesia: Dissociable roles of medial temporal lobe structures , 2007, Neuropsychologia.

[43]  I Biederman,et al.  Neurocomputational bases of object and face recognition. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[44]  B. Duchaine,et al.  Introduction to this special issue on developmental prosopagnosia , 2012, Cognitive neuropsychology.

[45]  C. Ranganath,et al.  Two cortical systems for memory-guided behaviour , 2012, Nature Reviews Neuroscience.

[46]  I. Olson,et al.  Anterior temporal face patches: a meta-analysis and empirical study , 2013, Front. Hum. Neurosci..

[47]  Lars A. Ross,et al.  Social cognition and the anterior temporal lobes: a review and theoretical framework. , 2013, Social cognitive and affective neuroscience.

[48]  Peter Fransson,et al.  Access to the Published Version May Require Journal Subscription. Published with Permission From: Elsevier Fmri Activity in the Medial Temporal Lobe during Famous Face Processing , 2022 .

[49]  R Turner,et al.  Optimized EPI for fMRI studies of the orbitofrontal cortex , 2003, NeuroImage.

[50]  Patrik Vuilleumier,et al.  Memory for friends or foes: The social context of past encounters with faces modulates their subsequent neural traces in the brain , 2009, Social neuroscience.

[51]  M. Behrmann,et al.  Congenital prosopagnosia: face-blind from birth , 2005, Trends in Cognitive Sciences.

[52]  Andy C. H. Lee,et al.  It does not look odd to me: Perceptual impairments and eye movements in amnesic patients with medial temporal lobe damage , 2013, Neuropsychologia.

[53]  Bruno Rossion,et al.  Personally familiar faces are perceived categorically in face‐selective regions other than the fusiform face area , 2010, The European journal of neuroscience.

[54]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[55]  Doris Y. Tsao,et al.  Functional Compartmentalization and Viewpoint Generalization Within the Macaque Face-Processing System , 2010, Science.

[56]  Peter Mende-Siedlecki,et al.  Robust Selectivity for Faces in the Human Amygdala in the Absence of Expressions , 2013, Journal of Cognitive Neuroscience.

[57]  Margot J. Taylor,et al.  Neural correlates of personally familiar faces: Parents, partner and own faces , 2009, Human brain mapping.

[58]  V. Bruce,et al.  Recognition of unfamiliar faces , 2000, Trends in Cognitive Sciences.

[59]  Rand Wilcox Chapter 10 – Robust Regression , 2012 .

[60]  T. Bussey,et al.  Interaction of ventral and orbital prefrontal cortex with inferotemporal cortex in conditional visuomotor learning. , 2002, Behavioral neuroscience.

[61]  T. Allison,et al.  Face-sensitive regions in human extrastriate cortex studied by functional MRI. , 1995, Journal of neurophysiology.

[62]  Mark S. Seidenberg,et al.  Neural Systems Underlying the Recognition of Familiar and Newly Learned Faces , 2000, The Journal of Neuroscience.

[63]  Richard N. A. Henson,et al.  Perception and Conception: Temporal Lobe Activity during Complex Discriminations of Familiar and Novel Faces and Objects , 2011, Journal of Cognitive Neuroscience.

[64]  J. Barton Structure and function in acquired prosopagnosia: lessons from a series of 10 patients with brain damage. , 2008, Journal of neuropsychology.

[65]  Bruno Rossion,et al.  Face categorization in visual scenes may start in a higher order area of the right fusiform gyrus: evidence from dynamic visual stimulation in neuroimaging. , 2011, Journal of neurophysiology.

[66]  T. Schormann,et al.  Activation Reduction in Anterior Temporal Cortices during Repeated Recognition of Faces of Personal Acquaintances , 2001, NeuroImage.

[67]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[68]  Bruno Rossion,et al.  Understanding face perception by means of prosopagnosia and neuroimaging. , 2014, Frontiers in bioscience.

[69]  Rosemary A. Cowell,et al.  Functional Dissociations within the Ventral Object Processing Pathway: Cognitive Modules or a Hierarchical Continuum? , 2010, Journal of Cognitive Neuroscience.

[70]  J. Sergent,et al.  Functional neuroanatomy of face and object processing. A positron emission tomography study. , 1992, Brain : a journal of neurology.

[71]  H. P. Bahrick,et al.  Fifty years of memory for names and faces: A cross-sectional approach. , 1975 .

[72]  R. Tootell,et al.  An anterior temporal face patch in human cortex, predicted by macaque maps , 2009, Proceedings of the National Academy of Sciences.

[73]  Alice J. O'Toole,et al.  Spatiotemporal changes in neural response patterns to faces varying in visual familiarity , 2015, NeuroImage.

[74]  Susanne Ferber,et al.  Stimulus familiarity modulates functional connectivity of the perirhinal cortex and anterior hippocampus during visual discrimination of faces and objects , 2014, Front. Hum. Neurosci..

[75]  Nikolaus Kriegeskorte,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[76]  G. Yovel,et al.  Diagnosing prosopagnosia: Effects of ageing, sex, and participant–stimulus ethnic match on the Cambridge Face Memory Test and Cambridge Face Perception Test , 2009, Cognitive neuropsychology.

[77]  Andy C. H. Lee,et al.  The hippocampus and visual perception , 2012, Front. Hum. Neurosci..

[78]  Edward T. Bullmore,et al.  The hippocampal region is involved in successful recognition of both remote and recent famous faces , 2004, NeuroImage.

[79]  C. Carbon Famous Faces as Icons. The Illusion of Being an Expert in the Recognition of Famous Faces , 2008, Perception.

[80]  Frans A. J. Verstraten,et al.  Dynamics of visual recognition revealed by fMRI , 2006, NeuroImage.

[81]  Brenda Milner,et al.  Do I know you? Face perception and memory in patients with selective amygdalo-hippocampectomy , 2002, Neuropsychologia.

[82]  Brenda Milner,et al.  Visual recognition and recall after right temporal-lobe excision in man , 1968 .

[83]  A. Damasio,et al.  A role for left temporal pole in the retrieval of words for unique entities , 2001, Human brain mapping.

[84]  Ellen Leibenluft,et al.  Social and emotional attachment in the neural representation of faces , 2004, NeuroImage.

[85]  C. Büchel,et al.  The robustness of perception , 2005, The European journal of neuroscience.

[86]  Alexander Borst,et al.  How does Nature Program Neuron Types? , 2008, Front. Neurosci..

[87]  David Gaffan,et al.  Perirhinal cortical contributions to object perception , 2006, Trends in Cognitive Sciences.

[88]  J. Grafman,et al.  The Human Amygdala: An Evolved System for Relevance Detection , 2003, Reviews in the neurosciences.

[89]  S. Platek,et al.  Is family special to the brain? An event-related fMRI study of familiar, familial, and self-face recognition , 2009, Neuropsychologia.

[90]  K. Nakayama,et al.  Where cognitive development and aging meet: Face learning ability peaks after age 30 , 2011, Cognition.

[91]  J. Barton,et al.  Acquired prosopagnosia: structural basis and processing impairments. , 2014, Frontiers in bioscience.

[92]  J. Sergent Microgenesis of Face Perception , 1986 .

[93]  Edward B. O'Neil,et al.  Representational demands modulate involvement of perirhinal cortex in face processing , 2013, Hippocampus.

[94]  J. Mackie,et al.  What's to be done? , 1992 .

[95]  A R McIntosh,et al.  Episodic encoding and recognition of pictures and words: role of the human medial temporal lobes. , 2000, Acta psychologica.

[96]  Vaidehi S. Natu,et al.  The neural processing of familiar and unfamiliar faces: a review and synopsis. , 2011, British journal of psychology.

[97]  Joachim Bodamer,et al.  Die Prosop-Agnosie , 2004, Archiv für Psychiatrie und Nervenkrankheiten.

[98]  Bruno Rossion,et al.  The functionally defined right occipital and fusiform “face areas” discriminate novel from visually familiar faces , 2003, NeuroImage.

[99]  Taketoshi Ono,et al.  Neural Correlates of Associative Face Memory in the Anterior Inferior Temporal Cortex of Monkeys , 2010, The Journal of Neuroscience.

[100]  Nicholas B. Turk-Browne,et al.  Representations of individuals in ventral temporal cortex defined by faces and biographies , 2013, Neuropsychologia.

[101]  L. Saksida,et al.  Memory, perception, and the ventral visual‐perirhinal‐hippocampal stream: Thinking outside of the boxes , 2007, Hippocampus.

[102]  T. Schormann,et al.  Functional delineation of the human occipito-temporal areas related to face and scene processing. A PET study. , 2000, Brain : a journal of neurology.

[103]  C. Marra,et al.  Human Neuroscience , 2022 .

[104]  Hallvard Røe Evensmoen,et al.  Long-axis specialization of the human hippocampus , 2013, Trends in Cognitive Sciences.

[105]  Taketoshi Ono,et al.  Neural Representations of Personally Familiar and Unfamiliar Faces in the Anterior Inferior Temporal Cortex of Monkeys , 2011, Neuroscience Research.

[106]  K. Zilles,et al.  The neural correlates of person familiarity. A functional magnetic resonance imaging study with clinical implications. , 2001, Brain : a journal of neurology.

[107]  Neil Burgess,et al.  Neural bases of autobiographical support for episodic recollection of faces , 2009, Hippocampus.

[108]  L. Pessoa,et al.  Emotion processing and the amygdala: from a 'low road' to 'many roads' of evaluating biological significance , 2010, Nature Reviews Neuroscience.

[109]  Andreas Meyer-Lindenberg,et al.  Evidence for a general face salience signal in human amygdala , 2011, NeuroImage.

[110]  Alumit Ishai,et al.  Recognition memory of newly learned faces , 2006, Brain Research Bulletin.

[111]  Arne D. Ekstrom,et al.  Differential Connectivity of Perirhinal and Parahippocampal Cortices within Human Hippocampal Subregions Revealed by High-Resolution Functional Imaging , 2012, The Journal of Neuroscience.

[112]  Bruno Rossion,et al.  Face-specific impairment in holistic perception following focal lesion of the right anterior temporal lobe , 2014, Neuropsychologia.

[113]  R. Matthew Hutchison,et al.  Resting-state fMRI reveals functional connectivity between face-selective perirhinal cortex and the fusiform face area related to face inversion , 2014, NeuroImage.

[114]  Andrew J. Edmonds,et al.  Familiar and unfamiliar face recognition: A review , 2009, Memory.

[115]  E. Renzi,et al.  Apperceptive and Associative Forms of Prosopagnosia , 1991, Cortex.

[116]  B. Rossion,et al.  Right anterior temporal lobe atrophy and person-based semantic defect: A detailed case study , 2009, Neurocase.