Spatiotemporal changes in neural response patterns to faces varying in visual familiarity

Increasing experience with a previously unfamiliar face improves human ability to recognize it in challenging and novel viewing conditions. Differential neural responses to familiar versus unfamiliar faces in multiple regions of the ventral-temporal and parietal cortex have been reported in previous work, but with limited attention to how behavioral and neural measures change with increasing familiarity. We examined changes in the spatial and temporal characteristics of neural response patterns elicited by faces that vary in their degree of visual familiarity. First, we developed a behavioral paradigm to familiarize participants to low-, medium-, and high-levels of familiarity with faces. Recognition of novel, naturalistic images of the learned individuals improved with increasing familiarity with faces. Next, a new set of participants learned faces using the behavioral paradigm, outside the fMRI scanner, and subsequently viewed blocks of whole-body images of the learned and novel people, inside the scanner. We found that the face-selective FFA and OFA, and a combination of the ventral-temporal areas (e.g., fusiform gyrus) and parietal areas (e.g., precuneus) contained patterns useful for classifying highly familiar versus unfamiliar faces. Classification along the temporal-sequence of the face blocks revealed an early separation of neural patterns elicited in response to highly familiar versus unfamiliar faces in the FFA and OFA, but not in other regions of interest. This indicates the potential for a rapid assessment of the "known versus unknown" status of faces in core face-selective regions of the brain. The present study provides a first look at the perceptual and neural correlates underlying experience gains with faces as they become familiar.

[1]  Timothy J. Andrews,et al.  Differential sensitivity for viewpoint between familiar and unfamiliar faces in human visual cortex , 2008, NeuroImage.

[2]  T. Shallice,et al.  Neuroimaging evidence for dissociable forms of repetition priming. , 2000, Science.

[3]  J. Haxby,et al.  Neural response to the visual familiarity of faces , 2006, Brain Research Bulletin.

[4]  Ellen Leibenluft,et al.  Social and emotional attachment in the neural representation of faces , 2004, NeuroImage.

[5]  Karl J. Friston,et al.  How the brain learns to see objects and faces in an impoverished context , 1997, Nature.

[6]  Alice J. O'Toole,et al.  Neural correlates of own- and other-race face perception: Spatial and temporal response differences , 2011, NeuroImage.

[7]  C J Price,et al.  The neural systems sustaining face and proper-name processing. , 1998, Brain : a journal of neurology.

[8]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[9]  P. Schyns,et al.  Information and viewpoint dependence in face recognition , 1997, Cognition.

[10]  Vicki Bruce,et al.  Getting to know you: How we learn new faces , 2003 .

[11]  Pawan Sinha,et al.  Role of color in face recognition , 2010 .

[12]  A. Mike Burton,et al.  N250 ERP Correlates of the Acquisition of Face Representations across Different Images , 2009, Journal of Cognitive Neuroscience.

[13]  Bruno Rossion,et al.  How Does the Brain Discriminate Familiar and Unfamiliar Faces?: A PET Study of Face Categorical Perception , 2001, Journal of Cognitive Neuroscience.

[14]  E. Courchesne,et al.  The brain response to personally familiar faces in autism: findings of fusiform activity and beyond. , 2004, Brain : a journal of neurology.

[15]  Andrew J. Edmonds,et al.  Familiar and unfamiliar face recognition: A review , 2009, Memory.

[16]  Timothy J. Andrews,et al.  Distinct representations for facial identity and changeable aspects of faces in the human temporal lobe , 2004, NeuroImage.

[17]  R. Johnston,et al.  Exploring Levels of Face Familiarity by Using an Indirect Face-Matching Measure , 2002, Perception.

[18]  R. Johnston,et al.  Demonstrating how unfamiliar faces become familiar using a face matching task , 2005 .

[19]  P. Sinha,et al.  Contribution of Color to Face Recognition , 2002, Perception.

[20]  Norihiro Sadato,et al.  Neural substrates participating in acquisition of facial familiarity: an fMRI study , 2003, NeuroImage.

[21]  Kohki Yoshikawa,et al.  Neural substrates for the recognition of newly learned faces: a functional MRI study , 2000, Neuropsychologia.

[22]  Jerome Kagan,et al.  Differential amygdalar response to novel versus newly familiar neutral faces: a functional MRI probe developed for studying inhibited temperament , 2003, Biological Psychiatry.

[23]  V. Bruce,et al.  Face Recognition in Poor-Quality Video: Evidence From Security Surveillance , 1999 .

[24]  Raymond J. Dolan,et al.  Familiarity enhances invariance of face representations in human ventral visual cortex: fMRI evidence , 2005, NeuroImage.

[25]  Benjamin Balas,et al.  The Effect of Real-World Personal Familiarity on the Speed of Face Information Processing , 2007, PloS one.

[26]  Peter Fransson,et al.  Access to the Published Version May Require Journal Subscription. Published with Permission From: Elsevier Fmri Activity in the Medial Temporal Lobe during Famous Face Processing , 2022 .

[27]  Vaidehi S. Natu,et al.  The neural processing of familiar and unfamiliar faces: a review and synopsis. , 2011, British journal of psychology.

[28]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[29]  Gilles Pourtois,et al.  View-independent coding of face identity in frontal and temporal cortices is modulated by familiarity: an event-related fMRI study , 2005, NeuroImage.

[30]  V. Bruce,et al.  Effects of lighting on the perception of facial surfaces. , 1996, Journal of experimental psychology. Human perception and performance.

[31]  Hilla Peretz,et al.  Ju n 20 03 Schrödinger ’ s Cat : The rules of engagement , 2003 .

[32]  Manos Tsakiris,et al.  Predictive codes of familiarity and context during the perceptual learning of facial identities , 2013, Nature Communications.

[33]  K. Grill-Spector,et al.  Neural representations of faces and limbs neighbor in human high-level visual cortex: evidence for a new organization principle , 2011, Psychological Research.

[34]  Karl J. Friston Ten ironic rules for non-statistical reviewers , 2012, NeuroImage.

[35]  Mark S. Seidenberg,et al.  Neural Systems Underlying the Recognition of Familiar and Newly Learned Faces , 2000, The Journal of Neuroscience.

[36]  M. Crommelinck,et al.  Effect of Familiarity on the Processing of Human Faces , 1999, NeuroImage.

[37]  E. Leibenluft,et al.  Mothers' neural activation in response to pictures of their children and other children , 2004, Biological Psychiatry.

[38]  Robert A Johnston,et al.  Demonstrating the Acquired Familiarity of Faces by Using a Gender-Decision Task , 2004, Perception.

[39]  Galia Avidan,et al.  Functional MRI Reveals Compromised Neural Integrity of the Face Processing Network in Congenital Prosopagnosia , 2009, Current Biology.

[40]  Alice J. O'Toole,et al.  A video database of moving faces and people , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  V. Bruce,et al.  Recognition of unfamiliar faces , 2000, Trends in Cognitive Sciences.

[42]  Alice J. O'Toole,et al.  The neural representation of faces and bodies in motion and at rest , 2014, NeuroImage.

[43]  J. Haxby,et al.  Neural systems for recognition of familiar faces , 2007, Neuropsychologia.

[44]  Alice J. O'Toole,et al.  Dissociable Neural Patterns of Facial Identity across Changes in Viewpoint , 2010, Journal of Cognitive Neuroscience.

[45]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[46]  C. Price,et al.  Identification of famous faces and buildings: a functional neuroimaging study of semantically unique items. , 2001, Brain : a journal of neurology.

[47]  Leslie G. Ungerleider,et al.  Visual Imagery of Famous Faces: Effects of Memory and Attention Revealed by fMRI , 2002, NeuroImage.

[48]  Jasmin Cloutier,et al.  The influence of perceptual and knowledge-based familiarity on the neural substrates of face perception , 2011, Social neuroscience.

[49]  J. Sergent,et al.  Functional neuroanatomy of face and object processing. A positron emission tomography study. , 1992, Brain : a journal of neurology.

[50]  Bruno Rossion,et al.  The functionally defined right occipital and fusiform “face areas” discriminate novel from visually familiar faces , 2003, NeuroImage.

[51]  Nadim Joni Shah,et al.  Cortical Representations of Personally Familiar Objects and Places: Functional Organization of the Human Posterior Cingulate Cortex , 2005, Journal of Cognitive Neuroscience.

[52]  Michael Erb,et al.  Successful episodic memory retrieval of newly learned faces activates a left fronto-parietal network. , 2003, Brain research. Cognitive brain research.

[53]  Hervé Abdi,et al.  Learning the Moves: The Effect of Familiarity and Facial Motion on Person Recognition across Large Changes in Viewing Format , 2006, Perception.