Perceptual and Semantic Phases of Face Identification Processing: A Multivariate Electroencephalography Study

Rapid identification of a familiar face requires an image-invariant representation of person identity. A varying sample of familiar faces is necessary to disentangle image-level from person-level processing. We investigated the time course of face identity processing using a multivariate electroencephalography analysis. Participants saw ambient exemplars of celebrity faces that differed in pose, lighting, hairstyle, and so forth. A name prime preceded a face on half of the trials to preactivate person-specific information, whereas a neutral prime was used on the remaining half. This manipulation helped dissociate perceptual- and semantic-based identification. Two time intervals within the post-face onset electroencephalography epoch were sensitive to person identity. The early perceptual phase spanned 110–228 msec and was not modulated by the name prime. The late semantic phase spanned 252–1000 msec and was sensitive to person knowledge activated by the name prime. Within this late phase, the identity response occurred earlier in time (300–600 msec) for the name prime with a scalp topography similar to the FN400 ERP. This may reflect a matching of the person primed in memory with the face on the screen. Following a neutral prime, the identity response occurred later in time (500–800 msec) with a scalp topography similar to the P600f ERP. This may reflect activation of semantic knowledge associated with the identity. Our results suggest that processing of identity begins early (110 msec), with some tolerance to image-level variations, and then progresses in stages sensitive to perceptual and then to semantic features.

[1]  M. Eimer Event-related brain potentials distinguish processing stages involved in face perception and recognition , 2000, Clinical Neurophysiology.

[2]  Martin Eimer,et al.  An event-related brain potential study of explicit face recognition , 2011, Neuropsychologia.

[3]  M. Herrmann,et al.  Early stages (P100) of face perception in humans as measured with event-related potentials (ERPs) , 2004, Journal of Neural Transmission.

[4]  A. Burton,et al.  Mental representations of familiar faces. , 2011, British journal of psychology.

[5]  M. Crommelinck,et al.  Is the N170 for faces cognitively penetrable? Evidence from repetition priming of Mooney faces of familiar and unfamiliar persons. , 2003, Brain research. Cognitive brain research.

[6]  Ahmed M. Megreya,et al.  Unfamiliar faces are not faces: Evidence from a matching task , 2006, Memory & cognition.

[7]  Bruno Rossion,et al.  Constraining the cortical face network by neuroimaging studies of acquired prosopagnosia , 2008, NeuroImage.

[8]  Tim Curran,et al.  The FN400 indexes familiarity-based recognition of faces , 2007, NeuroImage.

[9]  Marcel van Gerven,et al.  Unsupervised Feature Learning Improves Prediction of Human Brain Activity in Response to Natural Images , 2014, PLoS Comput. Biol..

[10]  B. Renault,et al.  Electrophysiological correlates of facial decision: insights from upright and upside-down Mooney-face perception. , 2005, Brain research. Cognitive brain research.

[11]  T. Ito,et al.  Race and gender on the brain: electrocortical measures of attention to the race and gender of multiply categorizable individuals. , 2003, Journal of personality and social psychology.

[12]  Markus Kiefer,et al.  Masked and unmasked electrophysiological repetition effects of famous faces , 2006, Brain Research.

[14]  Mohamed Rebaï,et al.  Familiarity and emotional expression influence an early stage of face processing: An electrophysiological study , 2005, Brain and Cognition.

[15]  Guillaume A. Rousselet,et al.  Modeling Single-Trial ERP Reveals Modulation of Bottom-Up Face Visual Processing by Top-Down Task Constraints (in Some Subjects) , 2011, Frontiers in psychology.

[16]  A. Burton,et al.  Variability in photos of the same face , 2011, Cognition.

[17]  Florence Thibaut,et al.  ERPs ASSOCIATED WITH FAMILIARITY AND DEGREE OF FAMILIARITY DURING FACE RECOGNITION , 2002, The International journal of neuroscience.

[18]  Maria Pia Viggiano,et al.  Interplay between familiarity and orientation in face processing: an ERP study. , 2007, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[19]  A. Mognon,et al.  ADJUST: An automatic EEG artifact detector based on the joint use of spatial and temporal features. , 2011, Psychophysiology.

[20]  Stefan R. Schweinberger,et al.  HOW GORBACHEV PRIMED YELTSIN : ANALYSES OF ASSOCIATIVE PRIMING IN PERSON RECOGNITION BY MEANS OF REACTION TIMES AND EVENT-RELATED BRAIN POTENTIALS , 1996 .

[21]  W. Sommer,et al.  Interaction of facial expressions and familiarity: ERP evidence , 2008, Biological Psychology.

[22]  B. Rossion,et al.  ERP evidence for the speed of face categorization in the human brain: Disentangling the contribution of low-level visual cues from face perception , 2011, Vision Research.

[23]  Gregory McCarthy,et al.  The Effects of Face Inversion and Face Race on the P100 ERP , 2017, Journal of Cognitive Neuroscience.

[24]  G. Rousselet,et al.  Single-Trial Analyses: Why Bother? , 2011, Front. Psychology.

[25]  R. B. Reilly,et al.  FASTER: Fully Automated Statistical Thresholding for EEG artifact Rejection , 2010, Journal of Neuroscience Methods.

[26]  A. Burton,et al.  Event-related brain potential evidence for a response of inferior temporal cortex to familiar face repetitions. , 2002, Brain research. Cognitive brain research.

[27]  Sébastien M. Crouzet,et al.  Fast saccades toward faces: face detection in just 100 ms. , 2010, Journal of vision.

[28]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[29]  Artur Marchewka,et al.  How multiple repetitions influence the processing of self-, famous and unknown names and faces: an ERP study. , 2011, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[30]  Stefan R Schweinberger,et al.  What's special about personally familiar faces? A multimodal approach. , 2004, Psychophysiology.

[31]  T. Allison,et al.  Electrophysiological Studies of Face Perception in Humans , 1996, Journal of Cognitive Neuroscience.

[32]  Matthias Niemeier,et al.  The time course of individual face recognition: A pattern analysis of ERP signals , 2016, NeuroImage.

[33]  A. Young,et al.  Understanding face recognition. , 1986, British journal of psychology.

[34]  Margot J. Taylor,et al.  Early processing of the six basic facial emotional expressions. , 2003, Brain research. Cognitive brain research.

[35]  Russell A. Poldrack,et al.  Analyses of regional-average activation and multivoxel pattern information tell complementary stories , 2012, Neuropsychologia.

[36]  G. McCarthy,et al.  Electrophysiological correlates of face-evoked person knowledge , 2016, Biological Psychology.

[37]  M. Eimer The Face-Sensitive N170 Component of the Event-Related Brain Potential , 2011 .

[38]  Stephan G. Boehm,et al.  Do I Know You? Insights into Memory for Faces from Brain Potentials , 2006, Clinical EEG and neuroscience.

[39]  Frank Tong,et al.  Representational Dynamics of Facial Viewpoint Encoding , 2017, Journal of Cognitive Neuroscience.

[40]  Katie L. McMahon,et al.  A multivariate distance-based analytic framework for connectome-wide association studies , 2014, NeuroImage.

[41]  Margot J. Taylor,et al.  N170 or N1? Spatiotemporal differences between object and face processing using ERPs. , 2004, Cerebral cortex.

[42]  Philippe G Schyns,et al.  Decoding face categories in diagnostic subregions of primary visual cortex , 2013, The European journal of neuroscience.

[43]  M. Bindemann,et al.  Brain potential correlates of face recognition: geometric distortions and the N250r brain response to stimulus repetitions. , 2008, Psychophysiology.

[44]  Andrew J. Edmonds,et al.  EVIDENCE FOR DIFFERENT REPRESENTATIONS OF FAMILIAR AND UNFAMILIAR FACES , 2009 .

[45]  Markus F. Neumann,et al.  N250r and N400 ERP correlates of immediate famous face repetition are independent of perceptual load , 2008, Brain Research.

[46]  Shree K. Nayar,et al.  Attribute and simile classifiers for face verification , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[47]  Davis E. King,et al.  Dlib-ml: A Machine Learning Toolkit , 2009, J. Mach. Learn. Res..

[48]  Stefan Winkler,et al.  A data-driven approach to cleaning large face datasets , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[49]  John A. Pyles,et al.  Dynamic Encoding of Face Information in the Human Fusiform Gyrus , 2014, Nature Communications.

[50]  Eva Petkova,et al.  Web-Based Supplementary Materials for “ On Distance-Based Permutation Tests for Between-Group Comparisons ” , 2009 .

[51]  L. Deouell,et al.  STRUCTURAL ENCODING AND IDENTIFICATION IN FACE PROCESSING: ERP EVIDENCE FOR SEPARATE MECHANISMS , 2000, Cognitive neuropsychology.

[52]  G. Yovel,et al.  TMS Evidence for the Involvement of the Right Occipital Face Area in Early Face Processing , 2007, Current Biology.

[53]  D. Plaut,et al.  Spatiotemporal dynamics of similarity-based neural representations of facial identity , 2016, Proceedings of the National Academy of Sciences.

[54]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[55]  Dorothy V. M. Bishop,et al.  Journal of Neuroscience Methods , 2015 .

[56]  Guillaume A. Rousselet,et al.  Quantifying the Time Course of Visual Object Processing Using ERPs: It's Time to Up the Game , 2011, Front. Psychology.

[57]  C. Mondloch,et al.  The timing of individual face recognition in the brain , 2012, Neuropsychologia.

[58]  R. Goebel,et al.  Holistic Face Categorization in Higher Order Visual Areas of the Normal and Prosopagnosic Brain: Toward a Non-Hierarchical View of Face Perception , 2011, Front. Hum. Neurosci..

[59]  Rob Jenkins,et al.  Stable face representations , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[60]  E. Barbeau,et al.  The neural speed of familiar face recognition , 2015, Neuropsychologia.

[61]  Jonathan D. Cohen,et al.  Confounds in multivariate pattern analysis: Theory and rule representation case study , 2013, NeuroImage.

[62]  M. Eimer Effects of face inversion on the structural encoding and recognition of faces. Evidence from event-related brain potentials. , 2000, Brain research. Cognitive brain research.

[63]  Bruno Rossion,et al.  Face Familiarity Decisions Take 200 msec in the Human Brain: Electrophysiological Evidence from a Go/No-go Speeded Task , 2014, Journal of Cognitive Neuroscience.

[64]  A. Young,et al.  Expectations about person identity modulate the face-sensitive N170 , 2016, Cortex.