N170 sensitivity to facial expression: A meta-analysis

The N170 component is the most important electrophysiological index of face processing. Early studies concluded that it was insensitive to facial expression, thus supporting dual theories postulating separate mechanisms for identity and expression encoding. However, recent evidence contradicts this assumption. We conducted a meta-analysis to resolve inconsistencies and to derive theoretical implications. A systematic revision of 128 studies analyzing N170 in response to neutral and emotional expressions yielded 57 meta-analyzable experiments (involving 1645 healthy adults). First, the N170 was found to be sensitive to facial expressions, supporting proposals arguing for integrated rather than segregated mechanisms in the processing of identity and expression. Second, this sensitivity is heterogeneous, with anger, fear and happy faces eliciting the largest N170 amplitudes. Third, we explored some modulatory factors, including the focus of attention - N170 amplitude was found to be also sensitive to unattended expressions - or the reference electrode -common reference reinforcing the effects- . In sum, N170 is a valuable tool to study the neural processing of facial expressions in order to develop current theories.

[1]  Daniel Smilek,et al.  Visual search for faces with emotional expressions. , 2008, Psychological bulletin.

[2]  K. Phan,et al.  Augmenting serotonin neurotransmission with citalopram modulates emotional expression decoding but not structural encoding of moderate intensity sad facial emotional stimuli: an event-related potential (ERP) investigation , 2010, Journal of psychopharmacology.

[3]  M. Eimer,et al.  Event-related brain potential correlates of emotional face processing , 2007, Neuropsychologia.

[4]  A. Capilla,et al.  Exogenous attention to facial vs non-facial emotional visual stimuli. , 2013, Social cognitive and affective neuroscience.

[5]  Le Song,et al.  The ‘when’ and ‘where’ of perceiving signals of threat versus non-threat , 2006, NeuroImage.

[6]  Karl J. Friston,et al.  A neuromodulatory role for the human amygdala in processing emotional facial expressions. , 1998, Brain : a journal of neurology.

[7]  Jiu Chen,et al.  Distinct Facial Processing Related Negative Cognitive Bias in First-Episode and Recurrent Major Depression: Evidence from the N170 ERP Component , 2014, PloS one.

[8]  Gabriel Curio,et al.  MEG/EEG sources of the 170-ms response to faces are co-localized in the fusiform gyrus , 2007, NeuroImage.

[9]  A. Calder,et al.  In the eye of the beholder: Individual differences in reward-drive modulate early frontocentral ERPs to angry faces , 2009, Neuropsychologia.

[10]  Gilles Pourtois,et al.  Anxiety disrupts the evaluative component of performance monitoring: An ERP study , 2012, Neuropsychologia.

[11]  Paul D. Kieffaber,et al.  The role of encoding and attention in facial emotion memory: an EEG investigation. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[12]  S. Tobimatsu,et al.  Different perceptual sensitivities for Chernoff's face between children and adults , 2008, Neuroscience Research.

[13]  Frank F. Preston,et al.  Early sensitivity for eyes within faces: A new neuronal account of holistic and featural processing , 2014, NeuroImage.

[14]  K. Hyun,et al.  Facial affect perception and event-related potential N170 in schizophrenia: A preliminary study , 2007 .

[15]  J. Gross,et al.  See What You Think , 2012, Psychological science.

[16]  Matthias J. Wieser,et al.  Tonic pain grabs attention, but leaves the processing of facial expressions intact—Evidence from event-related brain potentials , 2012, Biological Psychology.

[17]  A. Young,et al.  Understanding the recognition of facial identity and facial expression , 2005, Nature Reviews Neuroscience.

[18]  P. Philippot,et al.  Is the P300 deficit in alcoholism associated with early visual impairments (P100, N170)? An oddball paradigm , 2007, Clinical Neurophysiology.

[19]  Urs Maurer,et al.  The face-specific N170 component is modulated by emotional facial expression , 2007, Behavioral and Brain Functions.

[20]  S. Schweinberger,et al.  Expression Influences the Recognition of Familiar Faces , 2004, Perception.

[21]  Daniël Lakens,et al.  Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs , 2013, Front. Psychol..

[22]  T. Allison,et al.  Electrophysiological Studies of Face Perception in Humans , 1996, Journal of Cognitive Neuroscience.

[23]  P. Pauli,et al.  Altered processing of emotional stimuli in migraine: An event-related potential study , 2012, Cephalalgia : an international journal of headache.

[24]  Paul Pauli,et al.  Early cortical processing of natural and artificial emotional faces differs between lower and higher socially anxious persons , 2009, Journal of Neural Transmission.

[25]  R. Dolan,et al.  Facial Expression Influences Face Identity Recognition During the Attentional Blink , 2014, Emotion.

[26]  G. Zelinsky,et al.  Electrocortical and ocular indices of attention to fearful and neutral faces presented under high and low working memory load , 2012, Biological Psychology.

[27]  L. Pessoa,et al.  Emotion processing and the amygdala: from a 'low road' to 'many roads' of evaluating biological significance , 2010, Nature Reviews Neuroscience.

[28]  Kirill V. Nourski,et al.  Processing of Facial Emotion in the Human Fusiform Gyrus , 2012, Journal of Cognitive Neuroscience.

[29]  A. Vingerhoets,et al.  Tilburg University An event-related potential study on the early processing of crying faces , 2017 .

[30]  C. H. Hansen,et al.  Finding the face in the crowd : An anger superiority effect , 1988 .

[31]  Sheng He,et al.  Dynamics of processing invisible faces in the brain: Automatic neural encoding of facial expression information , 2009, NeuroImage.

[32]  T. Blumenthal,et al.  Your emotion or mine: labeling feelings alters emotional face perception—an ERP study on automatic and intentional affect labeling , 2013, Front. Hum. Neurosci..

[33]  Shasha Morel,et al.  ERP evidence for an early emotional bias towards happy faces in trait anxiety , 2014, Biological Psychology.

[34]  Wioleta Walentowska,et al.  Attention modulates emotional expression processing. , 2011, Psychophysiology.

[35]  Bruno Rossion,et al.  Does physical interstimulus variance account for early electrophysiological face sensitive responses in the human brain? Ten lessons on the N170 , 2008, NeuroImage.

[36]  F. McGlone,et al.  The role of spatial attention in the processing of facial expression: An ERP study of rapid brain responses to six basic emotions , 2003, Cognitive, affective & behavioral neuroscience.

[37]  Giuseppe Iaria,et al.  The correlates of subjective perception of identity and expression in the face network: An fMRI adaptation study , 2009, NeuroImage.

[38]  W. Sommer,et al.  Emotion Effects on the N170: A Question of Reference? , 2012, Brain Topography.

[39]  B. Turetsky,et al.  Facial emotion recognition in schizophrenia:When and why does it go awry? , 2007, Schizophrenia Research.

[40]  G. Crombez,et al.  Attention for emotional faces under restricted awareness revisited: do emotional faces automatically attract attention? , 2007, Emotion.

[41]  S. Segalowitz,et al.  Shyness and emotional face processing in schizophrenia: An ERP study , 2013, Biological Psychology.

[42]  Georg W. Alpers,et al.  Social and emotional relevance in face processing: happy faces of future interaction partners enhance the late positive potential , 2014, Front. Hum. Neurosci..

[43]  G. Yovel,et al.  Event‐related potential and functional MRI measures of face‐selectivity are highly correlated: A simultaneous ERP‐fMRI investigation , 2010, Human brain mapping.

[44]  Ralph Adolphs,et al.  The neuropsychology of face perception: beyond simple dissociations and functional selectivity , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[45]  L. Nummenmaa,et al.  Dissociation between recognition and detection advantage for facial expressions: a meta-analysis. , 2015, Emotion.

[46]  Wenfeng Feng,et al.  Three stages of facial expression processing: ERP study with rapid serial visual presentation , 2010, NeuroImage.

[47]  Jeesun Kim,et al.  Emotional expressions evoke a differential response in the fusiform face area , 2013, Front. Hum. Neurosci..

[48]  Bruno Rossion,et al.  Hemispheric Asymmetries for Whole-Based and Part-Based Face Processing in the Human Fusiform Gyrus , 2000, Journal of Cognitive Neuroscience.

[49]  J. Stekelenburg,et al.  The neural correlates of perceiving human bodies: an ERP study on the body-inversion effect , 2004, Neuroreport.

[50]  Andreas J Fallgatter,et al.  Face-specific event-related potential in humans is independent from facial expression. , 2002, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[51]  Beatrice de Gelder,et al.  Real Faces, Real Emotions: Perceiving Facial Expressions in Naturalistic Contexts of Voices, Bodies, and Scenes , 2011 .

[52]  H. Leuthold,et al.  Parallel processing in face perception. , 2010, Journal of experimental psychology. Human perception and performance.

[53]  K. Paller,et al.  Neural and behavioral evidence for affective priming from unconsciously perceived emotional facial expressions and the influence of trait anxiety , 2008 .

[54]  A. Burrows,et al.  The facial expression musculature in primates and its evolutionary significance , 2008, BioEssays : news and reviews in molecular, cellular and developmental biology.

[55]  J. Nadel,et al.  Human brain spots emotion in non humanoid robots. , 2011, Social cognitive and affective neuroscience.

[56]  Y. Liu,et al.  Time Pressure Inhibits Dynamic Advantage in the Classification of Facial Expressions of Emotion , 2014, PloS one.

[57]  Martin Eimer,et al.  Attention modulates the processing of emotional expression triggered by foveal faces , 2006, Neuroscience Letters.

[58]  O. Dan,et al.  Adult attachment and emotional processing biases: An Event-Related Potentials (ERPs) study , 2012, Biological Psychology.

[59]  F. Barbosa,et al.  Dissociable effects of psychopathic traits on cortical and subcortical visual pathways during facial emotion processing: an ERP study on the N170. , 2014, Psychophysiology.

[60]  Alumit Ishai,et al.  Let’s face it: It’s a cortical network , 2008, NeuroImage.

[61]  W. He,et al.  Processing of facial expressions of emotions in healthy volunteers: An exploration with event-related potentials and personality traits , 2012, Neurophysiologie Clinique/Clinical Neurophysiology.

[62]  Margot J. Taylor,et al.  Early processing of the six basic facial emotional expressions. , 2003, Brain research. Cognitive brain research.

[63]  Tobias Brosch,et al.  Faces in Context: A Review and Systematization of Contextual Influences on Affective Face Processing , 2012, Front. Psychology.

[64]  I. Gauthier,et al.  How does the brain process upright and inverted faces? , 2002, Behavioral and cognitive neuroscience reviews.

[65]  A. Anderson,et al.  Examinations of identity invariance in facial expression adaptation , 2008, Cognitive, affective & behavioral neuroscience.

[66]  Lucy S. Petro,et al.  Dynamics of Visual Information Integration in the Brain for Categorizing Facial Expressions , 2007, Current Biology.

[67]  Lun Zhao,et al.  Visual mismatch negativity elicited by facial expressions under non-attentional condition , 2006, Neuroscience Letters.

[68]  Julie Grèzes,et al.  Early Binding of Gaze, Gesture, and Emotion: Neural Time Course and Correlates , 2012, The Journal of Neuroscience.

[69]  K. Mogg,et al.  Orienting of Attention to Threatening Facial Expressions Presented under Conditions of Restricted Awareness , 1999 .

[70]  G. McCarthy,et al.  Dynamic perception of facial affect and identity in the human brain. , 2003, Cerebral Cortex.

[71]  Wioleta Walentowska,et al.  Trait anxiety and involuntary processing of facial emotions. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[72]  Jun-peng Zhu,et al.  Facial emotion triggered cerebral potentials in treatment-resistant depression and borderline personality disorder patients of both genders , 2012, Progress in Neuro-Psychopharmacology and Biological Psychiatry.

[73]  A. Young,et al.  Matching familiar and unfamiliar faces on identity and expression , 1986, Psychological research.

[74]  Margot J. Taylor,et al.  The Faces of Development: A Review of Early Face Processing over Childhood , 2004, Journal of Cognitive Neuroscience.

[75]  Kenneth F. Valyear,et al.  The involvement of the “fusiform face area” in processing facial expression , 2005, Neuropsychologia.

[76]  Pierre Maurage,et al.  Enhanced perceptual responses during visual processing of facial stimuli in young socially anxious individuals , 2012, Neuroscience Letters.

[77]  C. Im,et al.  Reduced source activity of event-related potentials for affective facial pictures in schizophrenia patients , 2012, Schizophrenia Research.

[78]  L. Carretié Exogenous (automatic) attention to emotional stimuli: a review , 2014, Cognitive, Affective, & Behavioral Neuroscience.

[79]  L. Williams,et al.  Neural processing of facial expressions of emotion in first onset psychosis , 2014, Psychiatry Research.

[80]  Simon Rigoulot,et al.  Fearful faces impact in peripheral vision: Behavioral and neural evidence , 2011, Neuropsychologia.

[81]  Hervé Abdi,et al.  Processing Faces and Facial Expressions , 2003, Neuropsychology Review.

[82]  Beatrice de Gelder,et al.  Context influences early perceptual analysis of faces--an electrophysiological study. , 2006, Cerebral cortex.

[83]  S. Campanella,et al.  Early visual components (P100, N170) are disrupted in chronic schizophrenic patients: an event-related potentials study , 2006, Neurophysiologie Clinique/Clinical Neurophysiology.

[84]  E. Fox,et al.  Facial Expressions of Emotion: Are Angry Faces Detected More Efficiently? , 2000, Cognition & emotion.

[85]  Margot J. Taylor,et al.  N170 or N1? Spatiotemporal differences between object and face processing using ERPs. , 2004, Cerebral cortex.

[86]  Piia Astikainen,et al.  Biological psychology , 2019, An Introduction to the Psychology of Humor.

[87]  R. Kakigi,et al.  Emotional object and scene stimuli modulate subsequent face processing: An event-related potential study , 2008, Brain Research Bulletin.

[88]  Manfred Herrmann,et al.  Time course of implicit processing and explicit processing of emotional faces and emotional words , 2011, Biological Psychology.

[89]  P Krolak-Salmon,et al.  Processing of facial emotional expression: spatio‐temporal data as assessed by scalp event‐related potentials , 2001, The European journal of neuroscience.

[90]  W. Sommer,et al.  Interaction of facial expressions and familiarity: ERP evidence , 2008, Biological Psychology.

[91]  Patrik Vuilleumier,et al.  EEG-MEG evidence for early differential repetition effects for fearful, happy and neutral faces , 2009, Brain Research.

[92]  C. Jacques,et al.  The N170 : understanding the time-course of face perception in the human brain , 2011 .

[93]  F. Ghassemi,et al.  Emotional Face Perception in Patients with Schizophrenia: an Event-Related Potential Study , 2013, Neurophysiology.

[94]  A. Young,et al.  Understanding face recognition. , 1986, British journal of psychology.

[95]  S. Bentin,et al.  Domain specificity versus expertise: factors influencing distinct processing of faces , 2002, Cognition.

[96]  I. Biederman,et al.  Loci of the release from fMRI adaptation for changes in facial expression, identity, and viewpoint. , 2010, Journal of vision.

[97]  Margot J. Taylor,et al.  Source analysis of the N170 to faces and objects , 2004, Neuroreport.

[98]  M. Eimer,et al.  An ERP study on the time course of emotional face processing , 2002, Neuroreport.

[99]  Jacqueline Nadel,et al.  Reading sadness beyond human faces , 2010, Brain Research.

[100]  Glyn W. Humphreys,et al.  Expression is computed separately from facial identity, and it is computed separately for moving and static faces: Neuropsychological evidence , 1993, Neuropsychologia.

[101]  I. Gauthier,et al.  A defense of the subordinate-level expertise account for the N170 component , 2002, Cognition.

[102]  Leslie G. Ungerleider,et al.  Perception of emotional expressions is independent of face selectivity in monkey inferior temporal cortex , 2008, Proceedings of the National Academy of Sciences.

[103]  R. Zhou,et al.  Cognitive reappraisal of facial expressions: Electrophysiological evidence of social anxiety , 2014, Neuroscience Letters.

[104]  Paul Pauli,et al.  Don't look at me in anger! Enhanced processing of angry faces in anticipation of public speaking. , 2010, Psychophysiology.

[105]  Marie L. Smith,et al.  Rapid processing of emotional expressions without conscious awareness. , 2012, Cerebral cortex.

[106]  A. Young,et al.  Dissociable face processing impairments after brain injury. , 1991, Journal of clinical and experimental neuropsychology.

[107]  Dandan Zhang,et al.  Individual Differences in Detecting Rapidly Presented Fearful Faces , 2012, PloS one.

[108]  Guillaume A. Rousselet,et al.  Spatiotemporal analyses of the N170 for human faces, animal faces and objects in natural scenes , 2004, Neuroreport.

[109]  Roxane J. Itier,et al.  Neural bases of eye and gaze processing: The core of social cognition , 2009, Neuroscience & Biobehavioral Reviews.

[110]  B. Rossion,et al.  The time‐course of intermodal binding between seeing and hearing affective information , 2000, Neuroreport.

[111]  Nathalie George,et al.  The Cambridge Handbook of Human Affective Neuroscience: The Facial Expression of Emotions , 2013 .

[112]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[113]  K. Phan,et al.  Evidence for modulation of facial emotional processing bias during emotional expression decoding by serotonergic and noradrenergic antidepressants: an event-related potential (ERP) study , 2009, Psychopharmacology.

[114]  D. Salisbury,et al.  Attenuated Modulation of the N170 ERP by Facial Expressions in Schizophrenia , 2008, Clinical EEG and neuroscience.

[115]  Patrik Vuilleumier,et al.  Beware and be aware: Capture of spatial attention by fear-related stimuli in neglect , 2001, Neuroreport.

[116]  B. de Gelder,et al.  Rapid influence of emotional scenes on encoding of facial expressions: an ERP study. , 2008, Social cognitive and affective neuroscience.

[117]  Martial Mermillod,et al.  Emotional Modulation of Attention: Fear Increases but Disgust Reduces the Attentional Blink , 2009, PloS one.

[118]  B. Rossion Understanding face perception by means of human electrophysiology , 2014, Trends in Cognitive Sciences.

[119]  Anthony Randal McIntosh,et al.  Early Face Processing Specificity: It's in the Eyes! , 2007, Journal of Cognitive Neuroscience.

[120]  María Ruz,et al.  Race, emotion and trust: An ERP study , 2013, Brain Research.

[121]  E. Fox Processing emotional facial expressions: The role of anxiety and awareness , 2002, Cognitive, affective & behavioral neuroscience.

[122]  E. Fox,et al.  Attentional bias for threat: Evidence for delayed disengagement from emotional faces , 2002, Cognition & emotion.

[123]  Werner Sommer,et al.  Does processing of emotional facial expressions depend on intention? Time-resolved evidence from event-related brain potentials , 2012, Biological Psychology.

[124]  Hiroyuki Oya,et al.  Decoding Face Information in Time, Frequency and Space from Direct Intracranial Recordings of the Human Brain , 2008, PloS one.

[125]  R. Orwin A fail-safe N for effect size in meta-analysis. , 1983 .

[126]  R. Dolan,et al.  fMRI-adaptation reveals dissociable neural representations of identity and expression in face perception. , 2004, Journal of neurophysiology.

[127]  R. Rosenthal The file drawer problem and tolerance for null results , 1979 .

[128]  K. Lander,et al.  The influence of positive and negative facial expressions on face familiarity , 2007, Memory.