When does the brain distinguish between genuine and ambiguous smiles? An ERP study

Event-related brain potentials (ERPs) were recorded to assess the processing time course of ambiguous facial expressions with a smiling mouth but neutral, fearful, or angry eyes, in comparison with genuinely happy faces (a smile and happy eyes) and non-happy faces (neutral, fearful, or angry mouth and eyes). Participants judged whether the faces looked truly happy or not. Electroencephalographic recordings were made from 64 scalp electrodes to generate ERPs. The neural activation patterns showed early P200 sensitivity (differences between negative and positive or neutral expressions) and EPN sensitivity (differences between positive and neutral expressions) to emotional valence. In contrast, sensitivity to ambiguity (differences between genuine and ambiguous expressions) emerged only in later LPP components. Discrimination of emotional vs. neutral affect occurs between 180 and 430ms from stimulus onset, whereas the detection and resolution of ambiguity takes place between 470 and 720ms. In addition, while blended expressions involving a smile with angry eyes can be identified as not happy in the P200 (175-240ms) component, smiles with fearful or neutral eyes produce the same ERP pattern as genuinely happy faces, thus revealing poor discrimination.

[1]  P. Ekman.  Telling lies: clues to deceit in the marketplace , 1985 .

[2]  Werner Sommer,et al.  The appraisal of facial beauty is rapid but not mandatory , 2008, Cognitive, affective & behavioral neuroscience.

[3]  W. Sommer,et al.  Emotions in word and face processing: Early and late cortical responses , 2009, Brain and Cognition.

[4]  U. Hess,et al.  Assessing the way people look to judge their intentions. , 2011, Emotion.

[5]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[6]  L. Nummenmaa,et al.  Eye-movement assessment of the time course in facial expression recognition: Neurophysiological implications , 2009, Cognitive, affective & behavioral neuroscience.

[7]  Margot J. Taylor,et al.  Early processing of the six basic facial emotional expressions. , 2003, Brain research. Cognitive brain research.

[8]  M. G. Calvo,et al.  Visual search of emotional faces: The role of affective content and featural distinctiveness , 2009 .

[9]  Jonas K. Olofsson,et al.  Affective picture processing: An integrative review of ERP findings , 2008, Biological Psychology.

[10]  M. Junghöfer,et al.  The facilitated processing of threatening faces: an ERP analysis. , 2004, Emotion.

[11]  K. Scherer,et al.  Affect bursts: dynamic patterns of facial expression. , 2011, Emotion.

[12]  Jari K. Hietanen,et al.  Differential electrocortical responses to increasing intensities of fearful and happy emotional expressions , 2007, Brain Research.

[13]  G. Rhodes,et al.  Are you always on my mind? A review of how face perception and attention interact , 2007, Neuropsychologia.

[14]  K. Scherer,et al.  Are facial expressions of emotion produced by categorical affect programs or dynamically driven by appraisal? , 2007, Emotion.

[15]  Marcel Bastiaansen,et al.  The influence of information structure on the depth of semantic processing: How focus and pitch accent determine the size of the N400 effect , 2011, Neuropsychologia.

[16]  G. Alpers,et al.  Happy mouth and sad eyes: scanning emotional facial expressions. , 2011, Emotion.

[17]  Jack van Honk,et al.  Functionally dissociated aspects in anterior and posterior electrocortical processing of facial threat. , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[18]  S. Luck.  An Introduction to the Event-Related Potential Technique , 2005 .

[19]  F. McGlone,et al.  The role of spatial attention in the processing of facial expression: An ERP study of rapid brain responses to six basic emotions , 2003, Cognitive, affective & behavioral neuroscience.

[20]  L. Nummenmaa,et al.  Detection of emotional faces: salient physical features guide effective visual search. , 2008, Journal of experimental psychology. General.

[21]  L Carretié,et al.  Emotion, attention, and the 'negativity bias', studied through event-related potentials. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[22]  A. Manstead,et al.  Can Duchenne smiles be feigned? New evidence on felt and false smiles. , 2009, Emotion.

[23]  R. Adolphs.  Recognizing emotion from facial expressions: psychological and neurological mechanisms. , 2002, Behavioral and cognitive neuroscience reviews.

[24]  J. Cohn,et al.  All Smiles are Not Created Equal: Morphology and Timing of Smiles Perceived as Amused, Polite, and Embarrassed/Nervous , 2009, Journal of nonverbal behavior.

[25]  M. Pell,et al.  Facial expression decoding as a function of emotional meaning status: ERP evidence , 2009, Neuroreport.

[26]  Wenfeng Feng,et al.  Three stages of facial expression processing: ERP study with rapid serial visual presentation , 2010, NeuroImage.

[27]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[28]  P. Ekman,et al.  Strong evidence for universals in facial expressions: a reply to Russell's mistaken critique. , 1994, Psychological bulletin.

[29]  Carrick C. Williams,et al.  Eye movements are functional during face learning , 2005, Memory & cognition.

[30]  Jeff T. Larsen,et al.  May I have your attention, please: Electrocortical responses to positive and negative stimuli , 2003, Neuropsychologia.

[31]  Christoph M. Michel,et al.  Two electrophysiological stages of spatial orienting towards fearful faces: early temporo-parietal activation preceding gain control in extrastriate visual cortex , 2005, NeuroImage.

[32]  C. Tyler,et al.  What makes Mona Lisa smile? , 2004, Vision Research.

[33]  M. Mermillod,et al.  Is eye contact the key to the social brain? , 2010, Behavioral and Brain Sciences.

[34]  L. Nummenmaa,et al.  Time course of discrimination between emotional facial expressions: The role of visual saliency , 2011, Vision Research.

[35]  Ines Jentzsch,et al.  Event related potentials and the perception of intensity in facial expressions , 2006, Neuropsychologia.

[36]  J. Hietanen,et al.  Is there more in a happy face than just a big smile? , 2007 .

[37]  Chao-Cheng Chen,et al.  Neurophysiological mechanisms in the emotional modulation of attention: The interplay between threat sensitivity and attentional control , 2007, Biological Psychology.

[38]  L. Nummenmaa,et al.  Perceptual, categorical, and affective processing of ambiguous smiling facial expressions , 2012, Cognition.

[39]  M. Coltheart,et al.  Photographs of facial expression: Accuracy, response times, and ratings of intensity , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[40]  Garrison W. Cottrell,et al.  Transmitting and Decoding Facial Expressions , 2005, Psychological science.

[41]  M. Eimer,et al.  Event-related brain potential correlates of emotional face processing , 2007, Neuropsychologia.

[42]  J. Tanaka,et al.  The NimStim set of facial expressions: Judgments from untrained research participants , 2009, Psychiatry Research.

[43]  J. M. Carroll,et al.  Facial Expressions in Hollywood's Portrayal of Emotion , 1997 .

[44]  T. Jones,et al.  Interpersonal distance, body orientation, and touch: effects of culture, gender, and age. , 1995, The Journal of social psychology.

[45]  D. Lundqvist,et al.  Facial expressions of emotion (KDEF): Identification under different display-duration conditions , 2008, Behavior research methods.

[46]  Markus Junghöfer,et al.  Selective Visual Attention to Emotion , 2007, The Journal of Neuroscience.

[47]  L. Miles,et al.  Detecting Happiness: Perceiver Sensitivity to Enjoyment and Non-Enjoyment Smiles , 2007 .

[48]  C. Junqué,et al.  Sex differences in the human olfactory system , 2006, Brain Research.

[49]  C. Macrae,et al.  Why are you smiling at me? Social functions of enjoyment and non-enjoyment smiles. , 2010, The British journal of social psychology.