Switching associations between facial identity and emotional expression: A behavioural and ERP study

The aim of this study was to determine if, and when, the neural processes involved in switching associations formed with angry and happy faces start to diverge. We measured event-related potentials (ERPs) and behavioural responses while participants performed a reversal learning task with angry and happy faces. In the task, participants were simultaneously presented with two neutral faces and learned to associate one of the faces with an emotional expression (either angry or happy), which was displayed by the face when correctly selected. After three to seven trials, the face that had consistently been displaying an emotional expression when selected would instead remain neutral, signalling the participant to switch their response and select the other face on the subsequent trial. The neural processes involved in switching associations formed with angry and happy faces diverged 375 ms after stimulus onset. Specifically, P3a amplitude was reduced and P3b latency was delayed when participants were cued to switch associations formed with angry expressions compared to happy expressions. This difference was also evident in later behavioural responses, which showed that it was more difficult to switch associations made with angry expressions than happy expressions. These findings may reflect an adaptive mechanism that facilitates the maintenance of our memory of threatening individuals by associating them with their potential threat.

[1]  Katherine D. Kinzler,et al.  Memory for “mean” over “nice”: The influence of threat on children’s face memory , 2008, Cognition.

[2]  H. Jasper,et al.  The ten-twenty electrode system of the International Federation. The International Federation of Clinical Neurophysiology. , 1999, Electroencephalography and clinical neurophysiology. Supplement.

[3]  M. Eimer,et al.  The role of spatial frequency information for ERP components sensitive to faces and emotional facial expression. , 2005, Brain research. Cognitive brain research.

[4]  S. Delplanque,et al.  Event-related P3a and P3b in response to unpredictable emotional stimuli , 2005, Biological Psychology.

[5]  R. Bajcsy,et al.  A method for obtaining 3-dimensional facial expressions and its standardization for use in neurocognitive studies , 2002, Journal of Neuroscience Methods.

[6]  M. Coltheart,et al.  Photographs of facial expression: Accuracy, response times, and ratings of intensity , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[7]  D. Friedman,et al.  The novelty P3: an event-related brain potential (ERP) sign of the brain's evaluation of novelty , 2001, Neuroscience & Biobehavioral Reviews.

[8]  Morten L Kringelbach,et al.  Neural correlates of rapid reversal learning in a simple model of human social interaction , 2003, NeuroImage.

[9]  J. Tanaka,et al.  The NimStim set of facial expressions: Judgments from untrained research participants , 2009, Psychiatry Research.

[10]  Carmen M. Atkinson,et al.  Anxiety and the neural processing of threat in faces , 2008, Neuroreport.

[11]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[12]  Martin Eimer,et al.  Attention modulates the processing of emotional expression triggered by foveal faces , 2006, Neuroscience Letters.

[13]  C. Joyce,et al.  The face-sensitive N170 and VPP components manifest the same brain processes: The effect of reference electrode site , 2005, Clinical Neurophysiology.

[14]  E. Rolls,et al.  Emotion-related learning in patients with social and emotional changes associated with frontal lobe damage. , 1994, Journal of neurology, neurosurgery, and psychiatry.

[15]  Jane E. Raymond,et al.  Neural Correlates of Enhanced Visual Short-Term Memory for Angry Faces: An fMRI Study , 2008, PloS one.

[16]  F. McGlone,et al.  The role of spatial attention in the processing of facial expression: An ERP study of rapid brain responses to six basic emotions , 2003, Cognitive, affective & behavioral neuroscience.

[17]  Patrik Vuilleumier,et al.  Time course and specificity of event-related potentials to emotional expressions , 2004, Neuroreport.

[18]  Paul D. Kieffaber,et al.  Event-related potential correlates of task switching and switch costs. , 2005, Psychophysiology.

[19]  A. Damasio,et al.  Individuals with sociopathic behavior caused by frontal damage fail to respond autonomically to social stimuli , 1990, Behavioural Brain Research.

[20]  M. Eimer,et al.  The processing of emotional facial expression is gated by spatial attention: evidence from event-related brain potentials. , 2003, Brain research. Cognitive brain research.

[21]  Bruno Rossion,et al.  Does physical interstimulus variance account for early electrophysiological face sensitive responses in the human brain? Ten lessons on the N170 , 2008, NeuroImage.

[22]  F. Barceló.  The Madrid card sorting test (MCST): a task switching paradigm to study executive attention with event-related potentials. , 2003, Brain research. Brain research protocols.

[23]  M. Crommelinck,et al.  Discrimination of emotional facial expressions in a visual oddball task: an ERP study , 2002, Biological Psychology.

[24]  R. Adolphs.  Recognizing emotion from facial expressions: psychological and neurological mechanisms. , 2002, Behavioral and cognitive neuroscience reviews.

[25]  L Cipolotti,et al.  Impaired social response reversal. A case of 'acquired sociopathy'. , 2000, Brain : a journal of neurology.

[26]  Linda Mealey,et al.  Enhanced memory for faces of cheaters , 1996 .

[27]  Ahmad R. Hariri,et al.  Preferential Amygdala Reactivity to the Negative Assessment of Neutral Faces , 2009, Biological Psychiatry.

[28]  Robert T. Knight,et al.  Think differently: a brain orienting response to task novelty , 2002, Neuroreport.

[29]  Le Song,et al.  The ‘when’ and ‘where’ of perceiving signals of threat versus non-threat , 2006, NeuroImage.

[30]  P. Ekman.  Pictures of Facial Affect , 1976 .

[31]  E. Rolls,et al.  Face and voice expression identification in patients with emotional and behavioural changes following ventral frontal lobe damage , 1996, Neuropsychologia.

[32]  Dick J. Veltman,et al.  Neural correlates of a reversal learning task with an affectively neutral baseline: An event-related fMRI study , 2005, NeuroImage.

[33]  E. Rolls,et al.  Changes in emotion after circumscribed surgical lesions of the orbitofrontal and cingulate cortices. , 2003, Brain : a journal of neurology.

[34]  M. Eimer,et al.  An ERP study on the time course of emotional face processing , 2002, Neuroreport.

[35]  Colin W. G. Clifford,et al.  Perceptual categorisation of anti- expressions , 2010 .

[36]  E. Rolls,et al.  Reward-related Reversal Learning after Surgical Excisions in Orbito-frontal or Dorsolateral Prefrontal Cortex in Humans , 2004, Journal of Cognitive Neuroscience.

[37]  Jonathan R. Folstein,et al.  Influence of cognitive control and mismatch on the N2 component of the ERP: a review. , 2007, Psychophysiology.