Why are you looking like that? How the context influences evaluation and processing of human faces

Perception and evaluation of facial expressions are known to be heavily modulated by emotional features of contextual information. Such contextual effects, however, might also be driven by non-emotional aspects of contextual information, an interaction of emotional and non-emotional factors, and by the observers’ inherent traits. Therefore, we sought to assess whether contextual information about self-reference in addition to information about valence influences the evaluation and neural processing of neutral faces. Furthermore, we investigated whether social anxiety moderates these effects. In the present functional magnetic resonance imaging (fMRI) study, participants viewed neutral facial expressions preceded by a contextual sentence conveying either positive or negative evaluations about the participant or about somebody else. Contextual influences were reflected in rating and fMRI measures, with strong effects of self-reference on brain activity in the medial prefrontal cortex and right fusiform gyrus. Additionally, social anxiety strongly affected the response to faces conveying negative, self-related evaluations as revealed by the participants’ rating patterns and brain activity in cortical midline structures and regions of interest in the left and right middle frontal gyrus. These results suggest that face perception and processing are highly individual processes influenced by emotional and non-emotional aspects of contextual information and further modulated by individual personality traits.

[1]  Thomas J. Ross,et al.  Amygdala response to both positively and negatively valenced stimuli , 2001, Neuroreport.

[2]  Christian Büchel,et al.  Processing of facial expressions and their significance for the observer in subregions of the human amygdala , 2011, NeuroImage.

[3]  Paul Pauli,et al.  Fear of negative evaluation and the hypervigilance-avoidance hypothesis: an eye-tracking study , 2009, Journal of Neural Transmission.

[4]  J. Russell,et al.  Relativity in the Perception of Emotion in Facial Expressions , 1987 .

[5]  R. Edelmann,et al.  Social anxiety, fear of negative evaluation and the detection of negative emotion in others. , 1995, Behaviour research and therapy.

[6]  M. Bar The proactive brain: using analogies and associations to generate predictions , 2007, Trends in Cognitive Sciences.

[7]  R. Gibson,et al.  What the Face Reveals , 2002 .

[8]  Marisa O. Hollinshead,et al.  The organization of the human cerebral cortex estimated by intrinsic functional connectivity. , 2011, Journal of neurophysiology.

[9]  D. Pine,et al.  Neural response to self- and other referential praise and criticism in generalized social phobia. , 2008, Archives of general psychiatry.

[10]  P. Pauli,et al.  Stop looking angry and smile, please: start and stop of the very same facial expression differentially activate threat- and reward-related brain networks , 2010, Social cognitive and affective neuroscience.

[11]  R. Righart,et al.  Recognition of facial expressions is influenced by emotional scene gist , 2008, Cognitive, affective & behavioral neuroscience.

[12]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[13]  R. Heimberg,et al.  Attentional focus in social anxiety disorder: potential for interactive processes. , 2008, Clinical psychology review.

[14]  V. Benson,et al.  The influence of anxiety on processing capacity for threat detection , 2011, Psychonomic bulletin & review.

[15]  Lesley K. Fellows,et al.  Ventromedial Frontal Lobe Plays a Critical Role in Facial Emotion Recognition , 2008, Journal of Cognitive Neuroscience.

[16]  M. Phillips,et al.  Neural responses to emotional and neutral facial expressions in chronically violent men. , 2010, Journal of psychiatry & neuroscience : JPN.

[17]  Jason P. Mitchell,et al.  A neural mechanism of first impressions , 2009, Nature Neuroscience.

[18]  Jason P. Mitchell,et al.  Dissociable Medial Prefrontal Contributions to Judgments of Similar and Dissimilar Others , 2006, Neuron.

[19]  Marnie E. Shaw,et al.  Default network connectivity during a working memory task , 2011, Human brain mapping.

[20]  C. Beard,et al.  Interpretation in Social Anxiety: When Meaning Precedes Ambiguity , 2009, Cognitive Therapy and Research.

[21]  Stephan Eliez,et al.  Amygdalar activation associated with positive and negative facial expressions , 2002, Neuroreport.

[22]  Georg Northoff,et al.  Self-referential processing in our brain—A meta-analysis of imaging studies on the self , 2006, NeuroImage.

[23]  B. Mesquita,et al.  Adjustment to Chronic Diseases and Terminal Illness Health Psychology : Psychological Adjustment to Chronic Disease , 2006 .

[24]  Paul J. Laurienti,et al.  An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets , 2003, NeuroImage.

[25]  D. Perrett,et al.  A differential neural response in the human amygdala to fearful and happy facial expressions , 1996, Nature.

[26]  Ran R. Hassin,et al.  Angry, Disgusted, or Afraid? , 2008, Psychological science.

[27]  A. Calder,et al.  Personality influences the neural responses to viewing facial expressions of emotion , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[28]  Paul Pauli,et al.  Don't look at me in anger! Enhanced processing of angry faces in anticipation of public speaking. , 2010, Psychophysiology.

[29]  Simon B. Eickhoff,et al.  A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data , 2005, NeuroImage.

[30]  Jan Schweckendiek,et al.  Neural activations of the acquisition of conditioned sexual arousal: effects of contingency awareness and sex. , 2009, The journal of sexual medicine.

[31]  David R. Herring,et al.  Electrophysiological responses to evaluative priming: the LPP is sensitive to incongruity. , 2011, Emotion.

[32]  P. Pauli,et al.  Self-reference modulates the processing of emotional stimuli in the absence of explicit self-referential appraisal instructions. , 2011, Social cognitive and affective neuroscience.

[33]  K. Grill-Spector,et al.  The human visual cortex. , 2004, Annual review of neuroscience.

[34]  Zara M. Bergström,et al.  A Specific Brain Structural Basis for Individual Differences in Reality Monitoring , 2011, The Journal of Neuroscience.

[35]  D. Lundqvist,et al.  Karolinska Directed Emotional Faces , 2015 .

[36]  Fanny Eugène,et al.  Amygdala activation in the processing of neutral faces in social anxiety disorder: Is neutral really neutral? , 2006, Psychiatry Research: Neuroimaging.

[37]  L. F. Barrett,et al.  Context Is Routinely Encoded During Emotion Perception , 2010, Psychological science.

[38]  Justin L. Vincent,et al.  Evidence for a frontoparietal control system revealed by intrinsic functional connectivity. , 2008, Journal of neurophysiology.

[39]  David Rudrauf,et al.  Medial PFC Damage Abolishes the Self-reference Effect , 2012, Journal of Cognitive Neuroscience.

[40]  R. Zinbarg,et al.  Threat is in the eye of the beholder: social anxiety and the interpretation of ambiguous facial expressions. , 2007, Behaviour research and therapy.

[41]  Stéphane Lehéricy,et al.  Negative affectivity, self-referential processing and the cortical midline structures. , 2011, Social cognitive and affective neuroscience.

[42]  Jason P. Mitchell,et al.  Mentalizing under Uncertainty: Dissociated Neural Responses to Ambiguous and Unambiguous Mental State Inferences , 2009, Cerebral cortex.

[43]  R. Zinbarg,et al.  Interpreting neutral faces as threatening is a default mode for socially anxious individuals. , 2008, Journal of abnormal psychology.

[44]  Alexander Todorov,et al.  The amygdala and FFA track both social and non-social face dimensions , 2010, Neuropsychologia.

[45]  Andreas Keil,et al.  Sustained Preferential Processing of Social Threat Cues: Bias without Competition? , 2011, Journal of Cognitive Neuroscience.

[46]  Cheryl L. Grady,et al.  Distributed self in episodic memory: neural correlates of successful retrieval of self-encoded positive and negative personality traits , 2004, NeuroImage.

[47]  F. Craik,et al.  In search of the emotional self: an fMRI study using positive and negative emotional words. , 2003, The American journal of psychiatry.

[48]  Qingyang Li,et al.  Emotional perception: Meta-analyses of face and natural scene processing , 2011, NeuroImage.

[49]  S. Rauch,et al.  Response and Habituation of the Human Amygdala during Visual Processing of Facial Expression , 1996, Neuron.

[50]  Scott M. Hayes,et al.  Neural Mechanisms of Context Effects on Face Recognition: Automatic Binding and Context Shift Decrements , 2010, Journal of Cognitive Neuroscience.

[51]  Alexander Todorov,et al.  Spontaneous trait inferences are bound to actors' faces: evidence from a false recognition paradigm. , 2002, Journal of personality and social psychology.

[52]  Shlomo Bentin,et al.  The automaticity of emotional face-context integration. , 2011, Emotion.

[53]  Christopher I. Wright,et al.  Novelty responses and differential effects of order in the amygdala, substantia innominata, and inferior temporal cortex , 2003, NeuroImage.

[54]  William M. Kelley,et al.  Neuroanatomical Evidence for Distinct Cognitive and Affective Components of Self , 2006, Journal of Cognitive Neuroscience.

[55]  M. Leary A Brief Version of the Fear of Negative Evaluation Scale , 1983 .

[56]  R. Dolan,et al.  Emotion, Cognition, and Behavior , 2002, Science.

[57]  J. Grafman,et al.  The Human Amygdala: An Evolved System for Relevance Detection , 2003, Reviews in the neurosciences.

[58]  Jennifer C. Britton,et al.  Neural correlates of individual ratings of emotional salience: a trial-related fMRI study , 2004, NeuroImage.

[59]  B. McNaughton,et al.  Declarative memory consolidation in humans: a prospective functional magnetic resonance imaging study. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[60]  Maital Neta,et al.  Valence resolution of ambiguous facial expressions using an emotional oddball task. , 2011, Emotion.

[61]  Jane M Spurr,et al.  Self-focused attention in social phobia and social anxiety. , 2002, Clinical psychology review.

[62]  C. Neil Macrae,et al.  The Link between Social Cognition and Self-referential Thought in the Medial Prefrontal Cortex , 2005, Journal of Cognitive Neuroscience.

[63]  R. Adolphs,et al.  Impaired recognition of emotion in facial expressions following bilateral damage to the human amygdala , 1994, Nature.

[64]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[65]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[66]  B. de Gelder,et al.  Rapid influence of emotional scenes on encoding of facial expressions: an ERP study. , 2008, Social cognitive and affective neuroscience.

[67]  Michael Angstadt,et al.  Beyond threat: Amygdala reactivity across multiple expressions of facial affect , 2006, NeuroImage.

[68]  Andrew L. Alexander,et al.  Contextual Modulation of Amygdala Responsivity to Surprised Faces , 2004, Journal of Cognitive Neuroscience.

[69]  Murray B. Stein,et al.  Selective effects of social anxiety, anxiety sensitivity, and negative affectivity on the neural bases of emotional face processing , 2012, NeuroImage.

[70]  J. M. Carroll,et al.  Do facial expressions signal specific emotions? Judging emotion from the face in context. , 1996, Journal of personality and social psychology.

[71]  G. Pourtois,et al.  Distributed and interactive brain mechanisms during emotion face perception: Evidence from functional neuroimaging , 2007, Neuropsychologia.

[72]  J. Gross,et al.  The cognitive control of emotion , 2005, Trends in Cognitive Sciences.

[73]  U Klose,et al.  fMRI reveals amygdala activation to human faces in social phobics , 1998, Neuroreport.

[74]  Karine Sergerie,et al.  The role of the amygdala in emotional processing: A quantitative meta-analysis of functional neuroimaging studies , 2008, Neuroscience & Biobehavioral Reviews.

[75]  Alexander Todorov,et al.  Brain systems for assessing the affective value of faces , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[76]  G. Alpers,et al.  Is eye to eye contact really threatening and avoided in social anxiety?--An eye-tracking and psychophysiology study. , 2009, Journal of anxiety disorders.