Neural Correlates of Facial Mimicry: Simultaneous Measurements of EMG and BOLD Responses during Perception of Dynamic Compared to Static Facial Expressions

Facial mimicry (FM) is an automatic response to imitate the facial expressions of others. However, neural correlates of the phenomenon are as yet not well established. We investigated this issue using simultaneously recorded EMG and BOLD signals during perception of dynamic and static emotional facial expressions of happiness and anger. During display presentations, BOLD signals and zygomaticus major (ZM), corrugator supercilii (CS) and orbicularis oculi (OO) EMG responses were recorded simultaneously from 46 healthy individuals. Subjects reacted spontaneously to happy facial expressions with increased EMG activity in ZM and OO muscles and decreased CS activity, which was interpreted as FM. Facial muscle responses correlated with BOLD activity in regions associated with motor simulation of facial expressions [i.e., inferior frontal gyrus, a classical Mirror Neuron System (MNS)]. Further, we also found correlations for regions associated with emotional processing (i.e., insula, part of the extended MNS). It is concluded that FM involves both motor and emotional brain structures, especially during perception of natural emotional expressions.

[1]  Beate Seibt,et al.  Facial mimicry in its social setting , 2015, Front. Psychol..

[2]  Morten L Kringelbach,et al.  The functional neuroanatomy of pleasure and happiness. , 2010, Discovery medicine.

[3]  Peter Erhard,et al.  A common neural basis for receptive and expressive communication of pleasant facial affect , 2005, NeuroImage.

[4]  Robert Turner,et al.  A Method for Removing Imaging Artifact from Continuous EEG Recorded during Functional MRI , 2000, NeuroImage.

[5]  Peter Redgrave,et al.  Basal Ganglia , 2020, Encyclopedia of Autism Spectrum Disorders.

[6]  Harald C. Traue,et al.  Neural correlates of the perception of dynamic versus static facial expressions of emotion , 2011, Psycho-social medicine.

[7]  Jeff T. Larsen,et al.  Effects of positive and negative affect on electromyographic activity over zygomaticus major and corrugator supercilii. , 2003, Psychophysiology.

[8]  Eva H. Telzer,et al.  Amygdala and nucleus accumbens activation to emotional facial expressions in children and adolescents at risk for major depression. , 2008, The American journal of psychiatry.

[9]  U. Hess,et al.  You smile–I smile: Emotion expression in social interaction , 2010, Biological Psychology.

[10]  S. Huettel,et al.  Human Neuroscience , 2022 .

[11]  Skyler T. Hawk,et al.  Moving faces, looking places: validation of the Amsterdam Dynamic Facial Expression Set (ADFES). , 2011, Emotion.

[12]  Angela R. Laird,et al.  Neural network of cognitive emotion regulation — An ALE meta-analysis and MACM analysis , 2014, NeuroImage.

[13]  E. Heerey,et al.  Predictive and Reactive Mechanisms in Smile Reciprocity , 2013, Psychological science.

[14]  Hiroyuki Okada,et al.  Neural Substrates of Human Facial Expression of Pleasant Emotion Induced by Comic Films: A PET Study , 2002, NeuroImage.

[15]  U. Dimberg,et al.  Emotional Empathy and Facial Feedback , 2008 .

[16]  Hugo D Critchley,et al.  Imitating expressions: emotion-specific neural substrates in facial mimicry. , 2006, Social cognitive and affective neuroscience.

[17]  D. Perrett,et al.  Beauty in a smile: the role of medial orbitofrontal cortex in facial attractiveness , 2003, Neuropsychologia.

[18]  A. J. Fridlund,et al.  Guidelines for human electromyographic research. , 1986, Psychophysiology.

[19]  Carl Senior,et al.  Dynamic Facial Expressions Evoke Distinct Activation in the Face Perception Network: A Connectivity Analysis Study , 2012, Journal of Cognitive Neuroscience.

[20]  F. Van Overwalle.  Social cognition and the brain: A meta‐analysis , 2009, Human brain mapping.

[21]  U. Dimberg,et al.  Facial reactions to emotional stimuli: Automatically controlled emotional responses , 2002 .

[22]  P. Ekman,et al.  What the face reveals : basic and applied studies of spontaneous expression using the facial action coding system (FACS) , 2005 .

[23]  A. Cronin-Golomb,et al.  Specific impairments in the recognition of emotional facial expressions in Parkinson's disease , 2008, Neuropsychologia.

[24]  Jean-Luc Anton,et al.  Region of interest analysis using an SPM toolbox , 2010 .

[25]  C. Frith,et al.  Reading the mind in cartoons and stories: an fMRI study of ‘theory of mind’ in verbal and nonverbal tasks , 2000, Neuropsychologia.

[26]  E. Hatfield,et al.  Emotional Contagion , 1995 .

[27]  Cezary Biele,et al.  EMG activity in response to static and dynamic facial expressions. , 2011, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[28]  C. V. Witvliet,et al.  Psychophysiological responses as indices of affective dimensions. , 1995, Psychophysiology.

[29]  P. Niedenthal,et al.  Fashioning the Face: Sensorimotor Simulation Contributes to Facial Expression Recognition , 2016, Trends in Cognitive Sciences.

[30]  T. Johnstone,et al.  How reward modulates mimicry: EMG evidence of greater facial mimicry of more rewarding happy faces. , 2012, Psychophysiology.

[31]  U. Hess,et al.  Facial mimicry and emotional contagion to dynamic emotional facial expressions and their influence on decoding accuracy. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[32]  Ori Friedman,et al.  Core mechanisms in ‘theory of mind’ , 2004, Trends in Cognitive Sciences.

[33]  Christian Keysers,et al.  Inferior frontal gyrus activity triggers anterior insula response to emotional facial expressions. , 2008, Emotion.

[34]  Ursula Hess,et al.  Deficits in decoding emotional facial expressions in Parkinson’s disease , 2004, Neuropsychologia.

[35]  S. Lehéricy,et al.  3-D diffusion tensor axonal tracking shows distinct SMA and pre-SMA projections to the human striatum. , 2004, Cerebral cortex.

[36]  T. Kameda,et al.  Spontaneous Facial Mimicry Is Enhanced by the Goal of Inferring Emotional States: Evidence for Moderation of “Automatic” Mimicry by Higher Cognitive Processes , 2016, PloS one.

[37]  P. Vuilleumier,et al.  Neural Substrates of Social Emotion Regulation: A fMRI Study on Imitation and Expressive Suppression to Dynamic Facial Signals , 2013, Front. Psychol..

[38]  J. Cohn,et al.  Deciphering the Enigmatic Face , 2005, Psychological science.

[39]  Sakiko Yoshikawa,et al.  Enhanced Experience of Emotional Arousal in Response to Dynamic Facial Expressions , 2007 .

[40]  U. Dimberg,et al.  Rapid facial reactions to emotional facial expressions. , 1998, Scandinavian journal of psychology.

[41]  P. Ekman,et al.  The Duchenne smile: emotional expression and brain physiology. II. , 1990, Journal of personality and social psychology.

[42]  U. Dimberg,et al.  Unconscious Facial Reactions to Emotional Facial Expressions , 2000, Psychological science.

[43]  F. Strack,et al.  Approach and avoidance: the influence of proprioceptive and exteroceptive cues on encoding of affective information. , 2000, Journal of personality and social psychology.

[44]  P. Pauli,et al.  Facial mimicry and the mirror neuron system: simultaneous acquisition of facial electromyography and functional magnetic resonance imaging , 2012, Front. Hum. Neurosci..

[45]  C. Keysers,et al.  Facial expressions: What the mirror neuron system can and cannot tell us , 2007, Social neuroscience.

[46]  U. Dimberg,et al.  Facial reactions to happy and angry facial expressions: evidence for right hemisphere dominance. , 2000, Psychophysiology.

[47]  T. Allison,et al.  Brain activation evoked by perception of gaze shifts: the influence of context , 2003, Neuropsychologia.

[48]  M. Iacoboni,et al.  The mirror neuron system and the consequences of its dysfunction , 2006, Nature Reviews Neuroscience.

[49]  Frank A. Russo,et al.  Deficits in the Mimicry of Facial Expressions in Parkinson's Disease , 2016, Front. Psychol..

[50]  S. W. Rieger,et al.  Gender differences in the neural network of facial mimicry of smiles – An rTMS study , 2015, Cortex.

[51]  Clinton D. Kilts,et al.  Dissociable Neural Pathways Are Involved in the Recognition of Emotion in Static and Dynamic Facial Expressions , 2003, NeuroImage.

[52]  T. Chartrand,et al.  The chameleon effect: the perception-behavior link and social interaction. , 1999, Journal of personality and social psychology.

[53]  Christopher S. Monk,et al.  Choice selection and reward anticipation: an fMRI study , 2004, Neuropsychologia.

[54]  M. Herrmann,et al.  Emotions in motion: Dynamic compared to static facial expressions of disgust and happiness reveal more widespread emotion-specific activations , 2009, Brain Research.

[55]  R. Sprengelmeyera,et al.  Facial expression recognition in people with medicated and unmedicated Parkinson ’ s disease , 2015 .

[56]  Paul Pauli,et al.  Modulation of facial mimicry by attitudes , 2008 .

[57]  W. Sato,et al.  Enhanced facial EMG activity in response to dynamic facial expressions. , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[58]  G. Rizzolatti,et al.  Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling Disgust , 2003, Neuron.

[59]  U. Dimberg,et al.  Emotional Empathy and Facial Reactions to Facial Expressions , 2011 .

[60]  J. Mazziotta,et al.  Neural mechanisms of empathy in humans: A relay from neural systems for imitation to limbic areas , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[61]  Simone Schnall,et al.  Transgressions and Expressions , 2011 .

[62]  P. Pauli,et al.  Stop looking angry and smile, please: start and stop of the very same facial expression differentially activate threat- and reward-related brain networks , 2010, Social cognitive and affective neuroscience.

[63]  Paul Pauli,et al.  Electromyographic responses to static and dynamic avatar emotional facial expressions. , 2006, Psychophysiology.

[64]  P. Pauli,et al.  Processes underlying congruent and incongruent facial reactions to emotional facial expressions. , 2011, Emotion.

[65]  Reginald B. Adams,et al.  A 7 Tesla fMRI Study of Amygdala Responses to Fearful Faces , 2012, Brain Topography.

[66]  Takanori Kochiyama,et al.  Spatiotemporal neural network dynamics for the processing of dynamic facial expressions , 2015, Scientific Reports.

[67]  Karl J. Friston,et al.  Network Interactions Explain Sensitivity to Dynamic Faces in the Superior Temporal Sulcus , 2014, Cerebral cortex.

[68]  E. Tidoni,et al.  Sensorimotor Network Crucial for Inferring Amusement from Smiles , 2016, Cerebral cortex.

[69]  R. Schultz,et al.  Superior temporal activation in response to dynamic audio-visual emotional cues , 2009, Brain and Cognition.

[70]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[71]  C. Keysers,et al.  Evidence for mirror systems in emotions , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[72]  Christian Keysers,et al.  Empathy for positive and negative emotions in the gustatory cortex , 2007, NeuroImage.

[73]  C. Beckmann,et al.  Anger-sensitive networks: characterizing neural systems recruited during aggressive social interactions using data-driven analysis , 2017, Social cognitive and affective neuroscience.

[74]  J. Cacioppo,et al.  Electromyographic activity over facial muscle regions can differentiate the valence and intensity of affective reactions. , 1986, Journal of personality and social psychology.

[75]  Margot J. Taylor,et al.  Converging Evidence for the Advantage of Dynamic Facial Expressions , 2011, Brain Topography.

[76]  C. Keysers,et al.  Empathy and the Somatotopic Auditory Mirror System in Humans , 2006, Current Biology.

[77]  E. Naito,et al.  Enhanced neural activity in response to dynamic facial expressions of emotion: an fMRI study. , 2004, Brain research. Cognitive brain research.

[78]  S. Kaiser,et al.  The Perception and Mimicry of Facial Movements Predict Judgments of Smile Authenticity , 2014, PloS one.

[79]  Łukasz Żurawski,et al.  Do Dynamic Compared to Static Facial Expressions of Happiness and Anger Reveal Enhanced Facial Mimicry? , 2016, PloS one.

[80]  Francesco Versace,et al.  Pleasure rather than salience activates human nucleus accumbens and medial prefrontal cortex. , 2007, Journal of neurophysiology.

[81]  Pierre Philippot,et al.  Facial Reactions to Emotional Facial Expressions: Affect or Cognition? , 1998 .

[82]  Tilo Kircher,et al.  Affect-specific activation of shared networks for perception and execution of facial expressions. , 2013, Social cognitive and affective neuroscience.