Temporal and spatial neural dynamics in the perception of basic emotions from complex scenes.

The different temporal dynamics of emotions are critical to understand their evolutionary role in the regulation of interactions with the surrounding environment. Here, we investigated the temporal dynamics underlying the perception of four basic emotions from complex scenes varying in valence and arousal (fear, disgust, happiness and sadness) with the millisecond time resolution of Electroencephalography (EEG). Event-related potentials were computed and each emotion showed a specific temporal profile, as revealed by distinct time segments of significant differences from the neutral scenes. Fear perception elicited significant activity at the earliest time segments, followed by disgust, happiness and sadness. Moreover, fear, disgust and happiness were characterized by two time segments of significant activity, whereas sadness showed only one long-latency time segment of activity. Multidimensional scaling was used to assess the correspondence between neural temporal dynamics and the subjective experience elicited by the four emotions in a subsequent behavioral task. We found a high coherence between these two classes of data, indicating that psychological categories defining emotions have a close correspondence at the brain level in terms of neural temporal dynamics. Finally, we localized the brain regions of time-dependent activity for each emotion and time segment with the low-resolution brain electromagnetic tomography. Fear and disgust showed widely distributed activations, predominantly in the right hemisphere. Happiness activated a number of areas mostly in the left hemisphere, whereas sadness showed a limited number of active areas at late latency. The present findings indicate that the neural signature of basic emotions can emerge as the byproduct of dynamic spatiotemporal brain networks as investigated with millisecond-range resolution, rather than in time-independent areas involved uniquely in the processing one specific emotion.

[1]  Kevin N. Ochsner,et al.  For better or for worse: neural systems supporting the cognitive down- and up-regulation of negative emotion , 2004, NeuroImage.

[2]  Beatrice de Gelder,et al.  Context influences early perceptual analysis of faces--an electrophysiological study. , 2006, Cerebral cortex.

[3]  John Suckling,et al.  Brain Imaging Correlates of Depressive Symptom Severity and Predictors of Symptom Improvement After Antidepressant Treatment , 2007, Biological Psychiatry.

[4]  Valeria Gazzola,et al.  Motor mapping of implied actions during perception of emotional body language , 2012, Brain Stimulation.

[5]  J. H. Ward Hierarchical Grouping to Optimize an Objective Function , 1963 .

[6]  E. Phelps,et al.  The human amygdala. , 2009 .

[7]  Hugo D Critchley,et al.  Imitating expressions: emotion-specific neural substrates in facial mimicry. , 2006, Social cognitive and affective neuroscience.

[8]  R. Dolan,et al.  Distant influences of amygdala lesion on visual cortical activation during emotional face processing , 2004, Nature Neuroscience.

[9]  R. Dolan,et al.  Distinct spatial frequency sensitivities for processing faces and emotional expressions , 2003, Nature Neuroscience.

[10]  Thomas E. Nichols,et al.  Nonparametric permutation tests for functional neuroimaging: A primer with examples , 2002, Human brain mapping.

[11]  N. Hadjikhani,et al.  Fear fosters flight: a mechanism for fear contagion when perceiving emotion expressed by a whole body. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[12]  P. McGuire,et al.  Functional atlas of emotional faces processing: a voxel-based meta-analysis of 105 functional magnetic resonance imaging studies. , 2009, Journal of psychiatry & neuroscience : JPN.

[13]  John Suckling,et al.  Neural response to pleasant stimuli in anhedonia: an fMRI study , 2003, Neuroreport.

[14]  Giuliano Geminiani,et al.  Unseen facial and bodily expressions trigger fast emotional reactions , 2009, Proceedings of the National Academy of Sciences.

[15]  E. Miller,et al.  THE PREFRONTAL CORTEX AND COGNITIVE CONTROL , 2000 .

[16]  D L Rosene,et al.  Cingulate cortex of the rhesus monkey: I. Cytoarchitecture and thalamic afferents , 1987, The Journal of comparative neurology.

[17]  HighWire Press Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[18]  Gilles Pourtois,et al.  Fear recognition in the voice is modulated by unconsciously recognized facial expressions but not by unconsciously recognized affective pictures , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[19]  S. Rauch,et al.  A functional MRI study of human amygdala responses to facial expressions of fear versus anger. , 2001, Emotion.

[20]  P. Lang International Affective Picture System (IAPS) : Technical Manual and Affective Ratings , 1995 .

[21]  Marta I. Garrido,et al.  Functional Evidence for a Dual Route to Amygdala , 2012, Current Biology.

[22]  Alexander Borst,et al.  How does Nature Program Neuron Types? , 2008, Front. Neurosci..

[23]  Andrea Scarantino,et al.  Functional specialization does not require a one-to-one mapping between brain regions and emotions , 2012, Behavioral and Brain Sciences.

[24]  Ian H. Gotlib,et al.  The neural temporal dynamics of the intensity of emotional experience , 2010, NeuroImage.

[25]  D. Lehmann,et al.  Low resolution electromagnetic tomography: a new method for localizing electrical activity in the brain. , 1994, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[26]  P. Vuilleumier,et al.  How brains beware: neural mechanisms of emotional attention , 2005, Trends in Cognitive Sciences.

[27]  R. Dolan,et al.  A subcortical pathway to the right amygdala mediating "unseen" fear. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[28]  J. Decety,et al.  The Oxford handbook of social neuroscience , 2011 .

[29]  J. Panksepp Affective Neuroscience: The Foundations of Human and Animal Emotions , 1998 .

[30]  Swann Pichon,et al.  Cortico-subcortical visual, somatosensory, and motor activations for perceiving dynamic whole-body emotional expressions with and without striate cortex (V1) , 2011, Proceedings of the National Academy of Sciences.

[31]  E. Miller,et al.  The prefontral cortex and cognitive control , 2000, Nature Reviews Neuroscience.

[32]  Lisa Feldman Barrett,et al.  Functional grouping and cortical–subcortical interactions in emotion: A meta-analysis of neuroimaging studies , 2008, NeuroImage.

[33]  H. Barbas,et al.  Serial pathways from primate prefrontal cortex to autonomic areas may influence emotional expression , 2003, BMC Neuroscience.

[34]  A. Young,et al.  Impaired recognition and experience of disgust following brain injury , 2000, Nature Neuroscience.

[35]  A. Jedynak,et al.  Rapid extraction of emotional expression: evidence from evoked potential fields during brief presentation of face stimuli , 2003, Neuropsychologia.

[36]  R. Maddock The retrosplenial cortex and emotion: new insights from functional neuroimaging of the human brain , 1999, Trends in Neurosciences.

[37]  D. Pandya,et al.  Dorsolateral prefrontal cortex: comparative cytoarchitectonic analysis in the human and the macaque brain and corticocortical connection patterns , 1999, The European journal of neuroscience.

[38]  Jeff T. Larsen,et al.  May I have your attention, please: Electrocortical responses to positive and negative stimuli , 2003, Neuropsychologia.

[39]  Deborah A. Vitacco,et al.  Correspondence of event‐related potential tomography and functional magnetic resonance imaging during language processing , 2002, Human brain mapping.

[40]  J. Grafman,et al.  Frontal lobe injuries, violence, and aggression , 1996, Neurology.

[41]  P. Jerabek,et al.  Regional metabolic effects of fluoxetine in major depression: serial changes and relationship to clinical response , 2000, Biological Psychiatry.

[42]  Timothy Edward John Behrens,et al.  Changes in connectivity profiles define functionally distinct regions in human medial frontal cortex. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[43]  J. Russell,et al.  The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology , 2005, Development and Psychopathology.

[44]  A. Craig,et al.  How do you feel — now? The anterior insula and human awareness , 2009, Nature Reviews Neuroscience.

[45]  C. Frith,et al.  Meeting of minds: the medial frontal cortex and social cognition , 2006, Nature Reviews Neuroscience.

[46]  Timothy E. J. Behrens,et al.  Deep and Superficial Amygdala Nuclei Projections Revealed In Vivo by Probabilistic Tractography , 2011, The Journal of Neuroscience.

[47]  D. Pizzagalli Electroencephalography and High-Density Electrophysiological Source Localization , 2007 .

[48]  J. Russell,et al.  The relation between valence and arousal in subjective experience. , 2013, Psychological bulletin.

[49]  M. Thase,et al.  Can’t shake that feeling: event-related fMRI assessment of sustained amygdala activity in response to emotional information in depressed individuals , 2002, Biological Psychiatry.

[50]  L. Pessoa On the relationship between emotion and cognition , 2008, Nature Reviews Neuroscience.

[51]  Vinod Menon,et al.  Functional connectivity in the resting brain: A network analysis of the default mode hypothesis , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[52]  T. Dalgleish Basic Emotions , 2004 .

[53]  R. Goebel,et al.  Emotion unfolded by motion: a role for parietal lobe in decoding dynamic facial expressions. , 2013, Social cognitive and affective neuroscience.

[54]  B. Brinkmann,et al.  Localization of the Epileptic Focus by Low-Resolution Electromagnetic Tomography in Patients with a Lesion Demonstrated by MRI , 2004, Brain Topography.

[55]  P. Schyns,et al.  A mechanism for impaired fear recognition after amygdala damage , 2005, Nature.

[56]  K. Kendrick,et al.  Mirroring Fear in the Absence of a Functional Amygdala , 2013, Biological Psychiatry.

[57]  A. Lawrence,et al.  Functional neuroanatomy of emotions: A meta-analysis , 2003, Cognitive, affective & behavioral neuroscience.

[58]  V. Gazzola,et al.  Temporal dynamics of motor cortex excitability during perception of natural emotional scenes. , 2014, Social cognitive and affective neuroscience.

[59]  G. Rizzolatti,et al.  Neurophysiological mechanisms underlying the understanding and imitation of action , 2001, Nature Reviews Neuroscience.

[60]  Georg Northoff,et al.  Self-referential processing in our brain—A meta-analysis of imaging studies on the self , 2006, NeuroImage.

[61]  J. Russell,et al.  Multidimensional scaling of emotional facial expressions: Similarity from preschoolers to adults. , 1985 .

[62]  T. Dalgleish,et al.  Handbook of cognition and emotion , 1999 .

[63]  H. Meeren,et al.  Beyond the face: exploring rapid influences of context on face processing. , 2006, Progress in brain research.

[64]  J. Grafman,et al.  Human prefrontal cortex: processing and representational perspectives , 2003, Nature Reviews Neuroscience.

[65]  Karl J. Friston,et al.  Analysis of functional MRI time‐series , 1994, Human Brain Mapping.

[66]  E. Stip,et al.  The functional neuroanatomy of major depression: an fMRI study using an emotional activation paradigm , 1998, Neuroreport.

[67]  M. Tamietto,et al.  Neural bases of the non-conscious perception of emotional signals , 2010, Nature Reviews Neuroscience.

[68]  R. Davidson,et al.  Coupling of theta activity and glucose metabolism in the human rostral anterior cingulate cortex: an EEG/PET study of normal and depressed subjects. , 2003, Psychophysiology.

[69]  Robert Schmitt,et al.  Integration of fMRI and simultaneous EEG: towards a comprehensive understanding of localization and time-course of brain activity in target detection , 2004, NeuroImage.

[70]  Ralph Adolphs,et al.  The Biology of Fear , 2013, Current Biology.

[71]  H. Meeren,et al.  Rapid perceptual integration of facial expression and emotional body language. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[72]  L. F. Barrett Are Emotions Natural Kinds? , 2006, Perspectives on psychological science : a journal of the Association for Psychological Science.

[73]  E. N. Sokolov,et al.  A psychophysiological model of emotion space , 2000, Integrative physiological and behavioral science : the official journal of the Pavlovian Society.

[74]  A. Fallgatter,et al.  Three-dimensional tomography of event-related potentials during response inhibition: evidence for phasic frontal lobe activation. , 1998, Electroencephalography and clinical neurophysiology.

[75]  Kristen A. Lindquist,et al.  The brain basis of emotion: A meta-analytic review , 2012, Behavioral and Brain Sciences.

[76]  Christian E. Waugh,et al.  Timing: A missing key ingredient in typical fMRI studies of emotion , 2012, Behavioral and Brain Sciences.

[77]  R. Adolphs Recognizing emotion from facial expressions: psychological and neurological mechanisms. , 2002, Behavioral and cognitive neuroscience reviews.

[78]  J. Russell A circumplex model of affect. , 1980 .

[79]  E. Rolls,et al.  Orbitofrontal cortex neurons: role in olfactory and visual association learning. , 1996, Journal of neurophysiology.

[80]  Gian Luca Romani,et al.  Brain structures activated by overt and covert emotional visual stimuli , 2009, Brain Research Bulletin.

[81]  Nikolaus Kriegeskorte,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[82]  D. Pandya,et al.  Architecture and intrinsic connections of the prefrontal cortex in the rhesus monkey , 1989, The Journal of comparative neurology.

[83]  E. Rolls,et al.  The Orbitofrontal Cortex , 2019 .

[84]  Marco Tamietto,et al.  Standing up for the body. Recent progress in uncovering the networks involved in the perception of bodies and bodily expressions , 2010, Neuroscience & Biobehavioral Reviews.

[85]  D. Lehmann,et al.  Functional imaging with low-resolution brain electromagnetic tomography (LORETA): a review. , 2002, Methods and findings in experimental and clinical pharmacology.

[86]  Katherine Vytal,et al.  Neuroimaging Support for Discrete Neural Correlates of Basic Emotions: A Voxel-based Meta-analysis , 2010, Journal of Cognitive Neuroscience.

[87]  M Esslen,et al.  Brain areas and time course of emotional processing , 2004, NeuroImage.

[88]  S. Delplanque,et al.  Modulation of cognitive processing by emotional valence studied through event-related potentials in humans , 2004, Neuroscience Letters.

[89]  Y. Groen,et al.  Are there sex differences in ERPs related to processing empathy-evoking pictures? , 2013, Neuropsychologia.

[90]  Jonas K. Olofsson,et al.  Affective picture processing: An integrative review of ERP findings , 2008, Biological Psychology.

[91]  Jacobo Albert,et al.  Neural response to sustained affective visual stimulation using an indirect task , 2006, Experimental Brain Research.

[92]  I. Peretz,et al.  Cerebral and spinal modulation of pain by emotions , 2009, Proceedings of the National Academy of Sciences.

[93]  L. Fogassi,et al.  A Touching Sight SII/PV Activation during the Observation and Experience of Touch , 2004, Neuron.

[94]  Vittorio Gallese,et al.  Emotional and Social Behaviors Elicited by Electrical Stimulation of the Insula in the Macaque Monkey , 2011, Current Biology.

[95]  Christian Keysers,et al.  Somatosensation in social perception , 2010, Nature Reviews Neuroscience.

[96]  E T Rolls,et al.  Impulsivity, time perception, emotion and reinforcement sensitivity in patients with orbitofrontal cortex lesions. , 2004, Brain : a journal of neurology.

[97]  L. J. Chapman,et al.  The measurement of handedness , 1987, Brain and Cognition.

[98]  Alexander Todorov,et al.  Brain systems for assessing the affective value of faces , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[99]  N. Frijda The laws of emotion. , 1988, The American psychologist.

[100]  P. McGuire,et al.  Laterality effect on emotional faces processing: ALE meta-analysis of evidence , 2009, Neuroscience Letters.

[101]  K. Luan Phan,et al.  Functional Neuroanatomy of Emotion: A Meta-Analysis of Emotion Activation Studies in PET and fMRI , 2002, NeuroImage.

[102]  Bettina Sorger,et al.  Real-Time Self-Regulation of Emotion Networks in Patients with Depression , 2012, PloS one.

[103]  Keysers Christian,et al.  The Empathic Brain , 2011 .

[104]  K. Vohs,et al.  Case Western Reserve University , 1990 .

[105]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[106]  B. Fredrickson What Good Are Positive Emotions? , 1998, Review of general psychology : journal of Division 1, of the American Psychological Association.

[107]  Jeffrey S. Maxwell,et al.  Human Amygdala Responsivity to Masked Fearful Eye Whites , 2004, Science.

[108]  Rainer Goebel,et al.  Subcortical Connections to Human Amygdala and Changes following Destruction of the Visual Cortex , 2012, Current Biology.

[109]  Richard J. Davidson,et al.  The asymmetrical brain , 2003 .

[110]  R. Davidson Cerebral asymmetry and emotion: Conceptual and methodological conundrums , 1993 .