Neural signatures of dynamic emotion constructs in the human brain

How is emotion represented in the brain: is it categorical or along dimensions? In the present study, we applied multivariate pattern analysis (MVPA) to magnetoencephalography (MEG) to study the brain's temporally unfolding representations of different emotion constructs. First, participants rated 525 images on the dimensions of valence and arousal and by intensity of discrete emotion categories (happiness, sadness, fear, disgust, and sadness). Thirteen new participants then viewed subsets of these images within an MEG scanner. We used Representational Similarity Analysis (RSA) to compare behavioral ratings to the unfolding neural representation of the stimuli in the brain. Ratings of valence and arousal explained significant proportions of the MEG data, even after corrections for low-level image properties. Additionally, behavioral ratings of the discrete emotions fear, disgust, and happiness significantly predicted early neural representations, whereas rating models of anger and sadness did not. Different emotion constructs also showed unique temporal signatures. Fear and disgust - both highly arousing and negative - were rapidly discriminated by the brain, but disgust was represented for an extended period of time relative to fear. Overall, our findings suggest that 1) dimensions of valence and arousal are quickly represented by the brain, as are some discrete emotions, and 2) different emotion constructs exhibit unique temporal dynamics. We discuss implications of these findings for theoretical understanding of emotion and for the interplay of discrete and dimensional aspects of emotional experience.

[1]  K. Scherer,et al.  The World of Emotions is not Two-Dimensional , 2007, Psychological science.

[2]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[3]  C. Izard Basic emotions, relations among emotions, and emotion-cognition relations. , 1992, Psychological review.

[4]  Joseph E LeDoux Emotion Circuits in the Brain , 2000 .

[5]  M. Rajadhyaksha,et al.  Confocal imaging-guided laser ablation of basal cell carcinomas: an ex vivo study. , 2015, The Journal of investigative dermatology.

[6]  P. Lang International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[7]  N. Kriegeskorte,et al.  Author ' s personal copy Representational geometry : integrating cognition , computation , and the brain , 2013 .

[8]  D. Rubin,et al.  A comparison of dimensional models of emotion: Evidence from emotions, prototypical events, autobiographical memories, and words , 2009, Memory.

[9]  Lisa Feldman Barrett,et al.  The theory of constructed emotion: an active inference account of interoception and categorization , 2017, Social cognitive and affective neuroscience.

[10]  J. Russell A circumplex model of affect. , 1980 .

[11]  Nikolaus Kriegeskorte,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[12]  Adam J. Berinsky,et al.  Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk , 2012, Political Analysis.

[13]  Philip A. Kragel,et al.  Multivariate neural biomarkers of emotional states are categorically distinct. , 2015, Social cognitive and affective neuroscience.

[14]  Nikolaus Kriegeskorte,et al.  Pattern-information analysis: From stimulus decoding to computational-model testing , 2011, NeuroImage.

[15]  P. Ekman An argument for basic emotions , 1992 .

[16]  Kristen A. Lindquist,et al.  The hundred-year emotion war: are emotions natural kinds or psychological constructions? Comment on Lench, Flores, and Bench (2011). , 2013, Psychological bulletin.

[17]  Keiji Tanaka,et al.  Matching Categorical Object Representations in Inferior Temporal Cortex of Man and Monkey , 2008, Neuron.

[18]  Franco Cauda,et al.  Temporal and spatial neural dynamics in the perception of basic emotions from complex scenes. , 2014, Social cognitive and affective neuroscience.

[19]  Li Su,et al.  A Toolbox for Representational Similarity Analysis , 2014, PLoS Comput. Biol..

[20]  S. Scott,et al.  Saying it with feeling: neural responses to emotional vocalizations , 1999, Neuropsychologia.

[21]  Thomas Serre,et al.  Object recognition with features inspired by visual cortex , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[22]  T. Carlson,et al.  Patterns of Activity in the Categorical Representations of Objects , 2003, Journal of Cognitive Neuroscience.

[23]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[24]  Joel Z. Leibo,et al.  The dynamics of invariant object recognition in the human visual system. , 2014, Journal of neurophysiology.

[25]  J. Russell,et al.  Core affect, prototypical emotional episodes, and other things called emotion: dissecting the elephant. , 1999, Journal of personality and social psychology.

[26]  L. Pessoa,et al.  Emotion processing and the amygdala: from a 'low road' to 'many roads' of evaluating biological significance , 2010, Nature Reviews Neuroscience.

[27]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[28]  Adam K. Anderson,et al.  Population coding of affect across stimuli, modalities and individuals , 2014, Nature Neuroscience.

[29]  M Esslen,et al.  Brain areas and time course of emotional processing , 2004, NeuroImage.

[30]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[31]  Tom F. Price,et al.  Does Negative Affect Always Narrow and Positive Affect Always Broaden the Mind? Considering the Influence of Motivational Intensity on Cognitive Scope , 2013 .

[32]  David D. Cox,et al.  Functional magnetic resonance imaging (fMRI) “brain reading”: detecting and classifying distributed patterns of fMRI activity in human visual cortex , 2003, NeuroImage.

[33]  Jörn Diedrichsen,et al.  Reliability of dissimilarity measures for multi-voxel pattern analysis , 2016, NeuroImage.

[34]  Philip A. Kragel,et al.  Decoding the Nature of Emotion in the Brain , 2016, Trends in Cognitive Sciences.

[35]  Philip A Kragel,et al.  Multivariate pattern classification reveals autonomic and experiential representations of discrete emotions. , 2013, Emotion.

[36]  J. Russell,et al.  Core affect, prototypical emotional episodes, and other things called emotion: dissecting the elephant. , 1999 .

[37]  R. Hari,et al.  Discrete Neural Signatures of Basic Emotions. , 2016, Cerebral cortex.

[38]  Sylvain Baillet,et al.  Magnetoencephalography for brain electrophysiology and imaging , 2017, Nature Neuroscience.

[39]  Marvin M. Chun,et al.  Attentional rubbernecking: Cognitive control and personality in emotion-induced blindness , 2005, Psychonomic bulletin & review.

[40]  Thomas A Carlson,et al.  Rapid neural discrimination of communicative gestures. , 2015, Social cognitive and affective neuroscience.

[41]  L. F. Barrett The theory of constructed emotion: an active inference account of interoception and categorization , 2016, Social cognitive and affective neuroscience.

[42]  Nikolaus Kriegeskorte,et al.  Perceptual similarity of visual patterns predicts dynamic neural activation patterns measured with MEG , 2016, NeuroImage.

[43]  Christian E. Waugh,et al.  Temporal Dynamics of Emotional Processing in the Brain , 2015 .

[44]  J. Russell Please Scroll down for Article Cognition & Emotion Emotion, Core Affect, and Psychological Construction , 2022 .

[45]  Naresh Acharya,et al.  Locating series FACTS devices for congestion management in deregulated electricity markets , 2007 .

[46]  J. Wagemans,et al.  Is neuroimaging measuring information in the brain? , 2016, Psychonomic Bulletin & Review.

[47]  Stephan Hamann,et al.  Mapping discrete and dimensional emotions onto the brain: controversies and consensus , 2012, Trends in Cognitive Sciences.

[48]  Susan G. Wardle,et al.  Decoding Dynamic Brain Patterns from Evoked Responses: A Tutorial on Multivariate Pattern Analysis Applied to Time Series Neuroimaging Data , 2016, Journal of Cognitive Neuroscience.

[49]  T. Poggio,et al.  Neural mechanisms of object recognition , 2002, Current Opinion in Neurobiology.

[50]  M. Tamietto,et al.  Neural bases of the non-conscious perception of emotional signals , 2010, Nature Reviews Neuroscience.

[51]  A. Jedynak,et al.  Rapid extraction of emotional expression: evidence from evoked potential fields during brief presentation of face stimuli , 2003, Neuropsychologia.

[52]  W. Drongelen,et al.  Localization of brain electrical activity via linearly constrained minimum variance spatial filtering , 1997, IEEE Transactions on Biomedical Engineering.

[53]  A. Grabowska,et al.  The Nencki Affective Picture System (NAPS): Introduction to a novel, standardized, wide-range, high-quality, realistic picture database , 2013, Behavior research methods.

[54]  Radoslaw Martin Cichy,et al.  Resolving human object recognition in space and time , 2014, Nature Neuroscience.

[55]  L. F. Barrett Variety is the spice of life: A psychological construction approach to understanding variability in emotion , 2009, Cognition & emotion.

[56]  J. Haynes A Primer on Pattern-Based Approaches to fMRI: Principles, Pitfalls, and Perspectives , 2015, Neuron.

[57]  Rainer Goebel,et al.  Information-based functional brain mapping. , 2006, Proceedings of the National Academy of Sciences of the United States of America.