Abstract Representations of Associated Emotions in the Human Brain

Emotions can be aroused by various kinds of stimulus modalities. Recent neuroimaging studies indicate that several brain regions represent emotions at an abstract level, i.e., independently from the sensory cues from which they are perceived (e.g., face, body, or voice stimuli). If emotions are indeed represented at such an abstract level, then these abstract representations should also be activated by the memory of an emotional event. We tested this hypothesis by asking human participants to learn associations between emotional stimuli (videos of faces or bodies) and non-emotional stimuli (fractals). After successful learning, fMRI signals were recorded during the presentations of emotional stimuli and emotion-associated fractals. We tested whether emotions could be decoded from fMRI signals evoked by the fractal stimuli using a classifier trained on the responses to the emotional stimuli (and vice versa). This was implemented as a whole-brain searchlight, multivoxel activation pattern analysis, which revealed successful emotion decoding in four brain regions: posterior cingulate cortex (PCC), precuneus, MPFC, and angular gyrus. The same analysis run only on responses to emotional stimuli revealed clusters in PCC, precuneus, and MPFC. Multidimensional scaling analysis of the activation patterns revealed clear clustering of responses by emotion across stimulus types. Our results suggest that PCC, precuneus, and MPFC contain representations of emotions that can be evoked by stimuli that carry emotional information themselves or by stimuli that evoke memories of emotional stimuli, while angular gyrus is more likely to take part in emotional memory retrieval.

[1]  Jeffrey M. Zacks,et al.  Searchlight analysis: Promise, pitfalls, and potential , 2013, NeuroImage.

[2]  Lisa Feldman Barrett,et al.  Functional grouping and cortical–subcortical interactions in emotion: A meta-analysis of neuroimaging studies , 2008, NeuroImage.

[3]  R. Adolphs,et al.  Damage to the prefrontal cortex increases utilitarian moral judgements , 2007, Nature.

[4]  Kristen A. Lindquist,et al.  The brain basis of emotion: A meta-analytic review , 2012, Behavioral and Brain Sciences.

[5]  F Mauguiere,et al.  The duality of the cingulate gyrus in monkey. Neuroanatomical study and functional hypothesis. , 1980, Brain : a journal of neurology.

[6]  Timothy E. J. Behrens,et al.  Online evaluation of novel choices by simultaneous representation of multiple memories , 2013, Nature Neuroscience.

[7]  T. Kircher,et al.  Supramodal Representation of Emotions , 2011, The Journal of Neuroscience.

[8]  M. Buonocore,et al.  Posterior cingulate cortex activation by emotional words: fMRI evidence from a valence decision task , 2003, Human brain mapping.

[9]  M. Peelen,et al.  Supramodal Representations of Perceived Emotions in the Human Brain , 2010, The Journal of Neuroscience.

[10]  M. Fredrikson,et al.  Functional neuroanatomy of robbery re‐experience: affective memories studied with PET , 1996, Neuroreport.

[11]  A. Young,et al.  Emotion Perception from Dynamic and Static Body Expressions in Point-Light and Full-Light Displays , 2004, Perception.

[12]  S. Edelman,et al.  Toward direct visualization of the internal shape representation space by fMRI , 1998, Psychobiology.

[13]  Greg O. Horne,et al.  Controlling low-level image properties: The SHINE toolbox , 2010, Behavior research methods.

[14]  S E Petersen,et al.  Direct comparison of episodic encoding and retrieval of words: an event-related fMRI study. , 1999, Memory.

[15]  G. Glover,et al.  Reflecting upon Feelings: An fMRI Study of Neural Systems Supporting the Attribution of Emotion to Self and Other , 2004, Journal of Cognitive Neuroscience.

[16]  R. Mar The neural bases of social cognition and story comprehension. , 2011, Annual review of psychology.

[17]  Jason P. Mitchell,et al.  Distinct neural systems subserve person and object knowledge , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Timothy Edward John Behrens,et al.  Segregated Encoding of Reward–Identity and Stimulus–Reward Associations in Human Orbitofrontal Cortex , 2013, The Journal of Neuroscience.

[19]  A. Atkinson,et al.  Evidence for distinct contributions of form and motion information to the recognition of emotions from body gestures , 2007, Cognition.

[20]  M. Buonocore,et al.  Remembering familiar people: the posterior cingulate cortex and autobiographical memory retrieval , 2001, Neuroscience.

[21]  Nikolaus Kriegeskorte,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[22]  Arafat Angulo-Perkins,et al.  Fear across the senses: brain responses to music, vocalizations and facial expressions. , 2015, Social cognitive and affective neuroscience.

[23]  A. Cavanna,et al.  The precuneus: a review of its functional anatomy and behavioural correlates. , 2006, Brain : a journal of neurology.

[24]  M. Tomasello,et al.  Does the chimpanzee have a theory of mind? 30 years later , 2008, Trends in Cognitive Sciences.

[25]  A. Damasio,et al.  Subcortical and cortical brain activity during the feeling of self-generated emotions , 2000, Nature Neuroscience.

[26]  Steven Laureys,et al.  Cytology and functionally correlated circuits of human posterior cingulate areas , 2006, NeuroImage.

[27]  Alison J. Wiggett,et al.  Surface-Based Information Mapping Reveals Crossmodal Vision–Action Representations in Human Parietal and Occipitotemporal Cortex , 2010, Journal of neurophysiology.

[28]  S. Kosslyn,et al.  The role of area 17 in visual imagery: convergent evidence from PET and rTMS. , 1999, Science.

[29]  Guillaume Flandin,et al.  Retinotopic organization of visual mental images as revealed by functional magnetic resonance imaging. , 2004, Brain research. Cognitive brain research.

[30]  A. Lawrence,et al.  Functional neuroanatomy of emotions: A meta-analysis , 2003, Cognitive, affective & behavioral neuroscience.

[31]  Jean-Baptiste Poline,et al.  Inverse retinotopy: Inferring the visual content of images from brain activation patterns , 2006, NeuroImage.

[32]  M. Raichle,et al.  Searching for a baseline: Functional imaging and the resting human brain , 2001, Nature Reviews Neuroscience.

[33]  T. Egner,et al.  Emotional processing in anterior cingulate and medial prefrontal cortex , 2011, Trends in Cognitive Sciences.

[34]  James W Tanaka,et al.  An Encoding Advantage for Own-Race versus Other-Race Faces , 2003, Perception.

[35]  K. Luan Phan,et al.  Functional Neuroanatomy of Emotion: A Meta-Analysis of Emotion Activation Studies in PET and fMRI , 2002, NeuroImage.

[36]  J. Schwerdtner,et al.  fMRI an der Forensischen Klinik am Bezirksklinikum Regensburg - Neuroanatomische Grundlagen der Emotionsverarbeitung , 2004 .

[37]  Thomas E. Nichols,et al.  Controlling the familywise error rate in functional neuroimaging: a comparative review , 2003, Statistical methods in medical research.

[38]  C. Frith,et al.  Interacting minds--a biological basis. , 1999, Science.

[39]  BoRa Kim,et al.  P2-35: The KU Facial Expression Database: A Validated Database of Emotional and Conversational Expressions , 2012 .

[40]  Karl J. Friston,et al.  Neuroanatomical correlates of externally and internally generated human emotion. , 1997, The American journal of psychiatry.

[41]  N C Andreasen,et al.  Remembering the past: two facets of episodic memory explored with positron emission tomography. , 1995, The American journal of psychiatry.

[42]  Jing Wang,et al.  Decoding the neural representation of affective states , 2012, NeuroImage.

[43]  Francisco Pereira,et al.  Information mapping with pattern classifiers: A comparative study , 2011, NeuroImage.

[44]  Vaidehi S. Natu,et al.  Category-Specific Cortical Activity Precedes Retrieval During Memory Search , 2005, Science.

[45]  Alexander Borst,et al.  How does Nature Program Neuron Types? , 2008, Front. Neurosci..

[46]  Uta Frith,et al.  Cognitive psychology - Interacting minds - A biological basis , 1999 .

[47]  M. Buonocore,et al.  Activation of left posterior cingulate gyrus by the auditory presentation ofthreat-related words: an fMRI study , 1997, Psychiatry Research: Neuroimaging.