Emotionotopy: Gradients encode emotion dimensions in right temporo-parietal territories

Humans use emotions to decipher complex cascades of internal events. However, which mechanisms link subjective descriptions of affective states to brain activity is unclear, with evidence supporting either local or distributed processing. A biologically favorable alternative is provided by the notion of gradient, which postulates the isomorphism between functional representations of stimulus features and cortical distance. Here, we used fMRI activity evoked by an emotionally charged movie and continuous ratings of the perceived emotion intensity, to reveal the topographic organization of affective states. We found that three orthogonal and spatially overlapping gradients encode the polarity, complexity and intensity of emotional experiences in right temporo-parietal territories. The spatial arrangement of these gradients allows the brain to map a variety of affective states within a single patch of cortex. As this organization resembles how sensory regions represent psychophysical properties (e.g., retinotopy), we propose emotionotopy as the underlying principle of emotion coding.

[1]  Jessica L. Tracy,et al.  Four Models of Basic Emotions: A Review of Ekman and Cordaro, Izard, Levenson, and Panksepp and Watt , 2011 .

[2]  M. Petrides Motor conditional associative-learning after selective prefrontal lesions in the monkey , 1982, Behavioural Brain Research.

[3]  J. Russell A circumplex model of affect. , 1980 .

[4]  Diana I Tamir,et al.  Mental models accurately predict emotion transitions , 2017, Proceedings of the National Academy of Sciences.

[5]  Abraham Z. Snyder,et al.  Spurious but systematic correlations in functional connectivity MRI networks arise from subject motion , 2012, NeuroImage.

[6]  Thomas E. Nichols,et al.  A Bayesian Model of Category-Specific Emotional Brain Responses , 2015, PLoS Comput. Biol..

[7]  Stefanie Seiler,et al.  Finding Groups In Data , 2016 .

[8]  Janaina Mourão Miranda,et al.  Contributions of stimulus valence and arousal to visual activation during emotional perception , 2003, NeuroImage.

[9]  R Saxe,et al.  People thinking about thinking people The role of the temporo-parietal junction in “theory of mind” , 2003, NeuroImage.

[10]  G. Glover,et al.  Dissociated neural representations of intensity and valence in human olfaction , 2003, Nature Neuroscience.

[11]  K. Scherer,et al.  The World of Emotions is not Two-Dimensional , 2007, Psychological science.

[12]  Craig A. Smith,et al.  Patterns of cognitive appraisal in emotion. , 1985, Journal of personality and social psychology.

[13]  Jack L. Gallant,et al.  Encoding and decoding in fMRI , 2011, NeuroImage.

[14]  Kristen A. Lindquist,et al.  Intrinsic connectivity in the human brain does not reveal networks for 'basic' emotions. , 2015, Social cognitive and affective neuroscience.

[15]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[16]  F. Van Overwalle Social cognition and the brain: A meta‐analysis , 2009, Human brain mapping.

[17]  Jaak Panksepp,et al.  Toward a general psychobiological theory of emotions , 1982, Behavioral and Brain Sciences.

[18]  J. Hietanen,et al.  Bodily maps of emotions , 2013, Proceedings of the National Academy of Sciences.

[19]  Lisa Feldman Barrett,et al.  Functional grouping and cortical–subcortical interactions in emotion: A meta-analysis of neuroimaging studies , 2008, NeuroImage.

[20]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[21]  R. Malach,et al.  Intersubject Synchronization of Cortical Activity During Natural Vision , 2004, Science.

[22]  Aaron R. Seitz,et al.  Detecting and Quantifying Topography in Neural Maps , 2014, PloS one.

[23]  K. Luan Phan,et al.  Valence, gender, and lateralization of functional brain anatomy in emotion: a meta-analysis of findings from neuroimaging , 2003, NeuroImage.

[24]  M. Peelen,et al.  Supramodal Representations of Perceived Emotions in the Human Brain , 2010, The Journal of Neuroscience.

[25]  Elizabeth Jefferies,et al.  Situating the default-mode network along a principal gradient of macroscale cortical organization , 2016, Proceedings of the National Academy of Sciences.

[26]  Ralph Adolphs,et al.  The Biology of Fear , 2013, Current Biology.

[27]  Juan Carlos Fernández,et al.  Multiobjective evolutionary algorithms to identify highly autocorrelated areas: the case of spatial distribution in financially compromised farms , 2014, Ann. Oper. Res..

[28]  J W Belliveau,et al.  Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. , 1995, Science.

[29]  J. Diedrichsen,et al.  Hand use predicts the structure of representations in sensorimotor cortex , 2015, Nature Neuroscience.

[30]  Peter J. Rousseeuw,et al.  Finding Groups in Data: An Introduction to Cluster Analysis , 1990 .

[31]  Schreiber,et al.  Improved Surrogate Data for Nonlinearity Tests. , 1996, Physical review letters.

[32]  John Suckling,et al.  Shared Neural Circuits for Mentalizing about the Self and Others , 2010, Journal of Cognitive Neuroscience.

[33]  Jeff T. Larsen,et al.  Can people feel happy and sad at the same time? , 2001, Journal of personality and social psychology.

[34]  Rebecca Saxe,et al.  Neural Representations of Emotion Are Organized around Abstract Event Features , 2015, Current Biology.

[35]  Sarah-Jayne Blakemore,et al.  Functional connectivity during a social emotion task in adolescents and in adults , 2009, The European journal of neuroscience.

[36]  Kristen A. Lindquist,et al.  The brain basis of emotion: A meta-analytic review , 2012, Behavioral and Brain Sciences.

[37]  Russell A. Poldrack,et al.  Large-scale automated synthesis of human functional neuroimaging data , 2011, Nature Methods.

[38]  Sylvia D. Kreibig,et al.  Autonomic nervous system activity in emotion: A review , 2010, Biological Psychology.

[39]  R. Hari,et al.  Discrete Neural Signatures of Basic Emotions. , 2016, Cerebral cortex.

[40]  Talma Hendler,et al.  Cry for her or cry with her: context-dependent dissociation of two modes of cinematic empathy reflected in network cohesion dynamics. , 2014, Social cognitive and affective neuroscience.

[41]  D. Schacter,et al.  Processing emotional pictures and words: Effects of valence and arousal , 2006, Cognitive, affective & behavioral neuroscience.

[42]  P. Philippot Inducing and assessing differentiated emotion-feeling states in the laboratory. , 1993, Cognition & emotion.

[43]  Timothy S. Coalson,et al.  Parcellations and hemispheric asymmetries of human cerebral cortex analyzed on surface-based atlases. , 2012, Cerebral cortex.

[44]  Forrest Gump Portrayed emotions in the movie " , 2017 .

[45]  Jouko Lampinen,et al.  Stimulus-Related Independent Component and Voxel-Wise Analysis of Human Brain Activity during Free Viewing of a Feature Film , 2012, PloS one.

[46]  Matthew D. Lieberman,et al.  The neural components of empathy: predicting daily prosocial behavior. , 2014, Social cognitive and affective neuroscience.

[47]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[48]  Jack L. Gallant,et al.  Pyrcca: Regularized Kernel Canonical Correlation Analysis in Python and Its Applications to Neuroimaging , 2015, Front. Neuroinform..

[49]  Bruce Fischl,et al.  Within-subject template estimation for unbiased longitudinal image analysis , 2012, NeuroImage.

[50]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[51]  Kristen A. Lindquist,et al.  A functional architecture of the human brain: emerging insights from the science of emotion , 2012, Trends in Cognitive Sciences.

[52]  Jesper Andersson,et al.  A multi-modal parcellation of human cerebral cortex , 2016, Nature.

[53]  J. Gross,et al.  Emotion elicitation using films , 1995 .

[54]  B. P. Klein,et al.  Topographic Representation of Numerosity in the Human Parietal Cortex , 2013, Science.

[55]  W. K. Simmons,et al.  Circular analysis in systems neuroscience: the dangers of double dipping , 2009, Nature Neuroscience.

[56]  Emiliano Ricciardi,et al.  Modality-independent encoding of individual concepts in the left parietal cortex , 2017, Neuropsychologia.

[57]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[58]  Michael Hanke,et al.  A studyforrest extension, simultaneous fMRI and eye gaze recordings during prolonged natural stimulation , 2016, Scientific Data.

[59]  Ajay B. Satpute,et al.  The Brain Basis of Positive and Negative Affect: Evidence from a Meta-Analysis of the Human Neuroimaging Literature. , 2016, Cerebral cortex.

[60]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[61]  Michael Hanke,et al.  Portrayed emotions in the movie "Forrest Gump" , 2015, F1000Research.

[62]  Philip A. Kragel,et al.  Multivariate neural biomarkers of emotional states are categorically distinct. , 2015, Social cognitive and affective neuroscience.

[63]  Alan S. Cowen,et al.  Self-report captures 27 distinct categories of emotion bridged by continuous gradients , 2017, Proceedings of the National Academy of Sciences.

[64]  Chad L. Stephens,et al.  Autonomic specificity of basic emotions: Evidence from pattern classification and cluster analysis , 2010, Biological Psychology.

[65]  A. Schaefer,et al.  Assessing the effectiveness of a large database of emotion-eliciting films: A new tool for emotion researchers , 2010 .

[66]  M. Taquet,et al.  Emotions in Everyday Life , 2015, PloS one.

[67]  A. Dale,et al.  Cortical Surface-Based Analysis II: Inflation, Flattening, and a Surface-Based Coordinate System , 1999, NeuroImage.

[68]  Matteo Bianchi,et al.  A synergy-based hand control is encoded in human motor cortical areas , 2016, eLife.

[69]  Julia M. Huntenburg,et al.  Large-Scale Gradients in Human Cortical Organization , 2018, Trends in Cognitive Sciences.

[70]  M. Sams,et al.  Distributed affective space represents multiple emotion categories across the human brain , 2018, Social cognitive and affective neuroscience.

[71]  P. Lang The emotion probe. Studies of motivation and attention. , 1995, The American psychologist.

[72]  M. Just,et al.  Identifying Emotions on the Basis of Neural Activation , 2013, PloS one.

[73]  Koen V. Haak,et al.  Connectopic mapping with resting-state fMRI , 2016, NeuroImage.

[74]  Brian A. Wandell,et al.  Population receptive field estimates in human visual cortex , 2008, NeuroImage.

[75]  Philip A. Kragel,et al.  Decoding the Nature of Emotion in the Brain , 2016, Trends in Cognitive Sciences.

[76]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[77]  R Walker,et al.  Cultural differences in emotions: a context for interpreting emotional experiences. , 2003, Behaviour research and therapy.

[78]  Emiliano Ricciardi,et al.  Foreground-Background Segmentation Revealed during Natural Image Viewing , 2017, eNeuro.

[79]  Simone G. Shamay-Tsoory,et al.  Dissociable prefrontal networks for cognitive and affective theory of mind: A lesion study , 2007, Neuropsychologia.

[80]  Murray Smith Engaging Characters: Fiction, Emotion, and the Cinema , 1995 .

[81]  C. Almli,et al.  Unbiased nonlinear average age-appropriate brain templates from birth to adulthood , 2009, NeuroImage.

[82]  L. F. Barrett,et al.  Multivoxel Pattern Analysis Does Not Provide Evidence to Support the Existence of Basic Emotions. , 2016, Cerebral cortex.

[83]  R. Hari,et al.  Emotions promote social interaction by synchronizing brain activity across individuals , 2012, Proceedings of the National Academy of Sciences.

[84]  P. Vink,et al.  Pleasure, Arousal, Dominance: Mehrabian and Russell revisited , 2014, Current Psychology.

[85]  P. Ekman An argument for basic emotions , 1992 .

[86]  Matthew D. Lieberman,et al.  The role of automaticity and attention in neural processes underlying empathy for happiness, sadness, and anxiety , 2013, Front. Hum. Neurosci..

[87]  N. Rinehart,et al.  Noninvasive stimulation of the temporoparietal junction: A systematic review , 2015, Neuroscience & Biobehavioral Reviews.

[88]  D. Pollen,et al.  Spatial and temporal frequency selectivity of neurones in visual cortical areas V1 and V2 of the macaque monkey. , 1985, The Journal of physiology.

[89]  J. M. Carroll,et al.  On the bipolarity of positive and negative affect. , 1999, Psychological bulletin.

[90]  Mara Mather,et al.  Emotional Arousal Can Impair Feature Binding in Working Memory , 2006, Journal of Cognitive Neuroscience.

[91]  Lisa Feldman Barrett,et al.  The Structure of Emotion , 2006 .

[92]  Katherine Vytal,et al.  Neuroimaging Support for Discrete Neural Correlates of Basic Emotions: A Voxel-based Meta-analysis , 2010, Journal of Cognitive Neuroscience.

[93]  Yaroslav O. Halchenko,et al.  The Animacy Continuum in the Human Ventral Vision Pathway , 2015, Journal of Cognitive Neuroscience.

[94]  R. Saxe,et al.  Development of the social brain from age three to twelve years , 2018, Nature Communications.

[95]  Peter Totterdell,et al.  Eliciting mixed emotions: a meta-analysis comparing models, types, and measures , 2015, Front. Psychol..

[96]  James A. Russell,et al.  Mixed Emotions Viewed from the Psychological Constructionist Perspective , 2017 .

[97]  What can neuroimaging meta-analyses really tell us about the nature of emotion? , 2012, Behavioral and Brain Sciences.

[98]  L. Phillips,et al.  The overlapping relationship between emotion perception and theory of mind , 2015, Neuropsychologia.

[99]  T. Shallice,et al.  Impact of brain tumour location on emotion and personality: a voxel-based lesion-symptom mapping study on mentalization processes. , 2014, Brain : a journal of neurology.

[100]  J. Gallant,et al.  Identifying natural images from human brain activity , 2008, Nature.

[101]  T. Singer,et al.  The empathic brain: how, when and why? , 2006, Trends in Cognitive Sciences.

[102]  J. Russell,et al.  An approach to environmental psychology , 1974 .

[103]  Thomas L. Griffiths,et al.  Supplementary Information for Natural Speech Reveals the Semantic Maps That Tile Human Cerebral Cortex , 2022 .