Shared understanding of narratives is correlated with shared neural responses

&NA; Humans have a striking ability to infer meaning from even the sparsest and most abstract forms of narratives. At the same time, flexibility in the form of a narrative is matched by inherent ambiguity in its interpretation. How does the brain represent subtle, idiosyncratic differences in the interpretation of abstract and ambiguous narratives? In this fMRI study, subjects were scanned either watching a novel 7‐min animation depicting a complex narrative through the movement of geometric shapes, or listening to a narration of the animation's social story. Using an intersubject representational similarity analysis that compared interpretation similarity and neural similarity across subjects, we found that the more similar two people's interpretations of the abstract shapes animation were, the more similar were their neural responses in regions of the default mode network (DMN) and fronto‐parietal network. Moreover, these shared responses were modality invariant: the shapes movie and the verbal interpretation of the movie elicited shared responses in linguistic areas and a subset of the DMN when subjects shared interpretations. Together, these results suggest a network of high‐level regions that are not only sensitive to subtle individual differences in narrative interpretation during naturalistic conditions, but also resilient to large differences in the modality of the narrative. HighlightsShared narrative interpretation is correlated with neural similarity in DMN and FCPN.Neural responses in DMN depend on shared interpretation, not stimulus modality.Intersubject representation similarity analysis can detect individual differences.

[1]  D. Heeger,et al.  Reliability of cortical activity during natural stimulation , 2010, Trends in Cognitive Sciences.

[2]  Jussi Tohka,et al.  How Many Is Enough? Effect of Sample Size in Inter-Subject Correlation Analysis of fMRI , 2016, Comput. Intell. Neurosci..

[3]  Elizabeth Jefferies,et al.  Situating the default-mode network along a principal gradient of macroscale cortical organization , 2016, Proceedings of the National Academy of Sciences.

[4]  Yuan Chang Leong,et al.  Shared memories reveal shared structure in neural activity across individuals , 2016, Nature Neuroscience.

[5]  Patrick F. Reidy An Introduction to Latent Semantic Analysis , 2009 .

[6]  Michael W. Cole,et al.  Heterogeneity within the frontoparietal control network and its relationship to the default and dorsal attention networks , 2017, Proceedings of the National Academy of Sciences.

[7]  B. Levine,et al.  The functional neuroanatomy of autobiographical memory: A meta-analysis , 2006, Neuropsychologia.

[8]  K H Nuechterlein,et al.  Disturbances in the spontaneous attribution of social meaning in schizophrenia , 2008, Psychological Medicine.

[9]  Stephen J. Misovich,et al.  Effects of Disruption of Structure and Motion on Perceptions of Social Causality , 1992 .

[10]  Bernard Mazoyer,et al.  Impact of modality and linguistic complexity during reading and listening tasks , 2007, NeuroImage.

[11]  D. Heeger,et al.  A Hierarchy of Temporal Receptive Windows in Human Cortex , 2008, The Journal of Neuroscience.

[12]  C. Frith,et al.  Autism, Asperger syndrome and brain mechanisms for the attribution of mental states to animated shapes. , 2002, Brain : a journal of neurology.

[13]  C. Honey,et al.  Topographic Mapping of a Hierarchy of Temporal Receptive Windows Using a Narrated Story , 2011, The Journal of Neuroscience.

[14]  M. Greicius,et al.  Decoding subject-driven cognitive states with whole-brain connectivity patterns. , 2012, Cerebral cortex.

[15]  F. Pollick,et al.  Exploring collective experience in watching dance through intersubject correlation and functional connectivity of fMRI brain activity. , 2018, Progress in brain research.

[16]  S. Scott,et al.  Converging Language Streams in the Human Temporal Lobe , 2006, The Journal of Neuroscience.

[17]  Yuan Chang Leong,et al.  How We Transmit Memories to Other Brains: Constructing Shared Neural Representations Via Communication , 2016, bioRxiv.

[18]  Daniel L. Schacter,et al.  Intrinsic Architecture Underlying the Relations among the Default, Dorsal Attention, and Frontoparietal Control Networks of the Human Brain , 2013, Journal of Cognitive Neuroscience.

[19]  S. Garrod,et al.  Brain-to-brain coupling: a mechanism for creating and sharing a social world , 2012, Trends in Cognitive Sciences.

[20]  B. Wexler,et al.  Social attribution test — multiple choice (SAT-MC) in schizophrenia: Comparison with community sample and relationship to neurocognitive, social cognitive and symptom measures , 2010, Schizophrenia Research.

[21]  Robert Lindenberg,et al.  Supramodal language comprehension: Role of the left temporal lobe for listening and reading , 2007, Neuropsychologia.

[22]  P. Dupont,et al.  Similarity of fMRI Activity Patterns in Left Perirhinal Cortex Reflects Semantic Similarity between Words , 2013, The Journal of Neuroscience.

[23]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[24]  Istvan Molnar-Szakacs,et al.  Beyond superior temporal cortex: intersubject correlations in narrative speech comprehension. , 2008, Cerebral cortex.

[25]  R. Malach,et al.  Intersubject Synchronization of Cortical Activity During Natural Vision , 2004, Science.

[26]  M. Sams,et al.  Inter-Subject Synchronization of Prefrontal Cortex Hemodynamic Activity During Natural Viewing , 2008, The open neuroimaging journal.

[27]  G. Fink,et al.  Minds at rest? Social cognition as the default mode of cognizing and its putative relationship to the “default system” of the brain , 2008, Consciousness and Cognition.

[28]  J. Andrews-Hanna,et al.  The brain's default network: Anatomy, function, and consequence of disruption , 2009 .

[29]  Thomas E. Nichols,et al.  Nonparametric permutation tests for functional neuroimaging: A primer with examples , 2002, Human brain mapping.

[30]  Uri Hasson,et al.  Engaged listeners: shared neural processing of powerful political speeches. , 2015, Social cognitive and affective neuroscience.

[31]  Stephen M. Smith,et al.  Brain network dynamics are hierarchically organized in time , 2017, Proceedings of the National Academy of Sciences.

[32]  Robert T. Schultz,et al.  Self, mother and abstract other: An fMRI study of reflective social processing , 2008, NeuroImage.

[33]  Rebecca Saxe,et al.  Contributions of episodic retrieval and mentalizing to autobiographical thought: Evidence from functional neuroimaging, resting-state connectivity, and fMRI meta-analyses , 2014, NeuroImage.

[34]  D. Schacter,et al.  The Brain's Default Network , 2008, Annals of the New York Academy of Sciences.

[35]  Janice Chen,et al.  Dynamic reconfiguration of the default mode network during narrative comprehension , 2016, Nature Communications.

[36]  F. Heider,et al.  An experimental study of apparent behavior , 1944 .

[37]  M. Chee,et al.  Overlap and Dissociation of Semantic Processing of Chinese Characters, English Words, and Pictures: Evidence from fMRI , 2000, NeuroImage.

[38]  Uri Hasson,et al.  Same Story, Different Story , 2017, Psychological science.

[39]  R. Nathan Spreng,et al.  The Common Neural Basis of Autobiographical Memory, Prospection, Navigation, Theory of Mind, and the Default Mode: A Quantitative Meta-analysis , 2009, Journal of Cognitive Neuroscience.

[40]  Uri Hasson,et al.  Amplification of local changes along the timescale processing hierarchy , 2017, Proceedings of the National Academy of Sciences.

[41]  Patrice D. Tremoulet,et al.  Perceptual causality and animacy , 2000, Trends in Cognitive Sciences.

[42]  Daniel L. Schacter,et al.  Default network activity, coupled with the frontoparietal control network, supports goal-directed cognition , 2010, NeuroImage.

[43]  Uri Hasson,et al.  Mirroring and beyond: coupled dynamics as a generalized framework for modelling social interactions , 2016, Philosophical Transactions of the Royal Society B: Biological Sciences.

[44]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[45]  Christopher J. Honey,et al.  Selective and Invariant Neural Responses to Spoken and Written Narratives , 2013, The Journal of Neuroscience.

[46]  Christopher J. Honey,et al.  Same Story , Different Story : The Neural Representation of Interpretive Frameworks , 2017 .

[47]  Nikolaus Kriegeskorte,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[48]  B. Sahakian,et al.  Default Mode Dynamics for Global Functional Integration , 2015, The Journal of Neuroscience.

[49]  Elizabeth Jefferies,et al.  Down but not out in posterior cingulate cortex: Deactivation yet functional coupling with prefrontal cortex during demanding semantic cognition , 2016, NeuroImage.

[50]  B. Sahakian,et al.  Angular default mode network connectivity across working memory load , 2017, Human brain mapping.

[51]  Valerie A. Carr,et al.  Spatiotemporal Dynamics of Modality-Specific and Supramodal Word Processing , 2003, Neuron.

[52]  G. Glover Deconvolution of Impulse Response in Event-Related BOLD fMRI1 , 1999, NeuroImage.

[53]  C. Honey,et al.  Hierarchical process memory: memory as an integral component of information processing , 2015, Trends in Cognitive Sciences.

[54]  Hao-Ting Wang,et al.  Varieties of semantic cognition revealed through simultaneous decomposition of intrinsic brain connectivity and behaviour , 2017, NeuroImage.

[55]  Kenneth A. Norman,et al.  Discovering Event Structure in Continuous Narrative Perception and Memory , 2016, Neuron.

[56]  D. Skuse,et al.  Can autistic children read the mind of an animated triangle? , 2008, Autism : the international journal of research and practice.

[57]  Ivan Toni,et al.  On the relationship between the “default mode network” and the “social brain” , 2012, Front. Hum. Neurosci..

[58]  Christopher J. Honey,et al.  Loss of reliable temporal structure in event-related averaging of naturalistic stimuli , 2012, NeuroImage.

[59]  J. Perner,et al.  Neuroscience and Biobehavioral Reviews Fractionating Theory of Mind: a Meta-analysis of Functional Brain Imaging Studies , 2022 .

[60]  Steven L. Small,et al.  Interpretation-mediated changes in neural activity during language comprehension , 2011, NeuroImage.

[61]  G L Shulman,et al.  INAUGURAL ARTICLE by a Recently Elected Academy Member:A default mode of brain function , 2001 .

[62]  Uri Hasson,et al.  Not Lost in Translation: Neural Responses Shared Across Languages , 2012, The Journal of Neuroscience.

[63]  M. Fox,et al.  Spontaneous fluctuations in brain activity observed with functional magnetic resonance imaging , 2007, Nature Reviews Neuroscience.

[64]  Rainer Goebel,et al.  Information-based functional brain mapping. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[65]  K. Oatley,et al.  Perception of personal and interpersonal action in a cartoon film , 1985 .

[66]  Justin L. Vincent,et al.  Evidence for a frontoparietal control system revealed by intrinsic functional connectivity. , 2008, Journal of neurophysiology.

[67]  Mikko Sams,et al.  Synchronous brain activity across individuals underlies shared psychological perspectives , 2014, NeuroImage.

[68]  Thomas E. Nichols,et al.  Nonparametric Permutation Tests for Functional Neuroimaging , 2003 .

[69]  Ajay B. Satpute,et al.  Large-scale brain networks in affective and social neuroscience: towards an integrative functional architecture of the brain , 2013, Current Opinion in Neurobiology.