How We Transmit Memories to Other Brains: Constructing Shared Neural Representations Via Communication

Abstract Humans are able to mentally construct an episode when listening to another person's recollection, even though they themselves did not experience the events. However, it is unknown how strongly the neural patterns elicited by mental construction resemble those found in the brain of the individual who experienced the original events. Using fMRI and a verbal communication task, we traced how neural patterns associated with viewing specific scenes in a movie are encoded, recalled, and then transferred to a group of naïve listeners. By comparing neural patterns across the 3 conditions, we report, for the first time, that event-specific neural patterns observed in the default mode network are shared across the encoding, recall, and construction of the same real-life episode. This study uncovers the intimate correspondences between memory encoding and event construction, and highlights the essential role our common language plays in the process of transmitting one's memories to other brains.

[1]  F. Bartlett,et al.  Remembering: A Study in Experimental and Social Psychology , 1932 .

[2]  Marcia K. Johnson,et al.  Contextual prerequisites for understanding: Some investigations of comprehension and recall , 1972 .

[3]  Morris Moscovitch,et al.  Depth of processing, retrieval cues, and uniqueness of encoding as factors in recall , 1976 .

[4]  Lynn Hasher,et al.  Is memory schematic , 1983 .

[5]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[6]  Rolf A. Zwaan,et al.  Situation models in language comprehension and memory. , 1998, Psychological bulletin.

[7]  M. Buonocore,et al.  Remembering familiar people: the posterior cingulate cortex and autobiographical memory retrieval , 2001, Neuroscience.

[8]  E A Maguire,et al.  Neuroimaging studies of autobiographical event memory. , 2001, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[9]  S. Kosslyn,et al.  Neural foundations of imagery , 2001, Nature Reviews Neuroscience.

[10]  G L Shulman,et al.  INAUGURAL ARTICLE by a Recently Elected Academy Member:A default mode of brain function , 2001 .

[11]  M. Pickering,et al.  Toward a mechanistic psychology of dialogue , 2004, Behavioral and Brain Sciences.

[12]  R. Mar The neuropsychology of narrative: story comprehension, story production and their interrelation , 2004, Neuropsychologia.

[13]  H. H. Clark,et al.  Speaking while monitoring addressees for understanding , 2004 .

[14]  Vaidehi S. Natu,et al.  Category-Specific Cortical Activity Precedes Retrieval During Memory Search , 2005, Science.

[15]  H. H. Clark Context and Common Ground , 2006 .

[16]  B. Levine,et al.  The functional neuroanatomy of autobiographical memory: A meta-analysis , 2006, Neuropsychologia.

[17]  Rainer Goebel,et al.  Information-based functional brain mapping. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Walt Detmar Meurers,et al.  Encyclopedia of Language and Linguistics , 2006 .

[19]  K. Szpunar,et al.  Neural substrates of envisioning the future , 2007, Proceedings of the National Academy of Sciences.

[20]  R. Cabeza,et al.  Functional neuroimaging of autobiographical memory , 2007, Trends in Cognitive Sciences.

[21]  D. Hassabis,et al.  Patients with hippocampal amnesia cannot imagine new experiences , 2007, Proceedings of the National Academy of Sciences.

[22]  Jeffrey M. Zacks,et al.  Event perception: a mind-brain perspective. , 2007, Psychological bulletin.

[23]  D. Hassabis,et al.  Using Imagination to Understand the Neural Basis of Episodic Memory , 2007, The Journal of Neuroscience.

[24]  R. Buckner,et al.  Self-projection and the brain , 2007, Trends in Cognitive Sciences.

[25]  Alana T. Wong,et al.  Remembering the past and imagining the future: Common and distinct neural substrates during event construction and elaboration , 2007, Neuropsychologia.

[26]  D. Schacter,et al.  Remembering the past to imagine the future: the prospective brain , 2007, Nature Reviews Neuroscience.

[27]  D. Hassabis,et al.  Deconstructing episodic memory with construction , 2007, Trends in Cognitive Sciences.

[28]  Nikolaus Kriegeskorte,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[29]  Arthur W. Toga,et al.  Construction of a 3D probabilistic atlas of human cortical structures , 2008, NeuroImage.

[30]  J. Duncan,et al.  Top-Down Activation of Shape-Specific Population Codes in Visual Cortex during Mental Imagery , 2009, The Journal of Neuroscience.

[31]  R. Nathan Spreng,et al.  The Common Neural Basis of Autobiographical Memory, Prospection, Navigation, Theory of Mind, and the Default Mode: A Quantitative Meta-analysis , 2009, Journal of Cognitive Neuroscience.

[32]  Kenneth A. Norman,et al.  Recollection, Familiarity, and Cortical Reinstatement: A Multivoxel Pattern Analysis , 2009, Neuron.

[33]  Demis Hassabis,et al.  The construction system of the brain , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[34]  William W. Graves,et al.  Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. , 2009, Cerebral cortex.

[35]  U. Hasson,et al.  Speaker–listener neural coupling underlies successful communication , 2010, Proceedings of the National Academy of Sciences.

[36]  Rutvik H. Desai,et al.  The neurobiology of semantic memory , 2011, Trends in Cognitive Sciences.

[37]  C. Ranganath,et al.  Two cortical systems for memory-guided behaviour , 2012, Nature Reviews Neuroscience.

[38]  Uri Hasson,et al.  Not Lost in Translation: Neural Responses Shared Across Languages , 2012, The Journal of Neuroscience.

[39]  M. Greicius,et al.  Decoding subject-driven cognitive states with whole-brain connectivity patterns. , 2012, Cerebral cortex.

[40]  Hervé Abdi,et al.  The Neural Basis of Vivid Memory Is Patterned on Perception , 2012, Journal of Cognitive Neuroscience.

[41]  M. Moscovitch,et al.  Episodic Memory and Event Construction in Aging and Amnesia. , 2012 .

[42]  Radoslaw Martin Cichy,et al.  Imagery and perception share cortical representations of content and location. , 2012, Cerebral Cortex.

[43]  Kaia L. Vilberg,et al.  Brain Networks Underlying Episodic Memory Retrieval This Review Comes from a Themed Issue on Macrocircuits Memory Signals within the Mtl , 2022 .

[44]  Karl J. Friston,et al.  Structural and Functional Brain Networks: From Connections to Cognition , 2013, Science.

[45]  Christopher J. Honey,et al.  Selective and Invariant Neural Responses to Spoken and Written Narratives , 2013, The Journal of Neuroscience.

[46]  Olaf Sporns,et al.  Network attributes for segregation and integration in the human brain , 2013, Current Opinion in Neurobiology.

[47]  Marcia K. Johnson,et al.  Decoding individual natural scene representations during perception and imagery , 2010, Front. Hum. Neurosci..

[48]  D. Poeppel,et al.  Coupled neural systems underlie the production and comprehension of naturalistic narrative speech , 2014, Proceedings of the National Academy of Sciences.

[49]  U. Hasson,et al.  On the Same Wavelength: Predictable Language Enhances Speaker–Listener Brain-to-Brain Synchrony in Posterior Superior Temporal Gyrus , 2014, The Journal of Neuroscience.

[50]  Hervé Abdi,et al.  Memory Reactivation in Healthy Aging: Evidence of Stimulus-Specific Dedifferentiation , 2014, The Journal of Neuroscience.

[51]  Lars Muckli,et al.  Decoding Sound and Imagery Content in Early Visual Cortex , 2014, Current Biology.

[52]  Siyuan Liu,et al.  Embodied Comprehension of Stories: Interactions between Language Regions and Modality-specific Neural Systems , 2014, Journal of Cognitive Neuroscience.

[53]  C. Honey,et al.  Hierarchical process memory: memory as an integral component of information processing , 2015, Trends in Cognitive Sciences.

[54]  Roberto Cabeza,et al.  Reinstatement of Individual Past Events Revealed by the Similarity of Distributed Activation Patterns during Encoding and Retrieval , 2015, Journal of Cognitive Neuroscience.

[55]  James L. Keidel,et al.  Consolidation of Complex Events via Reinstatement in Posterior Cingulate Cortex , 2015, The Journal of Neuroscience.

[56]  Kenneth A. Norman,et al.  Shared experience, shared memory: a common structure for brain activity during naturalistic recall , 2016, bioRxiv.

[57]  Elizabeth Jefferies,et al.  Situating the default-mode network along a principal gradient of macroscale cortical organization , 2016, Proceedings of the National Academy of Sciences.

[58]  Jonathan W. Pillow,et al.  Discovering Event Structure in Continuous Narrative Perception and Memory , 2016, Neuron.

[59]  Tomoyasu Horikawa,et al.  Generic decoding of seen and imagined objects using hierarchical visual features , 2015, Nature Communications.

[60]  Yuan Chang Leong,et al.  Shared memories reveal shared structure in neural activity across individuals , 2016, Nature Neuroscience.