Relating the Past with the Present: Information Integration and Segregation during Ongoing Narrative Processing

Abstract This study examined how the brain dynamically updates event representations by integrating new information over multiple minutes while segregating irrelevant input. A professional writer custom-designed a narrative with two independent storylines, interleaving across minute-long segments (ABAB). In the last (C) part, characters from the two storylines meet and their shared history is revealed. Part C is designed to induce the spontaneous recall of past events, upon the recurrence of narrative motifs from A/B, and to shed new light on them. Our fMRI results showed storyline-specific neural patterns, which were reinstated (i.e., became more active) during storyline transitions. This effect increased along the processing timescale hierarchy, peaking in the default mode network. Similarly, the neural reinstatement of motifs was found during Part C. Furthermore, participants showing stronger motif reinstatement performed better in integrating A/B and C events, demonstrating the role of memory reactivation in information integration over intervening irrelevant events.

[1]  B. Staresina,et al.  Mind the Gap: Binding Experiences across Space and Time in the Human Hippocampus , 2009, Neuron.

[2]  Earl K. Miller,et al.  Working Memory 2.0 , 2018, Neuron.

[3]  Xenophon Papademetris,et al.  Groupwise whole-brain parcellation from resting-state fMRI data for network node identification , 2013, NeuroImage.

[4]  Anjan Chatterjee,et al.  Visual Working Memory Is Impaired when the Medial Temporal Lobe Is Damaged , 2006, Journal of Cognitive Neuroscience.

[5]  Uri Hasson,et al.  Amplification of local changes along the timescale processing hierarchy , 2017, Proceedings of the National Academy of Sciences.

[6]  I. Olson,et al.  The medial temporal lobe and visual working memory: Comparisons across tasks, delays, and visual similarity , 2008, Cognitive, affective & behavioral neuroscience.

[7]  C. Honey,et al.  Hierarchical process memory: memory as an integral component of information processing , 2015, Trends in Cognitive Sciences.

[8]  Morris Moscovitch,et al.  Multiple Scales of Representation along the Hippocampal Anteroposterior Axis in Humans , 2018, Current Biology.

[9]  Janne Kauttonen,et al.  Brain mechanisms underlying cue-based memorizing during free viewing of movie Memento , 2018, NeuroImage.

[10]  Buddhika Bellana,et al.  What can narratives tell us about the neural bases of human memory? , 2020, Current Opinion in Behavioral Sciences.

[11]  Yadin Dudai,et al.  Constructing Realistic Engrams: Poststimulus Activity of Hippocampus and Dorsal Striatum Predicts Subsequent Episodic Memory , 2011, The Journal of Neuroscience.

[12]  Dagmar Zeithamova,et al.  Hippocampal and Ventral Medial Prefrontal Activation during Retrieval-Mediated Learning Supports Novel Inference , 2012, Neuron.

[13]  D. Heeger,et al.  Slow Cortical Dynamics and the Accumulation of Information over Long Timescales , 2012, Neuron.

[14]  D. Shohamy,et al.  Integrating Memories in the Human Brain: Hippocampal-Midbrain Encoding of Overlapping Events , 2008, Neuron.

[15]  Christopher J. Honey,et al.  Constructing and Forgetting Temporal Context in the Human Cerebral Cortex , 2020, Neuron.

[16]  Margaret L. Schlichting,et al.  Memory integration: neural mechanisms and implications for behavior , 2015, Current Opinion in Behavioral Sciences.

[17]  Mikko Sams,et al.  Neural mechanisms for integrating consecutive and interleaved natural events , 2017, Human brain mapping.

[18]  Deborah E. Hannula,et al.  The Eyes Have It: Hippocampal Activity Predicts Expression of Memory in Eye Movements , 2009, Neuron.

[19]  A. Baddeley Working memory: looking back and looking forward , 2003, Nature Reviews Neuroscience.

[20]  Jonathan W. Pillow,et al.  Discovering Event Structure in Continuous Narrative Perception and Memory , 2016, Neuron.

[21]  Po-Hsuan Chen,et al.  A Reduced-Dimension fMRI Shared Response Model , 2015, NIPS.

[22]  Roel M. Willems,et al.  Narratives for Neuroscience , 2020, Trends in Neurosciences.

[23]  Yuan Chang Leong,et al.  Shared memories reveal shared structure in neural activity across individuals , 2016, Nature Neuroscience.

[24]  S. Funahashi,et al.  Neural mechanisms of dual-task interference and cognitive capacity limitation in the prefrontal cortex , 2014, Nature Neuroscience.

[25]  Kevin Murphy,et al.  The impact of global signal regression on resting state correlations: Are anti-correlated networks introduced? , 2009, NeuroImage.

[26]  Lluís Fuentemilla,et al.  Event conjunction: How the hippocampus integrates episodic memories across event boundaries , 2019, Hippocampus.

[27]  Elkan G. Akyürek,et al.  Dynamic hidden states underlying working memory guided behaviour , 2017, Nature Neuroscience.

[28]  Christian F. Doeller,et al.  Memory hierarchies map onto the hippocampal long axis in humans , 2015, Nature Neuroscience.

[29]  C. Honey,et al.  Topographic Mapping of a Hierarchy of Temporal Receptive Windows Using a Narrated Story , 2011, The Journal of Neuroscience.

[30]  Nikolaus Kriegeskorte,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[31]  A. Yonelinas,et al.  Visual working memory impairments for single items following medial temporal lobe damage , 2019, Neuropsychologia.

[32]  Michael Breakspear,et al.  Naturalistic Stimuli in Neuroscience: Critically Acclaimed , 2019, Trends in Cognitive Sciences.

[33]  Uri Hasson,et al.  Not Lost in Translation: Neural Responses Shared Across Languages , 2012, The Journal of Neuroscience.

[34]  Christian F. Doeller,et al.  Hippocampal-Prefrontal Theta Oscillations Support Memory Integration , 2016, Current Biology.

[35]  W. Maass,et al.  State-dependent computations: spatiotemporal processing in cortical networks , 2009, Nature Reviews Neuroscience.

[36]  I. Johnsrude,et al.  The problem of functional localization in the human brain , 2002, Nature Reviews Neuroscience.

[37]  Edward F. Ester,et al.  Restoring Latent Visual Working Memory Representations in Human Cortex , 2016, Neuron.

[38]  Uri Hasson,et al.  Same Story, Different Story , 2017, Psychological science.

[39]  Yael Niv,et al.  Does mental context drift or shift? , 2017, Current Opinion in Behavioral Sciences.

[40]  Jeffrey M. Zacks,et al.  Human brain activity time-locked to perceptual event boundaries , 2001, Nature Neuroscience.

[41]  Janice Chen,et al.  Dynamic reconfiguration of the default mode network during narrative comprehension , 2016, Nature Communications.

[42]  Christian F. Doeller,et al.  Coding of Event Nodes and Narrative Context in the Hippocampus , 2016, The Journal of Neuroscience.

[43]  Dagmar Zeithamova,et al.  Flexible Memories: Differential Roles for Medial Temporal Lobe and Prefrontal Cortex in Cross-Episode Binding , 2010, The Journal of Neuroscience.

[44]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[45]  G L Shulman,et al.  INAUGURAL ARTICLE by a Recently Elected Academy Member:A default mode of brain function , 2001 .

[46]  Nikolaus Kriegeskorte,et al.  Mind the drift - improving sensitivity to fMRI pattern information by accounting for temporal pattern drift , 2015, bioRxiv.

[47]  M J Arcaro,et al.  Accessing Real-Life Episodic Information from Minutes versus Hours Earlier Modulates Hippocampal and High-Order Cortical Dynamics. , 2016, Cerebral cortex.

[48]  Margaret L. Schlichting,et al.  The hippocampus and inferential reasoning: building memories to navigate future decisions , 2012, Front. Hum. Neurosci..

[49]  M. Tsodyks,et al.  Synaptic Theory of Working Memory , 2008, Science.

[50]  D. Schacter,et al.  The Brain's Default Network , 2008, Annals of the New York Academy of Sciences.

[51]  L. Davachi,et al.  Transcending time in the brain: How event memories are constructed from experience , 2019, Hippocampus.

[52]  W. Regehr,et al.  Short-term synaptic plasticity. , 2002, Annual review of physiology.

[53]  Alison R Preston,et al.  Memory integration constructs maps of space, time, and concepts , 2017, Current Opinion in Behavioral Sciences.

[54]  Kenneth A. Norman,et al.  Representation of Real-World Event Schemas during Narrative Perception , 2018, The Journal of Neuroscience.

[55]  Ken Nakayama,et al.  The consequences of subtracting the mean pattern in fMRI multivariate correlation analyses , 2013, Front. Neurosci..

[56]  Margaret L. Schlichting,et al.  Hippocampal–medial prefrontal circuit supports memory updating during learning and post-encoding rest , 2016, Neurobiology of Learning and Memory.

[57]  Jeffrey M. Zacks,et al.  Event Segmentation , 2007, Current directions in psychological science.

[58]  N. Cowan What are the differences between long-term, short-term, and working memory? , 2008, Progress in brain research.

[59]  Yuan Chang Leong,et al.  How We Transmit Memories to Other Brains: Constructing Shared Neural Representations Via Communication , 2016, bioRxiv.

[60]  Bryan R. Conroy,et al.  Function-based Intersubject Alignment of Human Cortical Anatomy , 2009, Cerebral cortex.

[61]  M. Stokes ‘Activity-silent’ working memory in prefrontal cortex: a dynamic coding framework , 2015, Trends in Cognitive Sciences.

[62]  Adam C. Riggall,et al.  Reactivation of latent working memories with transcranial magnetic stimulation , 2016, Science.

[63]  Margaret L. Schlichting,et al.  Hippocampal representations as a function of time, subregion, and brain state , 2018, Neurobiology of Learning and Memory.

[64]  Russell A. Poldrack,et al.  The impact of study design on pattern estimation for single-trial multivariate pattern analysis , 2014, NeuroImage.

[65]  L. Davachi,et al.  What Constitutes an Episode in Episodic Memory? , 2011, Psychological science.