Relating the past with the present: Information integration and segregation during ongoing narrative processing

This study examined how the brain dynamically updates event representations by integrating new information over multiple minutes while segregating irrelevant input. A professional writer custom-designed a narrative with two independent storylines, interleaving across minute-long segments (ABAB). In the last (C) part, characters from the two storylines meet and their shared history is revealed. Part C is designed to induce the spontaneous recall of past events, upon the recurrence of narrative motifs from A/B, and to shed new light on them. Our fMRI results showed storyline-specific neural patterns, which were reinstated (i.e. became more active) during storyline transitions. This effect increased along the processing timescale hierarchy, peaking in the default mode network. Similarly, the neural reinstatement of motifs was found during part C. Furthermore, participants showing stronger motif reinstatement performed better in integrating A/B and C events, demonstrating the role of memory reactivation in information integration over intervening irrelevant events.

[1]  Elkan G. Akyürek,et al.  Dynamic hidden states underlying working memory guided behaviour , 2017, Nature Neuroscience.

[2]  Rainer Goebel,et al.  Information-based functional brain mapping. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[3]  N. Cowan What are the differences between long-term, short-term, and working memory? , 2008, Progress in brain research.

[4]  Janice Chen,et al.  Dynamic reconfiguration of the default mode network during narrative comprehension , 2016, Nature Communications.

[5]  M J Arcaro,et al.  Accessing Real-Life Episodic Information from Minutes versus Hours Earlier Modulates Hippocampal and High-Order Cortical Dynamics. , 2016, Cerebral cortex.

[6]  Adam C. Riggall,et al.  Reactivation of latent working memories with transcranial magnetic stimulation , 2016, Science.

[7]  M. Tsodyks,et al.  Synaptic Theory of Working Memory , 2008, Science.

[8]  Earl K. Miller,et al.  Working Memory 2.0 , 2018, Neuron.

[9]  Janne Kauttonen,et al.  Brain mechanisms underlying cue-based memorizing during free viewing of movie Memento , 2018, NeuroImage.

[10]  L. Davachi,et al.  What Constitutes an Episode in Episodic Memory? , 2011, Psychological science.

[11]  D. Heeger,et al.  Slow Cortical Dynamics and the Accumulation of Information over Long Timescales , 2012, Neuron.

[12]  C. Honey,et al.  Topographic Mapping of a Hierarchy of Temporal Receptive Windows Using a Narrated Story , 2011, The Journal of Neuroscience.

[13]  W. Regehr,et al.  Short-term synaptic plasticity. , 2002, Annual review of physiology.

[14]  I. Fried,et al.  Internally Generated Reactivation of Single Neurons in Human Hippocampus During Free Recall , 2008, Science.

[15]  Kenneth A. Norman,et al.  Shared experience, shared memory: a common structure for brain activity during naturalistic recall , 2016, bioRxiv.

[16]  Christian F. Doeller,et al.  Memory hierarchies map onto the hippocampal long axis in humans , 2015, Nature Neuroscience.

[17]  Christian F. Doeller,et al.  Insight Reconfigures Hippocampal-Prefrontal Memories , 2015, Current Biology.

[18]  Alexander Borst,et al.  How does Nature Program Neuron Types? , 2008, Front. Neurosci..

[19]  W. Maass,et al.  State-dependent computations: spatiotemporal processing in cortical networks , 2009, Nature Reviews Neuroscience.

[20]  Po-Hsuan Chen,et al.  A Reduced-Dimension fMRI Shared Response Model , 2015, NIPS.

[21]  Christian F. Doeller,et al.  Coding of Event Nodes and Narrative Context in the Hippocampus , 2016, The Journal of Neuroscience.

[22]  F Manfield,et al.  Looking back and looking forward , 1992, British Dental Journal.

[23]  Yuan Chang Leong,et al.  Shared memories reveal shared structure in neural activity across individuals , 2016, Nature Neuroscience.

[24]  Jonathan W. Pillow,et al.  Discovering Event Structure in Continuous Narrative Perception and Memory , 2016, Neuron.

[25]  Russell A. Poldrack,et al.  The impact of study design on pattern estimation for single-trial multivariate pattern analysis , 2014, NeuroImage.

[26]  Christopher J. Honey,et al.  Same Story , Different Story : The Neural Representation of Interpretive Frameworks , 2017 .

[27]  Nikolaus Kriegeskorte,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[28]  Anjan Chatterjee,et al.  Visual Working Memory Is Impaired when the Medial Temporal Lobe Is Damaged , 2006, Journal of Cognitive Neuroscience.

[29]  A. Baddeley Working memory: looking back and looking forward , 2003, Nature Reviews Neuroscience.

[30]  Jeffrey M. Zacks,et al.  Human brain activity time-locked to perceptual event boundaries , 2001, Nature Neuroscience.

[31]  Celia Hoyles,et al.  Looking back and looking forward , 1992 .

[32]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[33]  Yuan Chang Leong,et al.  How We Transmit Memories to Other Brains: Constructing Shared Neural Representations Via Communication , 2016, bioRxiv.

[34]  Jeffrey M. Zacks,et al.  Event Segmentation , 2007, Current directions in psychological science.

[35]  Xenophon Papademetris,et al.  Groupwise whole-brain parcellation from resting-state fMRI data for network node identification , 2013, NeuroImage.

[36]  Mikko Sams,et al.  Neural mechanisms for integrating consecutive and interleaved natural events , 2017, Human brain mapping.

[37]  James L. Keidel,et al.  Consolidation of Complex Events via Reinstatement in Posterior Cingulate Cortex , 2015, The Journal of Neuroscience.

[38]  I. Johnsrude,et al.  The problem of functional localization in the human brain , 2002, Nature Reviews Neuroscience.

[39]  G L Shulman,et al.  INAUGURAL ARTICLE by a Recently Elected Academy Member:A default mode of brain function , 2001 .

[40]  Kenneth A. Norman,et al.  Representation of Real-World Event Schemas during Narrative Perception , 2018, The Journal of Neuroscience.

[41]  Yadin Dudai,et al.  Constructing Realistic Engrams: Poststimulus Activity of Hippocampus and Dorsal Striatum Predicts Subsequent Episodic Memory , 2011, The Journal of Neuroscience.

[42]  Christopher J. Honey,et al.  Narratives: fMRI data for evaluating models of naturalistic language comprehension , 2020, bioRxiv.

[43]  Uri Hasson,et al.  Not Lost in Translation: Neural Responses Shared Across Languages , 2012, The Journal of Neuroscience.

[44]  Edward F. Ester,et al.  Restoring Latent Visual Working Memory Representations in Human Cortex , 2016, Neuron.

[45]  C. Honey,et al.  Hierarchical process memory: memory as an integral component of information processing , 2015, Trends in Cognitive Sciences.

[46]  Ken Nakayama,et al.  The consequences of subtracting the mean pattern in fMRI multivariate correlation analyses , 2013, Front. Neurosci..

[47]  H.-Y. S. Chien,et al.  Constructing and Forgetting Temporal Context in the Human Cerebral Cortex , 2019, Neuron.

[48]  C. Stark,et al.  Pattern separation in the hippocampus , 2011, Trends in Neurosciences.

[49]  M. Stokes ‘Activity-silent’ working memory in prefrontal cortex: a dynamic coding framework , 2015, Trends in Cognitive Sciences.

[50]  S. Funahashi,et al.  Neural mechanisms of dual-task interference and cognitive capacity limitation in the prefrontal cortex , 2014, Nature Neuroscience.

[51]  I. Olson,et al.  The medial temporal lobe and visual working memory: Comparisons across tasks, delays, and visual similarity , 2008, Cognitive, affective & behavioral neuroscience.

[52]  Kevin Murphy,et al.  The impact of global signal regression on resting state correlations: Are anti-correlated networks introduced? , 2009, NeuroImage.

[53]  Bryan R. Conroy,et al.  Function-based Intersubject Alignment of Human Cortical Anatomy , 2009, Cerebral cortex.

[54]  Uri Hasson,et al.  Amplification of local changes along the timescale processing hierarchy , 2017, Proceedings of the National Academy of Sciences.

[55]  Nikolaus Kriegeskorte,et al.  Mind the drift - improving sensitivity to fMRI pattern information by accounting for temporal pattern drift , 2015, bioRxiv.

[56]  A. Yonelinas,et al.  Visual working memory impairments for single items following medial temporal lobe damage , 2019, Neuropsychologia.

[57]  Deborah E. Hannula,et al.  The Eyes Have It: Hippocampal Activity Predicts Expression of Memory in Eye Movements , 2009, Neuron.