Coding of Event Nodes and Narrative Context in the Hippocampus

Narratives may provide a general context, unrestricted by space and time, which can be used to organize episodic memories into networks of related events. However, it is not clear how narrative contexts are represented in the brain. Here we test the novel hypothesis that the formation of narrative-based contextual representations in humans relies on the same hippocampal mechanisms that enable formation of spatiotemporal contexts in rodents. Participants watched a movie consisting of two interleaved narratives while we monitored their brain activity using fMRI. We used representational similarity analysis, a type of multivariate pattern analysis, which uses across-voxel correlations as a proxy for neural-pattern similarity, to examine whether the patterns of neural activity can be used to differentiate between narratives and recurring narrative elements, such as people and locations. We demonstrate that the neural activity patterns in the hippocampus differentiate between event nodes (people and locations) and narratives (different stories) and that these narrative-context representations diverge gradually over time akin to remapping-induced spatial maps represented by rodent place cells. SIGNIFICANCE STATEMENT Narratives, especially in movie format, are very engaging and can be used to investigate neural mechanisms underlying cognitive functions in more naturalistic settings than that of traditional paradigms. Narratives also provide a more general context, unrestricted by space and time, that can be used to organize memories into networks of related events. For this reason, narratives are ideally suited to engage neural mechanisms underlying episodic memory formation. In this study, participants watched a movie with two interleaved narratives while their brain activity was monitored using fMRI. We show that the hippocampus, which is involved in formation of spatiotemporal contexts in episodic memory, also represents gradually diverging narrative contexts as well as narrative elements, such as people and locations.

[1]  Blake S. Porter,et al.  Hippocampal Representation of Related and Opposing Memories Develop within Distinct, Hierarchically Organized Neural Schemas , 2014, Neuron.

[2]  R. Henson,et al.  Memory signals are temporally dissociated within and across human hippocampus and perirhinal cortex , 2012, Nature Neuroscience.

[3]  Neil Burgess,et al.  Attractor Dynamics in the Hippocampal Representation of the Local Environment , 2005, Science.

[4]  Juan Antonio Hernández Tamames,et al.  Brain activation in discourse comprehension: A 3t fMRI study , 2008, NeuroImage.

[5]  R. Nathan Spreng,et al.  The Common Neural Basis of Autobiographical Memory, Prospection, Navigation, Theory of Mind, and the Default Mode: A Quantitative Meta-analysis , 2009, Journal of Cognitive Neuroscience.

[6]  C. Honey,et al.  Topographic Mapping of a Hierarchy of Temporal Receptive Windows Using a Narrated Story , 2011, The Journal of Neuroscience.

[7]  Charan Ranganath,et al.  Medial Temporal Lobe Coding of Item and Spatial Information during Relational Binding in Working Memory , 2014, The Journal of Neuroscience.

[8]  Nikolaus Kriegeskorte,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[9]  N. Turk-Browne,et al.  Attention promotes episodic encoding by stabilizing hippocampal representations , 2016, Proceedings of the National Academy of Sciences.

[10]  K. Duncan,et al.  Memory’s Penumbra: Episodic Memory Decisions Induce Lingering Mnemonic Biases , 2012, Science.

[11]  G. Raposo,et al.  BLOC-1 Brings Together the Actin and Microtubule Cytoskeletons to Generate Recycling Endosomes , 2016, Current Biology.

[12]  Abraham Z. Snyder,et al.  Spurious but systematic correlations in functional connectivity MRI networks arise from subject motion , 2012, NeuroImage.

[13]  Stephen M. Smith,et al.  Threshold-free cluster enhancement: Addressing problems of smoothing, threshold dependence and localisation in cluster inference , 2009, NeuroImage.

[14]  M. Corballis Wandering tales: evolutionary origins of mental time travel and language , 2013, Front. Psychol..

[15]  Thomas J. Wills,et al.  Long-term plasticity in hippocampal place-cell representation of environmental geometry , 2002, Nature.

[16]  B. Staresina,et al.  Mind the Gap: Binding Experiences across Space and Time in the Human Hippocampus , 2009, Neuron.

[17]  N. Burgess,et al.  Evidence for holistic episodic recollection via hippocampal pattern completion , 2015, Nature Communications.

[18]  Karl J. Friston,et al.  Modelling Geometric Deformations in Epi Time Series , 2022 .

[19]  D. Kumaran,et al.  The Dynamics of Hippocampal Activation during Encoding of Overlapping Sequences , 2006, Neuron.

[20]  C. Honey,et al.  Hierarchical process memory: memory as an integral component of information processing , 2015, Trends in Cognitive Sciences.

[21]  M. Moser,et al.  Understanding memory through hippocampal remapping , 2008, Trends in Neurosciences.

[22]  Christian F. Doeller,et al.  Insight Reconfigures Hippocampal-Prefrontal Memories , 2015, Current Biology.

[23]  R. Passingham The hippocampus as a cognitive map J. O'Keefe & L. Nadel, Oxford University Press, Oxford (1978). 570 pp., £25.00 , 1979, Neuroscience.

[24]  Christian F. Doeller,et al.  Memory hierarchies map onto the hippocampal long axis in humans , 2015, Nature Neuroscience.

[25]  H. Eichenbaum Time cells in the hippocampus: a new dimension for mapping memories , 2014, Nature Reviews Neuroscience.

[26]  D. Schacter,et al.  Remembering the past to imagine the future: the prospective brain , 2007, Nature Reviews Neuroscience.

[27]  Marc W. Howard,et al.  A distributed representation of temporal context , 2002 .

[28]  D. Shohamy,et al.  Integrating Memories in the Human Brain: Hippocampal-Midbrain Encoding of Overlapping Events , 2008, Neuron.

[29]  L. Davachi Item, context and relational episodic encoding in humans , 2006, Current Opinion in Neurobiology.

[30]  Arne D. Ekstrom,et al.  Complementary Roles of Human Hippocampal Subregions during Retrieval of Spatiotemporal Context , 2014, The Journal of Neuroscience.

[31]  R. Muller,et al.  The effects of changes in the environment on the spatial firing of hippocampal complex-spike cells , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[32]  Christian F. Doeller,et al.  Evidence for grid cells in a human memory network , 2010, Nature.

[33]  Lila Davachi,et al.  Similarity Breeds Proximity: Pattern Similarity within and across Contexts Is Related to Later Mnemonic Judgments of Temporal Proximity , 2014, Neuron.

[34]  H. Eichenbaum,et al.  From Conditioning to Conscious Recollection , 2001 .

[35]  A. Ishai,et al.  Recollection- and Familiarity-Based Decisions Reflect Memory Strength , 2008, Frontiers in systems neuroscience.

[36]  P. Yger,et al.  An Optimized Blockwise Non Local Means Denoising Filter for 3D Magnetic Resonance Images , 2007 .

[37]  Emilio Kropff,et al.  Place cells, grid cells, and the brain's spatial representation system. , 2008, Annual review of neuroscience.

[38]  Matthias J. Gruber,et al.  Hippocampal Activity Patterns Carry Information about Objects in Temporal Context , 2014, Neuron.

[39]  C. Stark,et al.  Pattern Separation in the Human Hippocampal CA3 and Dentate Gyrus , 2008, Science.

[40]  D. Kumaran,et al.  The Emergence and Representation of Knowledge about Social and Nonsocial Hierarchies , 2012, Neuron.

[41]  Jack L. Gallant,et al.  A Continuous Semantic Space Describes the Representation of Thousands of Object and Action Categories across the Human Brain , 2012, Neuron.

[42]  Neil Burgess,et al.  Hippocampal Attractor Dynamics Predict Memory-Based Decision Making , 2016, Current Biology.

[43]  Karl J. Friston,et al.  Unified segmentation , 2005, NeuroImage.

[44]  E. Maguire,et al.  The Human Hippocampus and Spatial and Episodic Memory , 2002, Neuron.

[45]  Evelyn C. Ferstl,et al.  The extended language network: A meta‐analysis of neuroimaging studies on text comprehension , 2008, Human brain mapping.

[46]  Dagmar Zeithamova,et al.  Hippocampal and Ventral Medial Prefrontal Activation during Retrieval-Mediated Learning Supports Novel Inference , 2012, Neuron.

[47]  H. Eichenbaum,et al.  Can We Reconcile the Declarative Memory and Spatial Navigation Views on Hippocampal Function? , 2014, Neuron.

[48]  Christian F. Doeller,et al.  Parallel striatal and hippocampal systems for landmarks and boundaries in spatial memory , 2008, Proceedings of the National Academy of Sciences.

[49]  B. McNaughton,et al.  Hippocampal synaptic enhancement and information storage within a distributed memory system , 1987, Trends in Neurosciences.

[50]  Pierrick Coupé,et al.  An Optimized Blockwise Nonlocal Means Denoising Filter for 3-D Magnetic Resonance Images , 2008, IEEE Transactions on Medical Imaging.

[51]  Rhodri Cusack,et al.  Automatic analysis (aa): efficient neuroimaging workflows and parallel processing using Matlab and XML , 2015, Front. Neuroinform..

[52]  D. Hassabis,et al.  Decoding Individual Episodic Memory Traces in the Human Hippocampus , 2010, Current Biology.

[53]  Margaret L. Schlichting,et al.  Learning-related representational changes reveal dissociable integration and separation signatures in the hippocampus and prefrontal cortex , 2015, Nature Communications.

[54]  S. Zeki,et al.  Functional brain mapping during free viewing of natural scenes , 2004, Human brain mapping.

[55]  N. Turk-Browne,et al.  Mechanisms for widespread hippocampal involvement in cognition. , 2013, Journal of experimental psychology. General.

[56]  M. Conway,et al.  The construction of autobiographical memories in the self-memory system. , 2000, Psychological review.

[57]  Lawrence L. Wald,et al.  Three dimensional echo-planar imaging at 7 Tesla , 2010, NeuroImage.

[58]  Tobias Kober,et al.  MP2RAGE, a self bias-field corrected sequence for improved segmentation and T1-mapping at high field , 2010, NeuroImage.

[59]  L. Davachi,et al.  Enhanced Intersubject Correlations during Movie Viewing Correlate with Successful Episodic Encoding , 2008, Neuron.

[60]  H. Eichenbaum,et al.  The Hippocampus, Memory, and Place Cells Is It Spatial Memory or a Memory Space? , 1999, Neuron.

[61]  Ivan Toni,et al.  Perceptuo-Motor Interactions during Prehension Movements , 2008, The Journal of Neuroscience.

[62]  Christian F. Doeller,et al.  Journal of Experimental Psychology : General Mnemonic Networks in the Hippocampal Formation : From Spatial Maps to Temporal and Conceptual Codes , 2013 .

[63]  H. Eichenbaum,et al.  The medial temporal lobe and recognition memory. , 2007, Annual review of neuroscience.

[64]  R. O’Reilly,et al.  Modeling hippocampal and neocortical contributions to recognition memory: a complementary-learning-systems approach. , 2003, Psychological review.

[65]  Tobias Navarro Schröder,et al.  An event map of memory space in the hippocampus , 2016, eLife.

[66]  Roel M. Willems,et al.  Simulating Fiction: Individual Differences in Literature Comprehension Revealed with fMRI , 2015, PloS one.

[67]  C. Stark,et al.  Pattern separation in the hippocampus , 2011, Trends in Neurosciences.

[68]  G. Buzsáki,et al.  Memory, navigation and theta rhythm in the hippocampal-entorhinal system , 2013, Nature Neuroscience.

[69]  Nikolai Axmacher,et al.  Human neuroimaging studies on the hippocampal CA3 region – integrating evidence for pattern separation and completion , 2014, Front. Cell. Neurosci..