Modeling Contextual Modulation of Memory Associations in the Hippocampus

We present a computational model of how memories can be contextually acquired and recalled in the hippocampus. Our adaptive contextual memory model comprises the lateral entorhinal cortex (LEC), the dentate gyrus (DG) and areas CA3 and CA1 in the hippocampus, and assumes external inputs about context that originate in the prefrontal cortex (PFC). Specifically, we propose that there is a top-down bias on the excitability of cells in the DG of the hippocampus that recruits a sub-population of cells to differentiate contexts, independent of experienced stimuli, expanding the “pattern separation” role typically attributed to the DG. It has been demonstrated in rats that if PFC is inactivated, both acquisition and recall of memory associations are impaired. However, PFC inactivation during acquisition of one set of memory associations surprisingly leads to subsequent facilitation of the acquisition of a conflicting set of memory associations in the same context under normal PFC operation. We provide here the first computational and algorithmic account of how the absence or presence of the top-down contextual biases on the excitability of DG cells during different learning phases of these experiments explains these data. Our model simulates PFC inactivation as the loss of inhibitory control on DG, which leads to full or partial activation of DG cells related to conflicting memory associations previously acquired in different contexts. This causes context-inappropriate memory traces to become active in the CA3 recurrent network and thereby the output CA1 area within the hippocampus. We show that these incongruous memory patterns proactively interfere with and slow the acquisition of new memory associations. Further, we demonstrate that pattern completion within CA3 in response to a partial cue for the recall of previously acquired memories is also impaired by PFC inactivation for the same reason. Pre-training the model with interfering memories in contexts different from those used in the experiments, simulating a lifetime of experiences, was crucial to reproduce the rat behavioral data. Finally, we made several testable predictions based on the model that suggest future experiments to deepen our understanding of brain-wide memory processes.

[1]  R. Henson,et al.  How schema and novelty augment memory formation , 2012, Trends in Neurosciences.

[2]  B. Zemelman,et al.  Dentate Gyrus Contributes to Retrieval as well as Encoding: Evidence from Context Fear Conditioning, Recall, and Extinction , 2017, The Journal of Neuroscience.

[3]  M. Hasselmo,et al.  Encoding and retrieval in the CA3 region of the hippocampus: a model of theta-phase separation. , 2005, Journal of neurophysiology.

[4]  James B. Aimone,et al.  Low excitatory innervation balances high intrinsic excitability of immature dentate neurons , 2016, Nature Communications.

[5]  Brian Mingus,et al.  The Emergent neural modeling system , 2008, Neural Networks.

[6]  B. McNaughton,et al.  Spatial selectivity of unit activity in the hippocampal granular layer , 1993, Hippocampus.

[7]  Randall C. O'Reilly,et al.  Theta Coordinated Error-Driven Learning in the Hippocampus , 2013, PLoS Comput. Biol..

[8]  M. Wilson,et al.  Theta Rhythms Coordinate Hippocampal–Prefrontal Interactions in a Spatial Memory Task , 2005, PLoS biology.

[9]  Michael E. Hasselmo,et al.  A Proposed Function for Hippocampal Theta Rhythm: Separate Phases of Encoding and Retrieval Enhance Reversal of Prior Learning , 2002, Neural Computation.

[10]  M. Khamassi,et al.  Replay of rule-learning related neural patterns in the prefrontal cortex during sleep , 2009, Nature Neuroscience.

[11]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[12]  Menno P. Witter,et al.  Place Cells and Place Recognition Maintained by Direct Entorhinal-Hippocampal Circuitry , 2002, Science.

[13]  Brendan E. Depue,et al.  A neuroanatomical model of prefrontal inhibitory modulation of memory retrieval , 2012, Neuroscience & Biobehavioral Reviews.

[14]  B. Underwood,et al.  Fate of first-list associations in transfer theory. , 1959, Journal of experimental psychology.

[15]  Raphael T. Gerraty,et al.  Transfer of Learning Relates to Intrinsic Connectivity between Hippocampus, Ventromedial Prefrontal Cortex, and Large-Scale Networks , 2014, The Journal of Neuroscience.

[16]  E. Miller,et al.  Frequency-specific hippocampal-prefrontal interactions during associative learning , 2015, Nature Neuroscience.

[17]  Janet Wiles,et al.  Computational Influence of Adult Neurogenesis on Memory Encoding , 2009, Neuron.

[18]  D. Hassabis,et al.  Neuroscience-Inspired Artificial Intelligence , 2017, Neuron.

[19]  W. Cowan,et al.  A study of subcortical afferents to the hippocampal formation in the rat , 1979, Neuroscience.

[20]  Joel Z. Leibo,et al.  How Important Is Weight Symmetry in Backpropagation? , 2015, AAAI.

[21]  B. McNaughton,et al.  Sparse, environmentally selective expression of Arc RNA in the upper blade of the rodent fascia dentata by brief spatial experience , 2005, Hippocampus.

[22]  E. Kandel,et al.  What is remembered? Role of attention on the encoding and retrieval of hippocampal representations , 2009, The Journal of physiology.

[23]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[24]  S. Tonegawa,et al.  Creating a False Memory in the Hippocampus , 2013, Science.

[25]  B. McNaughton,et al.  Hippocampal synaptic enhancement and information storage within a distributed memory system , 1987, Trends in Neurosciences.

[26]  P. Best,et al.  Place cells and silent cells in the hippocampus of freely-behaving rats , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[27]  Brandy Schmidt,et al.  Changes in Task Demands Alter the Pattern of zif268 Expression in the Dentate Gyrus , 2011, The Journal of Neuroscience.

[28]  Colin J. Akerman,et al.  Random synaptic feedback weights support error backpropagation for deep learning , 2016, Nature Communications.

[29]  R. Pearce,et al.  Tonic Inhibitory Control of Dentate Gyrus Granule Cells by α5-Containing GABAA Receptors Reduces Memory Interference , 2015, The Journal of Neuroscience.

[30]  R. Vertes PHA‐L analysis of projections from the supramammillary nucleus in the rat , 1992, The Journal of comparative neurology.

[31]  Fengli Jiang,et al.  Microinjection of carbachol in the supramammillary region suppresses CA1 pyramidal cell synaptic excitability , 2006, Hippocampus.

[32]  Inah Lee,et al.  Putting an object in context and acting on it: neural mechanisms of goal-directed response to contextual object , 2013, Reviews in the neurosciences.

[33]  R. O’Reilly,et al.  Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain , 2000 .

[34]  Zara M. Bergström,et al.  The University of Birmingham ( Live System ) Neural markers of inhibition in human memory retrieval , 2016 .

[35]  Yoshua Bengio,et al.  Equilibrium Propagation: Bridging the Gap between Energy-Based Models and Backpropagation , 2016, Front. Comput. Neurosci..

[36]  H. Eichenbaum,et al.  Interplay of Hippocampus and Prefrontal Cortex in Memory , 2013, Current Biology.

[37]  Mark Mayford,et al.  Selection of distinct populations of dentate granule cells in response to inputs as a mechanism for pattern separation in mice , 2013, eLife.

[38]  R. Chitwood,et al.  Dorsal and ventral hippocampal adult-born neurons contribute to context fear memory , 2018, Neuropsychopharmacology.

[39]  V. Walsh,et al.  Transcranial direct current stimulation (tDCS) of the left dorsolateral prefrontal cortex modulates declarative memory , 2012, Brain Stimulation.

[40]  Ali A. Minai,et al.  Latent Attractors: A Model for Context-Dependent Place Representations in the Hippocampus , 2000, Neural Computation.

[41]  Joseph D. Monaco,et al.  Attention Enhances the Retrieval and Stability of Visuospatial and Olfactory Representations in the Dorsal Hippocampus , 2009, PLoS biology.

[42]  D. W. In memory of ... , 1963, Science.

[43]  M. Bar Visual objects in context , 2004, Nature Reviews Neuroscience.

[44]  Brice A. Kuhl,et al.  Neural Systems Underlying the Suppression of Unwanted Memories , 2004, Science.

[45]  W E Skaggs,et al.  Interactions between location and task affect the spatial and directional firing of hippocampal neurons , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[46]  Suzanna Becker,et al.  The role of adult hippocampal neurogenesis in reducing interference. , 2012, Behavioral neuroscience.

[47]  Stephen Grossberg,et al.  Adaptive pattern classification and universal recoding: II. Feedback, expectation, olfaction, illusions , 1976, Biological Cybernetics.

[48]  T. Curran,et al.  Prefrontal Regions Orchestrate Suppression of Emotional Memories via a Two-Phase Process , 2007, Science.

[49]  B. McNaughton,et al.  Independent Codes for Spatial and Episodic Memory in Hippocampal Neuronal Ensembles , 2005, Science.

[50]  Diano F. Marrone,et al.  Disambiguating the similar: The dentate gyrus and pattern separation , 2012, Behavioural Brain Research.

[51]  D Marr,et al.  Simple memory: a theory for archicortex. , 1971, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[52]  A. Javadi,et al.  Transcranial Direct Current Stimulation (tDCS) Enhances Reconsolidation of Long-Term Memory , 2013, Brain Stimulation.

[53]  A. Treves,et al.  Distinct Ensemble Codes in Hippocampal Areas CA3 and CA1 , 2004, Science.

[54]  Anthony D Wagner,et al.  Executive Control during Episodic Retrieval Multiple Prefrontal Processes Subserve Source Memory , 2002, Neuron.

[55]  Ojas Parekh,et al.  A Combinatorial Model for Dentate Gyrus Sparse Coding , 2017, Neural Computation.

[56]  M. Wilson,et al.  Coordinated Interactions between Hippocampal Ripples and Cortical Spindles during Slow-Wave Sleep , 1998, Neuron.

[57]  D. Henze,et al.  Large amplitude miniature excitatory postsynaptic currents in hippocampal CA3 pyramidal neurons are of mossy fiber origin. , 1997, Journal of neurophysiology.

[58]  Gerd Kempermann,et al.  Experience-Induced Neurogenesis in the Senescent Dentate Gyrus , 1998, The Journal of Neuroscience.

[59]  F. H. Lopes da Silva,et al.  Reciprocal connections between the entorhinal cortex and hippocampal fields CA1 and the subiculum are in register with the projections from CA1 to the subiculum , 2001, Hippocampus.

[60]  B. McNaughton,et al.  A comparison of supramammillary and medial septal influences on hippocampal field potentials and single-unit activity. , 1989, Journal of neurophysiology.

[61]  R. O’Reilly The Division of Labor Between the Neocortex and Hippocampus , 2010 .

[62]  D. Amaral,et al.  The three-dimensional organization of the hippocampal formation: A review of anatomical data , 1989, Neuroscience.

[63]  T. Palmer,et al.  Neurogenesis in the dentate gyrus of the adult rat: age-related decrease of neuronal progenitor proliferation , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[64]  F. Gage,et al.  More hippocampal neurons in adult mice living in an enriched environment , 1997, Nature.

[65]  Howard Eichenbaum,et al.  Distinct Pathways for Rule-Based Retrieval and Spatial Mapping of Memory Representations in Hippocampal Neurons , 2013, The Journal of Neuroscience.

[66]  K. Deisseroth,et al.  Optogenetic stimulation of a hippocampal engram activates fear memory recall , 2012, Nature.

[67]  M. Quirk,et al.  Requirement for Hippocampal CA3 NMDA Receptors in Associative Memory Recall , 2002, Science.

[68]  F. Gage,et al.  Temporally selective contextual encoding in the dentate gyrus of the hippocampus , 2014, Nature Communications.

[69]  Geoffrey E. Hinton Connectionist Learning Procedures , 1989, Artif. Intell..

[70]  Beresford N. Parlett,et al.  MULTIPLE REPRESENTATIONS: , 1998, The Indescribable and the Undiscussable.

[71]  N. Burgess,et al.  Evidence for Encoding versus Retrieval Scheduling in the Hippocampus by Theta Phase and Acetylcholine , 2013, The Journal of Neuroscience.

[72]  David M. Smith,et al.  The medial prefrontal cortex is critical for memory retrieval and resolving interference. , 2013, Learning & memory.

[73]  E. Kandel,et al.  Increased Attention to Spatial Context Increases Both Place Field Stability and Spatial Memory , 2004, Neuron.

[74]  O. Stork,et al.  HIPP neurons in the dentate gyrus mediate the cholinergic modulation of background context memory salience , 2017, Nature Communications.

[75]  J. Canales,et al.  The hippocampal dentate gyrus is essential for generating contextual memories of fear and drug-induced reward , 2008, Neurobiology of Learning and Memory.

[76]  R. Vertes,et al.  Collateral projections from the supramammillary nucleus to the medial septum and hippocampus , 2000, Synapse.

[77]  Rafal Bogacz,et al.  An Approximation of the Error Backpropagation Algorithm in a Predictive Coding Network with Local Hebbian Synaptic Plasticity , 2017, Neural Computation.

[78]  R. O’Reilly,et al.  Conjunctive representations in learning and memory: principles of cortical and hippocampal function. , 2001, Psychological review.

[79]  Inah Lee,et al.  Neural Correlates of Object-in-Place Learning in Hippocampus and Prefrontal Cortex , 2011, The Journal of Neuroscience.

[80]  S. Grossberg,et al.  Adaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectors , 1976, Biological Cybernetics.

[81]  M. Moser,et al.  Pattern Separation in the Dentate Gyrus and CA3 of the Hippocampus , 2007, Science.

[82]  Fred H. Gage,et al.  What is memory? The present state of the engram , 2016, BMC Biology.

[83]  Wei Xu,et al.  A Neural Circuit for Memory Specificity and Generalization , 2013, Science.

[84]  Michael D. Howard,et al.  Complementary Learning Systems , 2014, Cogn. Sci..

[85]  David C. Evans,et al.  Encoding and Retrieval , 2017 .

[86]  K. Abe,et al.  The supramammillary nucleus contributes to associative EPSP‐spike potentiation in the rat dentate gyrus in vivo , 2001, The European journal of neuroscience.

[87]  L. Squire,et al.  Retrograde amnesia and memory consolidation: a neurobiological perspective , 1995, Current Opinion in Neurobiology.

[88]  E. Rolls,et al.  Computational analysis of the role of the hippocampus in memory , 1994, Hippocampus.

[89]  R. Muller,et al.  Multiple representations in the hippocampus , 1991, Hippocampus.