SAMPL: The Spreading Activation and Memory PLasticity Model

We present the Spreading Activation and Memory PLasticity Model (SAMPL), a computational model of how memory retrieval changes memories. SAMPL restructures memory networks as a function of spreading activation and plasticity. Memory networks are represented as graphs of items in which edge weights capture the strength of association between items. When an item is retrieved, activation spreads across nodes depending on edge weights and the strength of initial activation. A non-monotonic plasticity rule, in turn, updates edge weights following activation. SAMPL simulates human memory phenomena across a number of experiments including retrieval induced forgetting, context-based memory enhancement, and memory synchronization in conversational networks. Our results have implications for theorizing memory disorders such as PTSD and designing computationally assisted conversational therapy.

[1]  Jason Weston,et al.  A unified architecture for natural language processing: deep neural networks with multitask learning , 2008, ICML '08.

[2]  A. R. Otto,et al.  Stress promotes generalization of older but not recent threat memories , 2017, Proceedings of the National Academy of Sciences.

[3]  Victoria J. H. Ritvo,et al.  Nonmonotonic Plasticity: How Memory Retrieval Drives Learning , 2019, Trends in Cognitive Sciences.

[4]  K. Christoff,et al.  Prefrontal organization of cognitive control according to levels of abstraction , 2009, Brain Research.

[5]  David Badre,et al.  Cognitive control, hierarchy, and the rostro–caudal organization of the frontal lobes , 2008, Trends in Cognitive Sciences.

[6]  Margaret L. Schlichting,et al.  Memory integration: neural mechanisms and implications for behavior , 2015, Current Opinion in Behavioral Sciences.

[7]  Margaret L. Schlichting,et al.  The Hippocampus and Memory Integration: Building Knowledge to Navigate Future Decisions , 2017 .

[8]  A. Geana,et al.  Mnemonic convergence in social networks: The emergent properties of cognition at a collective level , 2016, Proceedings of the National Academy of Sciences.

[9]  John R. Anderson.  A spreading activation theory of memory. , 1983 .

[10]  Marc W. Howard,et al.  Predicting the Future with Multi-scale Successor Representations , 2018, bioRxiv.

[11]  I. Momennejad,et al.  Encoding of Prospective Tasks in the Human Prefrontal Cortex under Varying Task Loads , 2013, The Journal of Neuroscience.

[12]  Ehren L. Newman,et al.  Moderate excitation leads to weakening of perceptual representations. , 2010, Cerebral cortex.

[13]  M. Botvinick,et al.  The hippocampus as a predictive map , 2016 .

[14]  Michael C. Anderson,et al.  Integration as a general boundary condition on retrieval-induced forgetting , 1999 .

[15]  Rutvik H. Desai,et al.  The neurobiology of semantic memory , 2011, Trends in Cognitive Sciences.

[16]  M. Kahana.  Associative retrieval processes in free recall , 1996, Memory & cognition.

[17]  Ida Momennejad,et al.  Bridge ties bind collective memories , 2019, Nature Communications.

[18]  Per B Sederberg,et al.  The temporal contiguity effect predicts episodic memory performance. , 2010, Memory & cognition.

[19]  L. Davachi,et al.  Time-resolved neural reinstatement and pattern separation during memory decisions in human hippocampus , 2018, Proceedings of the National Academy of Sciences of the United States of America.

[20]  Michael C. Anderson,et al.  Remembering can cause forgetting: retrieval dynamics in long-term memory. , 1994, Journal of experimental psychology. Learning, memory, and cognition.

[21]  Marc W. Howard,et al.  A distributed representation of temporal context , 2002 .

[22]  Raymond J Dolan,et al.  A map of abstract relational knowledge in the human hippocampal–entorhinal cortex , 2017, eLife.

[23]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[24]  R. Henson,et al.  Differential roles for medial prefrontal and medial temporal cortices in schema-dependent encoding: From congruent to incongruent , 2013, Neuropsychologia.

[25]  Margaret L. Schlichting,et al.  Learning-related representational changes reveal dissociable integration and separation signatures in the hippocampus and prefrontal cortex , 2015, Nature Communications.

[26]  Troy A. Smith,et al.  Human hippocampus represents space and time during retrieval of real-world memories , 2015, Proceedings of the National Academy of Sciences.

[27]  Peter Dayan,et al.  Improving Generalization for Temporal Difference Learning: The Successor Representation , 1993, Neural Computation.

[28]  Chris R Brewin,et al.  Psychological theories of posttraumatic stress disorder. , 2003, Clinical psychology review.

[29]  M. Botvinick,et al.  Neural representations of events arise from temporal community structure , 2013, Nature Neuroscience.

[30]  E. Lein,et al.  Functional organization of the hippocampal longitudinal axis , 2014, Nature Reviews Neuroscience.

[31]  Troy A. Smith,et al.  The context repetition effect: predicted events are remembered better, even when they don't happen. , 2013, Journal of experimental psychology. General.

[32]  Per B. Sederberg,et al.  The Successor Representation and Temporal Context , 2012, Neural Computation.

[33]  Ehren L. Newman,et al.  A neural network model of retrieval-induced forgetting. , 2007, Psychological review.

[34]  Daniel S. J. Costa,et al.  Temporal contiguity in associative learning: Interference and decay from an historical perspective. , 2014, Journal of experimental psychology. Animal learning and cognition.

[35]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[36]  A. Coman,et al.  Cognition in a Social Context: A Social-Interactionist Approach to Emergent Phenomena , 2018, Current Directions in Psychological Science.

[37]  John-Dylan Haynes,et al.  Human anterior prefrontal cortex encodes the ‘what’ and ‘when’ of future intentions , 2012, NeuroImage.

[38]  Lila Davachi,et al.  Consolidation Promotes the Emergence of Representational Overlap in the Hippocampus and Medial Prefrontal Cortex , 2017, Neuron.

[39]  Nicholas B. Turk-Browne,et al.  Complementary learning systems within the hippocampus: A neural network modeling approach to reconciling episodic memory with statistical learning , 2016, bioRxiv.

[40]  E. Koechlin,et al.  The role of the anterior prefrontal cortex in human cognition , 1999, Nature.

[41]  M. Botvinick,et al.  The successor representation in human reinforcement learning , 2016, Nature Human Behaviour.

[42]  Gui Xue,et al.  Global Neural Pattern Similarity as a Common Basis for Categorization and Recognition Memory , 2014, The Journal of Neuroscience.

[43]  William Hirst,et al.  Flashbulb Memories. , 2016, Current directions in psychological science.

[44]  Alison R Preston,et al.  Memory integration constructs maps of space, time, and concepts , 2017, Current Opinion in Behavioral Sciences.

[45]  H. Eichenbaum,et al.  Interplay of Hippocampus and Prefrontal Cortex in Memory , 2013, Current Biology.

[46]  Lila Davachi,et al.  Similarity Breeds Proximity: Pattern Similarity within and across Contexts Is Related to Later Mnemonic Judgments of Temporal Proximity , 2014, Neuron.

[47]  Brice A. Kuhl,et al.  Experience-dependent hippocampal pattern differentiation prevents interference during subsequent learning , 2016, Nature Communications.

[48]  Sean M. Polyn,et al.  A context maintenance and retrieval model of organizational processes in free recall. , 2009, Psychological review.

[49]  Marika C Inhoff,et al.  Differentiation of Human Medial Prefrontal Cortex Activity Underlies Long-Term Resistance to Forgetting in Memory , 2018, The Journal of Neuroscience.

[50]  Marc W Howard,et al.  The persistence of memory: Contiguity effects across hundreds of seconds , 2008, Psychonomic bulletin & review.

[51]  G. Winocur,et al.  Episodic Memory and Beyond: The Hippocampus and Neocortex in Transformation. , 2016, Annual review of psychology.

[52]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[53]  Samuel Gershman,et al.  Predictive representations can link model-based reinforcement learning to model-free mechanisms , 2017, bioRxiv.

[54]  Christian F. Doeller,et al.  Memory hierarchies map onto the hippocampal long axis in humans , 2015, Nature Neuroscience.

[55]  Thomas L. Griffiths,et al.  Supplementary Information for Natural Speech Reveals the Semantic Maps That Tile Human Cerebral Cortex , 2022 .