Analog-symbolic memory that tracks via reconsolidation

A fundamental part of a computational system is its memory, which is used to store and retrieve data. Classical computer memories rely on the static approach and are very different from human memories. Neural network memories are based on auto-associative attractor dynamics and thus provide a high level of pattern completion. However, they are not used in general computation since there are practically no algorithms to load an arbitrary landscape of attractors into them. In this sense neural network memory models cannot communicate well with symbolic and prior knowledge. We propose the design of a new memory based on localist attractor dynamics with reconsolidation called Reconsolidation Attractor Network (RAN). RAN combines symbolic and subsymbolic features in a very attractive way: it is based on attractors; enables pattern classification under missing data; and demonstrates dynamic reconsolidation, which is very useful for tracking changing concepts. The perception RAN enables is somewhat reminiscent of human perception due to its context sensitivity. Furthermore, it enables an immediate and clear interface with symbolic memories, including loading of attractors by means of trivial wiring, updating attractors, and retrieving them faster without waiting for full convergence. It also scales to any number of concepts. This provides a useful counterpoint to more conventional memory systems, such as random access memory and auto-associative neural networks. c 2008 Elsevier B.V. All rights reserved.

[1]  S. Becker,et al.  Long-term semantic priming: a computational account and empirical evidence. , 1997, Journal of experimental psychology. Learning, memory, and cognition.

[2]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: I. An account of basic findings. , 1981 .

[3]  Walter J. Freeman,et al.  Reafference and Attractors in the Olfactory System During Odor Recognition , 1996, Int. J. Neural Syst..

[4]  Hava T. Siegelmann,et al.  Computational Complexity for Continuous Time Dynamics , 1999 .

[5]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[6]  P. Goldman-Rakic Cellular basis of working memory , 1995, Neuron.

[7]  C. Gallistel,et al.  The learning curve: implications of a quantitative analysis. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[8]  D. Sagi,et al.  Dynamics of Memory Representations in Networks with Novelty-Facilitated Synaptic Plasticity , 2006, Neuron.

[9]  Naama Brenner,et al.  History-Dependent Multiple-Time-Scale Dynamics in a Single-Neuron Model , 2005, The Journal of Neuroscience.

[10]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: part 1.: an account of basic findings , 1988 .

[11]  Pierre Baldi,et al.  Bayesian surprise attracts human attention , 2005, Vision Research.

[12]  Y. Miyashita Neuronal correlate of visual associative long-term memory in the primate temporal cortex , 1988, Nature.

[13]  C. Koch,et al.  Invariant visual representation by single neurons in the human brain , 2005, Nature.

[14]  T. Sejnowski,et al.  Dopamine-mediated stabilization of delay-period activity in a network model of prefrontal cortex. , 2000, Journal of neurophysiology.

[15]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[16]  Y. Dudai,et al.  Rites of Passage of the Engram Reconsolidation and the Lingering Consolidation Hypothesis , 2004, Neuron.

[17]  B. Everitt,et al.  Independent Cellular Processes for Hippocampal Memory Consolidation and Reconsolidation , 2004, Science.

[18]  R. Desimone,et al.  Responses of Macaque Perirhinal Neurons during and after Visual Stimulus Association Learning , 1999, The Journal of Neuroscience.

[19]  Richard S. Zemel,et al.  Localist Attractor Networks , 2001, Neural Computation.

[20]  Boris S. Gutkin,et al.  Dopamine modulation in the basal ganglia locks the gate to working memory , 2006, Journal of Computational Neuroscience.

[21]  Neil Burgess,et al.  Attractor Dynamics in the Hippocampal Representation of the Local Environment , 2005, Science.

[22]  H. Siegelmann,et al.  Computation by dynamical systems , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[23]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[24]  Hava T. Siegelmann,et al.  Random matrix theory for the analysis of the performance of an analog computer: a scaling theory , 2004 .

[25]  P. Goldman-Rakic,et al.  Matching patterns of activity in primate prefrontal area 8a and parietal area 7ip neurons during a spatial working memory task. , 1998, Journal of neurophysiology.

[26]  Fear memories require protein synthesis in the amygdala for reconsolidation after retrieval , 2022 .

[27]  David L. Faigman,et al.  Human category learning. , 2005, Annual review of psychology.

[28]  Y. Miyashita,et al.  Neuronal correlate of pictorial short-term memory in the primate temporal cortexYasushi Miyashita , 1988, Nature.

[29]  Bruce L. McNaughton,et al.  Progressive Transformation of Hippocampal Neuronal Representations in “Morphed” Environments , 2005, Neuron.

[30]  H. Siegelmann,et al.  Analog computation with dynamical systems , 1998 .

[31]  Y. Dudai Time to Remember , 1997, Neuron.

[32]  T Poggio,et al.  Regularization Algorithms for Learning That Are Equivalent to Multilayer Networks , 1990, Science.

[33]  B. McNaughton,et al.  Hippocampal synaptic enhancement and information storage within a distributed memory system , 1987, Trends in Neurosciences.

[34]  G. E. Alexander,et al.  Neuron Activity Related to Short-Term Memory , 1971, Science.

[35]  P. Goldman-Rakic,et al.  Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. , 2000, Cerebral cortex.

[36]  C. Gallistel,et al.  The rat approximates an ideal detector of changes in rates of reward: implications for the law of effect. , 2001, Journal of experimental psychology. Animal behavior processes.

[37]  Hava T. Siegelmann,et al.  Probabilistic analysis of a differential equation for linear programming , 2001, J. Complex..

[38]  M. Hasselmo,et al.  Dynamics of learning and recall at excitatory recurrent synapses and cholinergic modulation in rat hippocampal region CA3 , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[39]  E T Rolls,et al.  Computational constraints suggest the need for two distinct input systems to the hippocampal CA3 network , 1992, Hippocampus.