The memory tesseract: Mathematical equivalence between composite and separate storage memory models

Abstract Computational memory models can explain the behaviour of human memory in diverse experimental paradigms. But research has produced a profusion of competing models, and, as different models focus on different phenomena, there is no best model. However, by examining commonalities among models, we can move towards theoretical unification. Computational memory models can be grouped into composite and separate storage models. We prove that MINERVA 2, a separate storage model of long-term memory, is mathematically equivalent to composite storage memory implemented as a fourth order tensor, and approximately equivalent to a fourth-order tensor compressed into a holographic vector. Building of these demonstrations, we show that MINERVA 2 and related separate storage models can be implemented in neurons. Our work clarifies the relationship between composite and separate storage models of memory, and thereby moves memory models a step closer to theoretical unification.

[1]  J. Eich A composite holographic associative recall model. , 1982 .

[2]  Adam F. Osth,et al.  Sources of interference in item and associative recognition memory. , 2015, Psychological review.

[3]  M. Humphreys,et al.  Different Ways to Cue a Coherent Memory System: A Theory for Episodic, Semantic, and Procedural Tasks. , 1989 .

[4]  D J Mewhort,et al.  Modeling lexical decision and word naming as a retrieval process. , 1999, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[5]  D. L. Hintzman Human learning and memory: connections and dissociations. , 1990, Annual review of psychology.

[6]  S. Goldinger Echoes of echoes? An episodic theory of lexical access. , 1998, Psychological review.

[7]  Michael N. Jones,et al.  The Combinatorial Power of Experience , 2016, CogSci.

[8]  Aryn Pyke,et al.  Dynamically structured holographic memory , 2014, BICA 2014.

[9]  Geoffrey E. Hinton,et al.  Distributed representations and nested compositional structure , 1994 .

[10]  E. E. Johns,et al.  Sharpening the echo: An iterative‐resonance model for short‐term recognition memory , 2005, Memory.

[11]  Michael N Jones,et al.  Representing word meaning and order information in a composite holographic lexicon. , 2007, Psychological review.

[12]  Steve B. Furber,et al.  Efficient SpiNNaker simulation of a heteroassociative memory using the Neural Engineering Framework , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[13]  T A Plate,et al.  Randomly connected sigma–pi neurons can form associator networks , 2000, Network.

[14]  S. Lewandowsky,et al.  An endogenous distributed model of ordering in serial recall , 2002, Psychonomic bulletin & review.

[15]  D J K Mewhort,et al.  Grammaticality is inferred from global similarity: A reply to Kinder (2010) , 2011, Quarterly journal of experimental psychology.

[16]  Douglas J. K. Mewhort,et al.  A synchronization account of false recognition , 2012, Cognitive Psychology.

[17]  Murdock,et al.  Learning in a distributed memory model. , 1989 .

[18]  Pentti Kanerva,et al.  Binary Spatter-Coding of Ordered K-Tuples , 1996, ICANN.

[19]  Douglas L. Hintzman,et al.  "Schema Abstraction" in a Multiple-Trace Memory Model , 1986 .

[20]  Ray Pike,et al.  Global matching: A comparison of the SAM, Minerva II, Matrix, and TODAM models. , 1989 .

[21]  R. Nosofsky Attention, similarity, and the identification-categorization relationship. , 1986, Journal of experimental psychology. General.

[22]  S. Gronlund,et al.  Global matching models of recognition memory: How the models match the data , 1996, Psychonomic bulletin & review.

[23]  Marc W. Howard,et al.  A distributed representation of temporal context , 2002 .

[24]  Chris Eliasmith,et al.  A Neural Model of Rule Generation in Inductive Reasoning , 2011, Top. Cogn. Sci..

[25]  Dorothea Blostein,et al.  Encoding structure in holographic reduced representations. , 2013, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[26]  D J K Mewhort,et al.  Memory as a hologram: an analysis of learning and recall. , 2015, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[27]  Douglas L. Hintzman,et al.  Is memory organized by temporal contiguity? , 2016, Memory & cognition.

[28]  Abraham R. Schneider,et al.  Theoretical correlations and measured correlations: relating recognition and recall in four distributed memory models. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[29]  R. Nosofsky Tests of an exemplar model for relating perceptual classification and recognition memory. , 1991, Journal of experimental psychology. Human perception and performance.

[30]  W. Kintsch,et al.  High-Dimensional Semantic Space Accounts of Priming. , 2006 .

[31]  Matthew Kelly,et al.  The Memory Tesseract: Developing a Unified Framework for Modelling Memory and Cognition , 2016 .

[32]  R. Shiffrin,et al.  List-strength Effect: Ii. Theoretical Mechanisms , 1990 .

[33]  P. Kwantes Using context to build semantics , 2005, Psychonomic bulletin & review.

[34]  Rick P. Thomas,et al.  Diagnostic hypothesis generation and human judgment. , 2008, Psychological review.

[35]  Simon Farrell,et al.  Short-Term Memory: New Data and a Model , 2008 .

[36]  Matthew Kelly,et al.  Advancing the Theory and Utility of Holographic Reduced Representations , 2010 .

[37]  Ross W. Gayler Vector Symbolic Architectures answer Jackendoff's challenges for cognitive neuroscience , 2004, ArXiv.

[38]  Endel Tulving,et al.  Continuity between recall and recognition. , 1973 .

[39]  Steve B. Furber,et al.  The SpiNNaker Project , 2014, Proceedings of the IEEE.

[40]  Randall K. Jamieson,et al.  A computational account of the production effect: Still playing twenty questions with nature. , 2016, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[41]  Paul Thagard,et al.  The AHA! Experience: Creativity Through Emergent Binding in Neural Networks , 2011, Cogn. Sci..

[42]  Trevor Bekolay,et al.  A Large-Scale Model of the Functioning Brain , 2012, Science.

[43]  R. Shiffrin,et al.  A model for recognition memory: REM—retrieving effectively from memory , 1997, Psychonomic bulletin & review.

[44]  Randall K. Jamieson,et al.  Applying an Exemplar Model to the Artificial-Grammar Task: Inferring Grammaticality from Similarity , 2009, Quarterly journal of experimental psychology.

[45]  B B Murdock,et al.  TODAM2: a model for the storage and retrieval of item, associative, and serial-order information. , 1993, Psychological review.

[46]  Paul Smolensky,et al.  Tensor Product Variable Binding and the Representation of Symbolic Structures in Connectionist Systems , 1990, Artif. Intell..

[47]  Tony A. Plate,et al.  Holographic reduced representations , 1995, IEEE Trans. Neural Networks.

[48]  C. Gettys,et al.  MINERVA-DM: A memory processes model for judgments of likelihood. , 1999 .

[49]  Douglas L. Hintzman,et al.  MINERVA 2: A simulation model of human memory , 1984 .

[50]  Randall K. Jamieson,et al.  An instance theory of associative learning , 2012, Learning & behavior.

[51]  Chris Eliasmith,et al.  How to Build a Brain: A Neural Architecture for Biological Cognition , 2013 .

[52]  Douglas L. Hintzman,et al.  Judgments of frequency and recognition memory in a multiple-trace memory model. , 1988 .

[53]  James A. Anderson,et al.  A theory for the recognition of items from short memorized lists , 1973 .