Encoding and Accessing Linguistic Representations in a Dynamically Structured Holographic Memory System

This paper presents a computational model that integrates a dynamically structured holographic memory system into the ACT-R cognitive architecture to explain how linguistic representations are encoded and accessed in memory. ACT-R currently serves as the most precise expression of the moment-by-moment working memory retrievals that support sentence comprehension. The ACT-R model of sentence comprehension is able to capture a range of linguistic phenomena, but there are cases where the model makes the wrong predictions, such as the over-prediction of retrieval interference effects during sentence comprehension. Here, we investigate one such case involving the processing of sentences with negative polarity items (NPIs) and consider how a dynamically structured holographic memory system might provide a cognitively plausible and principled explanation of some previously unexplained effects. Specifically, we show that by replacing ACT-R's declarative memory with a dynamically structured memory, we can explain a wider range of behavioral data involving reading times and judgments of grammaticality. We show that our integrated model provides a better fit to human error rates and response latencies than the original ACT-R model. These results provide proof-of-concept for the unification of two independent computational cognitive frameworks.

[1]  C. Phillips,et al.  Reflexive attraction in comprehension is selective , 2017 .

[2]  F. Velde,et al.  Neural blackboard architectures of combinatorial structures in cognition , 2006 .

[3]  Michael Matessa,et al.  A Production System Theory of Serial Memory , 1997 .

[4]  Geoffrey E. Hinton Tensor Product Variable Binding and the Representation of Symbolic Structures in Connectionist Systems , 1991 .

[5]  Douglas Saddy,et al.  Processing Negative Polarity Items: When Negation Comes Through the Backdoor , 2005 .

[6]  Robert L. West,et al.  Holographic declarative memory and the fan effect: A test case for a new memory module for ACT-R , 2015 .

[7]  Andrea Martin-Nieuwland Cue-based interference from illicit attractor: ERP Evidence from VP Ellipsis. , 2015 .

[8]  C. Pipper,et al.  [''R"--project for statistical computing]. , 2008, Ugeskrift for laeger.

[9]  John R. Anderson,et al.  The fan effect: New results and new theories. , 1999 .

[10]  Richard L. Lewis,et al.  Processing Polarity: How the Ungrammatical Intrudes on the Grammatical , 2008, Cogn. Sci..

[11]  Aryn Pyke,et al.  Dynamically structured holographic memory , 2014, BICA 2014.

[12]  John R. Anderson,et al.  Human memory: An adaptive perspective. , 1989 .

[13]  John R. Anderson Retrieval of propositional information from long-term memory , 1974 .

[14]  Jerry A. Fodor,et al.  Language, Thought and Compositionality , 2001, Royal Institute of Philosophy Supplement.

[15]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[16]  C. Phillips,et al.  Illusory licensing effects across dependency types: ERP evidence , 2009, Brain and Language.

[17]  Ellen F. Lau,et al.  Agreement Attraction in Comprehension: Representations and Processes. , 2009 .

[18]  Andrea E. Martin,et al.  Event-related brain potentials index cue-based retrieval interference during sentence comprehension , 2011, NeuroImage.

[19]  Dmitri A. Rachkovskij,et al.  Binding and Normalization of Binary Sparse Distributed Representations by Context-Dependent Thinning , 2001, Neural Computation.

[20]  Richard L. Lewis,et al.  Computational principles of working memory in sentence comprehension , 2006, Trends in Cognitive Sciences.

[21]  Pentti Kanerva,et al.  The Spatter Code for Encoding Concepts at Many Levels , 1994 .

[22]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[23]  Ross W. Gayler Vector Symbolic Architectures answer Jackendoff's challenges for cognitive neuroscience , 2004, ArXiv.

[24]  R. Meijer,et al.  A trial studying approach to predict college achievement , 2015, Front. Psychol..

[25]  Frank E. Ritter,et al.  Determining the number of simulation runs: Treating simulations as theories by not sampling their behavior , 2011 .

[26]  Case Licensing in Processing: Evidence from German , 2013 .

[27]  Ivan A. Sag,et al.  Book Reviews: Head-driven Phrase Structure Grammar and German in Head-driven Phrase-structure Grammar , 1996, CL.

[28]  Colin Phillips,et al.  5: Grammatical Illusions and Selective Fallibility in Real-Time Language Comprehension , 2011 .

[29]  C. Phillips,et al.  Negative polarity illusions and the format of hierarchical encodings in memory , 2016, Cognition.

[30]  Benjamin Naumann The Architecture Of Cognition , 2016 .

[31]  Tony A. Plate,et al.  Holographic Reduced Representation: Distributed Representation for Cognitive Structures , 2003 .

[32]  Laurel Brehm,et al.  The time-course of feature interference in agreement comprehension: Multiple mechanisms and asymmetrical attraction. , 2014, Journal of memory and language.

[33]  Pentti Kanerva,et al.  Binary Spatter-Coding of Ordered K-Tuples , 1996, ICANN.

[34]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[35]  Colin Phillips,et al.  Interference in the processing of adjunct control , 2015, Front. Psychol..

[36]  Mante S. Nieuwland,et al.  Agreement attraction during comprehension of grammatical sentences: ERP evidence from ellipsis , 2014, Brain and Language.

[37]  Richard Reviewer-Granger Unified Theories of Cognition , 1991, Journal of Cognitive Neuroscience.

[38]  Pentti Kanerva,et al.  Fully Distributed Representation , 1997 .

[39]  Brian Dillon,et al.  Contrasting intrusion profiles for agreement and anaphora: Experimental and modeling evidence , 2013 .

[40]  Richard L. Lewis,et al.  An Activation-Based Model of Sentence Processing as Skilled Memory Retrieval , 2005, Cogn. Sci..