Remembering Words in Context as Predicted by an Associative Read-Out Model

Interactive activation models (IAMs) simulate orthographic and phonological processes in implicit memory tasks, but they neither account for associative relations between words nor explicit memory performance. To overcome both limitations, we introduce the associative read-out model (AROM), an IAM extended by an associative layer implementing long-term associations between words. According to Hebbian learning, two words were defined as “associated” if they co-occurred significantly often in the sentences of a large corpus. In a study-test task, a greater amount of associated items in the stimulus set increased the “yes” response rates of non-learned and learned words. To model test-phase performance, the associative layer is initialized with greater activation for learned than for non-learned items. Because IAMs scale inhibitory activation changes by the initial activation, learned items gain a greater signal variability than non-learned items, irrespective of the choice of the free parameters. This explains why the slope of the z-transformed receiver-operating characteristics (z-ROCs) is lower one during recognition memory. When fitting the model to the empirical z-ROCs, it likewise predicted which word is recognized with which probability at the item-level. Since many of the strongest associates reflect semantic relations to the presented word (e.g., synonymy), the AROM merges form-based aspects of meaning representation with meaning relations between words.

[1]  Annette Kinder,et al.  Receiver operating characteristics in the lexical decision task: evidence for a simple signal-detection process simulated by the multiple read-out model. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[2]  David A. Balota,et al.  Bringing Computational Models of Word Naming Down to the Item Level , 1997 .

[3]  John J. L. Morton,et al.  Interaction of information in word recognition. , 1969 .

[4]  Pat Gunn,et al.  A rational account of memory predicts left prefrontal activation during controlled retrieval. , 2008, Cerebral cortex.

[5]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: I. An account of basic findings. , 1981 .

[6]  Gordon D A Brown,et al.  Modeling lexical decision: the form of frequency and diversity effects. , 2008, Psychological review.

[7]  Markus J. Hofmann,et al.  Does familiarity or conflict account for performance in the word-stem completion task? Evidence from behavioural and event-related-potential data , 2009, Psychological research.

[8]  Kenneth J. Malmberg,et al.  Recognition memory: A review of the critical findings and an integrated theory for relating them , 2008, Cognitive Psychology.

[9]  Stephen Grossberg,et al.  Competitive Learning: From Interactive Activation to Adaptive Resonance , 1987, Cogn. Sci..

[10]  N. Gee,et al.  Interpreting the influence of implicitly activated memories on recall and recognition. , 1998, Psychological review.

[11]  B. Murdock Context and mediators in a theory of distributed associative memory (TODAM2). , 1997 .

[12]  Christian Biemann,et al.  Corpus Portal for Search in Monolingual Corpora , 2006, LREC.

[13]  A. Jacobs,et al.  On localist connectionism and psychological science. , 1998 .

[14]  M. Glanzer,et al.  Slope of the receiver-operating characteristic in recognition memory. , 1999 .

[15]  Helen L Jamison,et al.  Morphology and the internal structure of words. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[16]  A. Jacobs,et al.  Modulation of prefrontal cortex activation by emotional words in recognition memory , 2006, Neuroreport.

[17]  Mark Steyvers,et al.  Topics in semantic representation. , 2007, Psychological review.

[18]  J. R. Firth,et al.  A Synopsis of Linguistic Theory, 1930-1955 , 1957 .

[19]  Prisca Stenneken,et al.  Sublexical frequency measures for orthographic and phonological units in German , 2007, Behavior research methods.

[20]  R. Clark,et al.  Recognition memory and the medial temporal lobe: a new perspective , 2007, Nature Reviews Neuroscience.

[21]  James L. McClelland,et al.  Précis of Semantic Cognition: A Parallel Distributed Processing Approach , 2008, Behavioral and Brain Sciences.

[22]  Mark S. Seidenberg,et al.  Computing the meanings of words in reading: cooperative division of labor between visual and phonological processes. , 2004, Psychological review.

[23]  Peter M. Todd,et al.  Learning and connectionist representations , 1993 .

[24]  Michael J Cortese,et al.  Recognition memory for 2,578 monosyllabic words , 2010, Memory.

[25]  David R. Shanks,et al.  A unitary signal-detection model of implicit and explicit memory , 2008, Trends in Cognitive Sciences.

[26]  Jonathan Grainger,et al.  Letter perception: from item-level ERPs to computational models , 2008 .

[27]  A. Yonelinas Receiver-operating characteristics in recognition memory: evidence for a dual-process model. , 1994, Journal of experimental psychology. Learning, memory, and cognition.

[28]  Jonathan Grainger,et al.  A Dual-Route Approach to Orthographic Processing , 2011, Front. Psychology.

[29]  Marius Usher,et al.  Extending a biologically inspired model of choice: multi-alternatives, nonlinearity and value-based multidimensional choice , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[30]  A. Jacobs,et al.  Conflict monitoring engages the mediofrontal cortex during nonword processing , 2008, Neuroreport.

[31]  M R Quillian,et al.  Word concepts: a theory and simulation of some basic semantic capabilities. , 1967, Behavioral science.

[32]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[33]  Michael E. J. Masson A Distributed Memory Model of Context Effects in Word Identification , 2012 .

[34]  T. Griffiths,et al.  Probabilistic inference in human semantic memory , 2006, Trends in Cognitive Sciences.

[35]  James L. McClelland,et al.  Understanding normal and impaired word reading: computational principles in quasi-regular domains. , 1996, Psychological review.

[36]  J. Deese On the prediction of occurrence of particular verbal intrusions in immediate recall. , 1959, Journal of experimental psychology.

[37]  A. Jacobs,et al.  The Berlin Affective Word List Reloaded (BAWL-R) , 2009, Behavior research methods.

[38]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[39]  R Ratcliff,et al.  Retrieving information from memory: spreading-activation theories versus compound-cue theories. , 1994, Psychological review.

[40]  Max Coltheart,et al.  Access to the internal lexicon , 1977 .

[41]  K. McDermott,et al.  Creating false memories: Remembering words not presented in lists. , 1995 .

[42]  M. Glanzer,et al.  The regularities of recognition memory. , 1993, Psychological review.

[43]  R. Shiffrin,et al.  A model for recognition memory: REM—retrieving effectively from memory , 1997, Psychonomic bulletin & review.

[44]  Mario Braun,et al.  Model-generated lexical activity predicts graded ERP amplitudes in lexical decision , 2006, Brain Research.

[45]  R Ratcliff,et al.  Testing global memory models using ROC curves. , 1992, Psychological review.

[46]  Reinhard Rapp,et al.  Prediction of free word associations based on Hebbian learning , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[47]  A. Jacobs,et al.  Affective processing within 1/10th of a second: High arousal is necessary for early facilitative processing of negative but not positive words , 2009, Cognitive, affective & behavioral neuroscience.

[48]  R. O’Reilly Six principles for biologically based computational models of cortical cognition , 1998, Trends in Cognitive Sciences.

[49]  A. Jacobs,et al.  Simulating syllable frequency effects within an interactive activation framework , 2010 .

[50]  R. Shiffrin,et al.  A retrieval model for both recognition and recall. , 1984, Psychological review.

[51]  VÕ MELISSAL.-H. di-The Berlin Affective Word List Reloaded (BAWL–R) , 2022 .

[52]  James L. McClelland,et al.  Familiarity breeds differentiation: a subjective-likelihood approach to the effects of experience in recognition memory. , 1998, Psychological review.

[53]  J. Bullinaria,et al.  Extracting semantic representations from word co-occurrence statistics: A computational study , 2007, Behavior research methods.

[54]  Murali Tummala,et al.  Receiver Operating Characteristics , 2004 .

[55]  Allan Collins,et al.  A spreading-activation theory of semantic processing , 1975 .

[56]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[57]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: Part 2. The contextual enhancement effect and some tests and extensions of the model. , 1982, Psychological review.

[58]  Troy A. Smith,et al.  The fSAM model of false recall. , 2007, Psychological review.

[59]  M. Ross Quillian,et al.  Retrieval time from semantic memory , 1969 .

[60]  Marco Zorzi,et al.  Nested incremental modeling in the development of computational theories: the CDP+ model of reading aloud. , 2007, Psychological review.

[61]  Allan Collins,et al.  A spreading-activation theory of semantic processing , 1975 .

[62]  Sharon L. Thompson-Schill,et al.  Resolving conflict: A response to Martin and Cheng (2006) , 2006, Psychonomic bulletin & review.

[63]  J. Morton A Preliminary Functional Model for Language Behaviour , 1964 .

[64]  R. H. Baayen,et al.  The CELEX Lexical Database (CD-ROM) , 1996 .

[65]  J. Ziegler,et al.  Reading acquisition, developmental dyslexia, and skilled reading across languages: a psycholinguistic grain size theory. , 2005, Psychological bulletin.

[66]  Richard D. Deveaux,et al.  Applied Smoothing Techniques for Data Analysis , 1999, Technometrics.

[67]  A. Jacobs,et al.  Models of visual word recognition: Sampling the state of the art. , 1994 .

[68]  J. S. Nairne,et al.  The nature of remembering : essays in honor of Robert G. Crowder , 2001 .

[69]  J. Wixted Dual-process theory and signal-detection theory of recognition memory. , 2007, Psychological review.

[70]  M. Masson A distributed memory model of semantic priming. , 1995 .

[71]  J Grainger,et al.  Orthographic processing in visual word recognition: a multiple read-out model. , 1996, Psychological review.

[72]  D. Norman Toward a theory of memory and attention. , 1968 .

[73]  James L. McClelland Toward a theory of information processing in graded, random, and interactive networks , 1993 .

[74]  Ted Dunning,et al.  Accurate Methods for the Statistics of Surprise and Coincidence , 1993, CL.

[75]  L. T. DeCarlo Signal detection theory with finite mixture distributions: theoretical developments with applications to recognition memory. , 2002, Psychological review.

[76]  M. Page,et al.  Connectionist modelling in psychology: A localist manifesto , 2000, Behavioral and Brain Sciences.

[77]  James L. McClelland,et al.  Semantic Cognition: A Parallel Distributed Processing Approach , 2004 .

[78]  M. Rugg,et al.  Separating the Brain Regions Involved in Recollection and Familiarity in Recognition Memory , 2005, The Journal of Neuroscience.

[79]  M Coltheart,et al.  DRC: a dual route cascaded model of visual word recognition and reading aloud. , 2001, Psychological review.

[80]  James L. McClelland,et al.  A distributed, developmental model of word recognition and naming. , 1989, Psychological review.

[81]  S. Grossberg A Theory of Visual Coding : Memory , and Development , 2010 .

[82]  Michael N Jones,et al.  Representing word meaning and order information in a composite holographic lexicon. , 2007, Psychological review.

[83]  Gabriella Vigliocco,et al.  Integrating experiential and distributional data to learn semantic representations. , 2009, Psychological review.