Modelling Lexical Decision Using Corpus Derived Semantic Representations in a Connectionist Network

Connectionist models of the mapping from orthography or phonology to random binary semantic vectors allow the simulation of lexical decision with reaction times that show patterns of semantic and associative priming similar to those found experimentally with human subjects. The co-occurrence statistics of words in large corpora allow the generation of vectors whose distribution correlates with the perceived semantic relatedness of the words. Here we discuss the use of these more realistic corpus derived semantic representations in connectionist models of lexical decision. We find lexical decision priming that correlates with distances in the semantic vector space, but the reaction times are very noisy. Averages over many words and/or many networks are required for the relationships to become clear. The question of associative priming remains open.

[1]  Hinrich Schütze,et al.  Word Space , 1992, NIPS.

[2]  T. Shallice,et al.  Deep Dyslexia: A Case Study of , 1993 .

[3]  J. H. Neely Semantic priming effects in visual word recognition: A selective review of current findings and theories. , 1991 .

[4]  Lorraine K. Tyler,et al.  A Distributed Memory Model of the Associative Boost in Semantic Priming , 1994, Connect. Sci..

[5]  W. Marslen-Wilson,et al.  Accessing Different Types of Lexical Semantic Information: Evidence From Priming , 1995 .

[6]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[7]  R. Shillcock,et al.  Proceedings of the Seventeenth Annual Conference of the Cognitive Science Society , 1995 .

[8]  G. Humphreys,et al.  Basic processes in reading : visual word recognition , 1993 .

[9]  Robert L. Mercer,et al.  Class-Based n-gram Models of Natural Language , 1992, CL.

[10]  J. Shelton,et al.  How semantic is automatic semantic priming? , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[11]  Malti Patel,et al.  Extracting Semantic Representations from Large Text Corpora , 1997, NCPW.

[12]  G. Zipf,et al.  The Psycho-Biology of Language , 1936 .

[13]  B. Fischhoff,et al.  Journal of Experimental Psychology: Human Learning and Memory , 1980 .

[14]  Ralf Der,et al.  The "Perceptual Magnet" Effect: A Model Based on Self-Organizing Feature Maps , 1995 .

[15]  John A. Bullinaria Modelling Reaction Times , 1995 .

[16]  David C. Plaut,et al.  Semantic and Associative Priming in a Distributed Attractor Network , 1995 .

[17]  John A. Bullinaria,et al.  Modelling Lexical Decision: Who needs a lexicon? , 1995 .

[18]  James L. McClelland On the time relations of mental processes: An examination of systems of processes in cascade. , 1979 .

[19]  Christopher C. Huckle Grouping Words Using Statistical Context , 1995, EACL.