Rethinking the Word Frequency Effect: The Neglected Role of Distributional Information in Lexical Processing

Attempts to quantify lexical variation have produced a large number of theoretical and empirical constructs, such as Word Frequency, Concreteness, and Ambiguity, which have been claimed to predict between-word differences in lexical processing behavior. Models of word recognition that have been developed to account for the effects of these variables have typically lacked adequate semantic representations, and have dealt with words as if they exist in isolation from their environment. We present a new dimension of lexical variation that is addressed to this concern. Contextual Distinctiveness(CD), a corpus-derived summary measure of the frequency distribution of the contexts in which a word occurs, is naturally compatible with contextual theories of semantic representation and meaning. Experiment 1 demonstrates that CD is a significantly better predictor of lexical decision latencies than occurrence frequency, suggesting that CD is the more psychologically relevant variable. We additionally explore the relationship between CD and six subjectively-defined measures: Concreteness, Context Availability, Number of Contexts, Ambiguity, Age of Acquisition and Familiarity and find CD to be reliably related to Ambiguity only. We argue for the priority of immediate context in determining the representation and processing of language.

[1]  R. Solomon,et al.  Visual duration threshold as a function of word-probability. , 1951, Journal of experimental psychology.

[2]  S. Siegel,et al.  Nonparametric Statistics for the Behavioral Sciences , 2022, The SAGE Encyclopedia of Research Design.

[3]  J. R. Firth,et al.  A Synopsis of Linguistic Theory, 1930-1955 , 1957 .

[4]  C. T. James.  The Role of Semantic Information in Lexical Decisions. , 1975 .

[5]  C. P. Whaley.  Word–nonword classification time. , 1978 .

[6]  M. Taft.  Recognition of affixed words and the word frequency effect , 1979, Memory & cognition.

[7]  H. Dahl.  Word frequencies of spoken American English , 1979 .

[8]  J. Jastrzembski.  Multiple meanings, number of related meanings, frequency of occurrence, and the lexicon , 1981, Cognitive Psychology.

[9]  E. Shoben,et al.  Differential Context Effects in the Comprehension of Abstract and Concrete Verbal Materials , 1983 .

[10]  Kenneth Gilhooly,et al.  Word age-of-acquisition and residence time in lexical memory as factors in word naming , 1984 .

[11]  M. Gernsbacher.  Resolving 20 years of inconsistent interactions between lexical familiarity and orthography, concreteness, and polysemy. , 1984, Journal of experimental psychology. General.

[12]  Gregory V. Jones.  Deep dyslexia, imageability, and ease of predication , 1985, Brain and Language.

[13]  Alfonso Caramazza,et al.  Lexical access and frequency sensitivity: Frequency saturation and open/closed class equivalence , 1985, Cognition.

[14]  D. Ingram.  The Acquisition Of Word-Initial [v] , 1988, Language and speech.

[15]  Eugene A. Lovelace,et al.  On using norms for low-frequency words , 1988 .

[16]  R. W. Stowe,et al.  Context availability and lexical decisions for abstract and concrete words , 1988 .

[17]  James L. McClelland,et al.  A distributed, developmental model of word recognition and naming. , 1989, Psychological review.

[18]  Robin K. Morris,et al.  Eye movement guidance in reading: the role of parafoveal letter and space information. , 1990, Journal of experimental psychology. Human perception and performance.

[19]  A. Baddeley.  Human Memory: Theory and Practice, Revised Edition , 1990 .

[20]  George A. Miller,et al.  Introduction to WordNet: An On-line Lexical Database , 1990 .

[21]  D. D. Groot,et al.  Determinants of word translation , 1991 .

[22]  Ernest Lepore,et al.  Holism: A Shopper's Guide , 1992 .

[23]  Matthew Flatt,et al.  PsyScope: An interactive graphic system for designing and controlling experiments in the psychology laboratory using Macintosh computers , 1993 .

[24]  M. Westphal.  Holism: A Shopper’s Guide , 1993 .

[25]  P. Resnik.  Selection and information: a class-based approach to lexical relationships , 1993 .

[26]  Maryellen C. MacDonald,et al.  Probabilistic constraints and syntactic ambiguity resolution , 1994 .

[27]  Andrew W. Ellis,et al.  ROLES OF WORD FREQUENCY AND AGE OF ACQUISITION IN WORD NAMING AND LEXICAL DECISION , 1995 .

[28]  R. H. Baayen,et al.  The CELEX Lexical Database (CD-ROM) , 1996 .

[29]  Christopher C. Huckle.  Unsupervised categorization of word meanings using statistical and neural network methods , 1996 .

[30]  Curt Burgess,et al.  Producing high-dimensional semantic spaces from lexical co-occurrence , 1996 .

[31]  J. Kroll,et al.  The influence of lexical and conceptual constraints on reading mixed-language sentences: Evidence from eye fixations and naming times , 1996, Memory & cognition.

[32]  Malti Patel,et al.  Extracting Semantic Representations from Large Text Corpora , 1997, NCPW.

[33]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[34]  Mark S. Seidenberg,et al.  On the nature and scope of featural representations of word meaning. , 1997, Journal of experimental psychology. General.

[35]  R. Baayen,et al.  Singulars and plurals in Dutch: Evidence for a parallel dual-route model , 1997 .

[36]  A. Jongman,et al.  Processing of English inflectional morphology , 1997, Memory & cognition.

[37]  Hinrich Schütze,et al.  Automatic Word Sense Discrimination , 1998, Comput. Linguistics.

[38]  W. Lowe,et al.  Modelling functional priming and the associative boost , 1998 .

[39]  Nick Chater,et al.  Distributional Information: A Powerful Cue for Acquiring Syntactic Categories , 1998, Cogn. Sci..

[40]  M. Gareth Gaskell,et al.  Ambiguity, competition, and blending in spoken word recognition , 1999, Cogn. Sci..

[41]  Frank Keller,et al.  Determinants of Adjective-Noun Plausibility , 1999, EACL.

[42]  Scott A. McDonald,et al.  Environmental Determinants of Lexical Processing Effort , 2000 .

[43]  R. Cann.  Functional versus lexical: a cognitive dichotomy , 2000 .

[44]  P. White,et al.  Causal judgments about relations between multilevel variables. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[45]  Michael B. Lewis,et al.  Re-evaluating age-of-acquisition effects: are they simply cumulative-frequency effects? , 2001, Cognition.

[46]  Michael Wilson.  MRC Psycholinguistic Database , 2001 .

[47]  Richard Shillcock,et al.  Contextual Distinctiveness: a new lexical property computed from large corpora , 2001 .