Lexical knowledge without a lexicon?

Although for many years a sharp distinction has been made in language research between rules and words - with primary interest on rules - this distinction is now blurred in many theories. If anything, the focus of attention has shifted in recent years in favor of words. Results from many different areas of language research suggest that the lexicon is representationally rich, that it is the source of much productive behavior, and that lexically specific information plays a critical and early role in the interpretation of grammatical structure. But how much information can or should be placed in the lexicon? This is the question I address here. I review a set of studies whose results indicate that event knowledge plays a significant role in early stages of sentence processing and structural analysis. This poses a conundrum for traditional views of the lexicon. Either the lexicon must be expanded to include factors that do not plausibly seem to belong there; or else virtually all information about word meaning is removed, leaving the lexicon impoverished. I suggest a third alternative, which provides a way to account for lexical knowledge without a mental lexicon.

[1]  Douglas Roland,et al.  Verb Sense and Verb Subcategorization Probabilities , 2001 .

[2]  N. Brown,et al.  Event Clusters: An Organization of Personal Events in Autobiographical Memory , 1998 .

[3]  Michael J. Spivey,et al.  The Continuity Of Mind , 2008 .

[4]  D. Lewkowicz,et al.  A dynamic systems approach to the development of cognition and action. , 2007, Journal of cognitive neuroscience.

[5]  Suzanne Stevenson,et al.  The Lexical Basis of Sentence Processing: Formal, Computational, and Experimental Issues , 2002, Computational Linguistics.

[6]  Norman Burgess,et al.  Dictionaries and Encyclopedias , 1969 .

[7]  Thomas L. Griffiths,et al.  A probabilistic approach to semantic representation , 2019, Proceedings of the Twenty-Fourth Annual Conference of the Cognitive Science Society.

[8]  K. Rayner,et al.  Making and correcting errors during sentence comprehension: Eye movements in the analysis of structurally ambiguous sentences , 1982, Cognitive Psychology.

[9]  Dana H. Ballard,et al.  Category Learning Through Multimodality Sensing , 1998, Neural Computation.

[10]  Morten H. Christiansen,et al.  Uncovering the Richness of the Stimulus: Structure Dependence and Indirect Statistical Evidence , 2005, Cogn. Sci..

[11]  Christopher T. Kello,et al.  Verb-specific constraints in sentence processing: separating effects of lexical preference from garden-paths. , 1993, Journal of experimental psychology. Learning, memory, and cognition.

[12]  M. MacDonald The interaction of lexical and syntactic ambiguity , 1993 .

[13]  B. MacWhinney,et al.  The Crosslinguistic Study of Sentence Processing. , 1992 .

[14]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[15]  Adele E. Goldberg Constructions: a new theoretical approach to language , 2003, Trends in Cognitive Sciences.

[16]  Susan M. Garnsey,et al.  Semantic Influences On Parsing: Use of Thematic Role Information in Syntactic Ambiguity Resolution , 1994 .

[17]  R. Langacker Foundations of cognitive grammar , 1983 .

[18]  Mark Steedman,et al.  The use of context by the psychological parser , 1981 .

[19]  S. Goldin-Meadow,et al.  Hearing Gesture: How Our Hands Help Us Think , 2003 .

[20]  G. Altmann,et al.  Incremental interpretation at verbs: restricting the domain of subsequent reference , 1999, Cognition.

[21]  J. Bresnan Is syntactic knowledge probabilistic ? Experiments with the English dative alternation ∗ , 2006 .

[22]  M. Engelmann The Philosophical Investigations , 2013 .

[23]  Jeffrey L. Elman,et al.  Cues, Constraints, and Competition in Sentence Processing , 2004 .

[24]  B. Ambridge,et al.  The effect of verb semantic class and verb frequency (entrenchment) on children’s and adults’ graded judgements of argument-structure overgeneralization errors , 2008, Cognition.

[25]  Michael K. Tanenhaus,et al.  Lexical structure and language comprehension , 1989 .

[26]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[27]  Noam Chomsky,et al.  वाक्यविन्यास का सैद्धान्तिक पक्ष = Aspects of the theory of syntax , 1965 .

[28]  Lyn Frazier,et al.  ON COMPREHENDING SENTENCES: SYNTACTIC PARSING STRATEGIES. , 1979 .

[29]  Jerry R. Hobbs Literature And Cognition , 1990 .

[30]  Noam Chomsky,et al.  Lectures on Government and Binding , 1981 .

[31]  M. Pickering,et al.  Plausibility and recovery from garden paths: An eye-tracking study , 1998 .

[32]  V. M. Holmes,et al.  The role of specific information about the verb in parsing sentences with local structural ambiguity , 1985 .

[33]  Gerry T. M. Altmann,et al.  Thematic role assignment in context , 1999 .

[34]  Gyöorgy Benedek,et al.  A Dynamic Systems Approach to Development: Applications , 1994, Journal of Cognitive Neuroscience.

[35]  Jeffrey L. Elman,et al.  Admitting that admitting verb sense into corpus analyses makes sense , 2004 .

[36]  M. MacDonald Lexical Representations and Sentence Processing: An Introduction , 1997 .

[37]  J. Lewis,et al.  A Connectionist Investigtion of Linguistic Arguments from the Poverty of the Stimulus: Learning the Unlearnable , 2001 .

[38]  Jeffrey L. Elman,et al.  Sense and structure: Meaning as a determinant of verb subcategorization preferences , 2003 .

[39]  S. Crain Language acquisition in the absence of experience , 1991, Behavioral and Brain Sciences.

[40]  Paul Rodríguez,et al.  Simple Recurrent Networks Learn Context-Free and Context-Sensitive Languages by Counting , 2001, Neural Computation.

[41]  M. Tomasello The item-based nature of children’s early syntactic development , 2000, Trends in Cognitive Sciences.

[42]  Michael K. Tanenhaus,et al.  Parsing in a Dynamical System: An Attractor-based Account of the Interaction of Lexical and Structural Constraints in Sentence Processing , 1997 .

[43]  Michael J. Spivey,et al.  On the Continuity of Mind: Toward a Dynamical Account of Cognition , 2004 .

[44]  Paul Rodríguez,et al.  A Recurrent Neural Network that Learns to Count , 1999, Connect. Sci..

[45]  Virginia R. de Sa,et al.  Sensory Modality Segregation , 2003, NIPS.

[46]  Jeffrey M. Zacks,et al.  Event structure in perception and conception. , 2001, Psychological bulletin.

[47]  G. Altmann,et al.  The time-course of prediction in incremental sentence processing: Evidence from anticipatory eye-movements , 2003 .

[48]  James L. McClelland,et al.  Constituent Attachment and Thematic Role Assignment in Sentence Processing: Influences of Content-Based Expectations , 1988 .

[49]  Jeffrey L. Elman,et al.  The Wind Chilled the Spectators, but the Wine Just Chilled: Sense, Structure, and Sentence Comprehension , 2009, Cogn. Sci..

[50]  Linda B. Smith,et al.  Development as a dynamic system , 1992, Trends in Cognitive Sciences.

[51]  D. McNeill Gesture and Thought , 2005 .

[52]  L. Barsalou,et al.  Multiple organisations of events in memory. , 1997, Memory.

[53]  Daniel Jurafsky,et al.  How Verb Subcategorization Frequencies Are Affected By Corpus Choice , 1998, COLING.

[54]  E. Mark Gold,et al.  Language Identification in the Limit , 1967, Inf. Control..

[55]  Roger C. Schank,et al.  Scripts, plans, goals and understanding: an inquiry into human knowledge structures , 1978 .

[56]  A. Tversky,et al.  On the psychology of prediction , 1973 .

[57]  C. Pollard,et al.  Center for the Study of Language and Information , 2022 .

[58]  Christoph Scheepers,et al.  Event-based plausibility immediately influences on-line language comprehension. , 2011, Journal of experimental psychology. Learning, memory, and cognition.

[59]  G. Schöner,et al.  Bridging the representational gap in the dynamic systems approach to development , 2003 .

[60]  David R. Dowty Thematic proto-roles and argument selection , 1991 .

[61]  G. Altmann,et al.  The real-time mediation of visual attention by language and world knowledge: Linking anticipatory (and other) eye movements to linguistic processing , 2007 .

[62]  James L. McClelland,et al.  Sentence comprehension: A parallel distributed processing approach , 1989, Language and Cognitive Processes.

[63]  Colin M. Brown,et al.  Anticipating upcoming words in discourse: evidence from ERPs and reading times. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[64]  D. McNeill Hand and Mind: What Gestures Reveal about Thought , 1992 .

[65]  Jeffrey L. Elman,et al.  Coherence and Coreference Revisited , 2007, J. Semant..

[66]  Lyn Frazier,et al.  The interaction of syntax and semantics during sentence processing: eye movements in the analysis of semantically biased sentences , 1983 .

[67]  M. Conway Cognitive models of memory , 1997 .

[68]  Curt Burgess,et al.  Modelling Parsing Constraints with High-dimensional Context Space , 1997 .

[69]  Janet Wiles,et al.  Context-free and context-sensitive dynamics in recurrent neural networks , 2000, Connect. Sci..

[70]  L Frazier,et al.  Constraint satisfaction as a theory of sentence processing , 1995, Journal of psycholinguistic research.

[71]  Ray Jackendoff,et al.  A Parallel Architecture perspective on language processing , 2007, Brain Research.

[72]  Karin Kipper Schuler,et al.  Argument Realization , 2006, Comput. Linguistics.

[73]  M. Tomasello Constructing a Language: A Usage-Based Theory of Language Acquisition , 2003 .

[74]  Marta Kutas,et al.  Verb aspect and the activation of event knowledge. , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[75]  M. Coltheart Attention and Performance XII: The Psychology of Reading , 1987 .

[76]  Tom Burr,et al.  Causation, Prediction, and Search , 2003, Technometrics.

[77]  K. McRae,et al.  Integrating Verbs, Situation Schemas, and Thematic Role Concepts , 2001 .

[78]  J. Elman,et al.  Effects of event knowledge in processing verbal arguments. , 2010, Journal of memory and language.

[79]  Paul Rodriguez,et al.  WATCHING THE TRANSIENTS : VIEWING A SIMPLE RECURRENT NETWORK AS A LIMITED COUNTER , 1999 .

[80]  Colin M. Brown,et al.  When and how do listeners relate a sentence to the wider discourse? Evidence from the N400 effect. , 2003, Brain research. Cognitive brain research.

[81]  G. Lakoff,et al.  Women, Fire, and Dangerous Things: What Categories Reveal about the Mind , 1988 .

[82]  Julie C. Sedivy,et al.  Subject Terms: Linguistics Language Eyes & eyesight Cognition & reasoning , 1995 .

[83]  John B. Black,et al.  Knowledge structures in the organization and retrieval of autobiographical memories , 1985, Cognitive Psychology.

[84]  M. Tanenhaus,et al.  Modeling the Influence of Thematic Fit (and Other Constraints) in On-line Sentence Comprehension , 1998 .

[85]  Lyn Frazier,et al.  Parsing modifiers: Special purpose routines in the human sentence processing mechanism? , 1990 .

[86]  H. H. Clark Pointing and placing. , 2003 .

[87]  A. R. Schmauder,et al.  The influence of semantic fit on on-line sentence processing , 1998, Memory & cognition.

[88]  Paul Sambre,et al.  Gilles Fauconnier & Mark Turner, " The way we think: conceptual blending and the mind's hidden complexities" , 2002 .

[89]  Marvin Minsky,et al.  A framework for representing knowledge , 1974 .

[90]  Dana H. Ballard,et al.  Principles of animate vision , 1992, CVGIP Image Underst..

[91]  Suzanne Stevenson,et al.  The Lexical Basis of Sentence Processing. , 2002 .

[92]  M. Bar,et al.  Top-down predictions in the cognitive brain , 2007, Brain and Cognition.

[93]  Christoph Scheepers,et al.  Integration of Syntactic and Semantic Information in Predictive Processing: Cross-Linguistic Evidence from German and English , 2003, Journal of psycholinguistic research.

[94]  G. Lakoff Women, fire, and dangerous things : what categories reveal about the mind , 1989 .

[95]  J. Henderson,et al.  Use of verb information in syntactic parsing: evidence from eye movements and word-by-word self-paced reading. , 1990, Journal of experimental psychology. Learning, memory, and cognition.

[96]  G. Altmann Ambiguity in sentence processing , 1998, Trends in Cognitive Sciences.

[97]  Noam Chomsky,et al.  Rules and representations , 1980, Behavioral and Brain Sciences.

[98]  Ray Jackendoff Semantics and Cognition , 1983 .

[99]  J. Elman,et al.  A basis for generating expectancies for verbs from nouns , 2005, Memory & cognition.

[100]  Barbara C. Scholz,et al.  Searching for arguments to support linguistic nativism , 2002 .

[101]  P. Holcomb,et al.  In: Understanding Events: How Humans See, Represent, and Act on Events. , 2007 .

[102]  Jerry Fodor,et al.  The lexicon and the laundromat , 2002 .

[103]  W. Kintsch The role of knowledge in discourse comprehension: a construction-integration model. , 1988, Psychological review.

[104]  Mikael Bodén,et al.  Learning the Dynamics of Embedded Clauses , 2003, Applied Intelligence.

[105]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: part 1.: an account of basic findings , 1988 .

[106]  Donald Mitchell,et al.  Lexical guidance in human parsing: Locus and processing characteristics. , 1987 .

[107]  Elizabeth Bates,et al.  On the inseparability of grammar and the lexicon: Evidence from acquisition. , 1997 .

[108]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[109]  J. Fodor,et al.  The structure of a semantic theory , 1963 .

[110]  James L. McClelland,et al.  Learning and Applying Contextual Constraints in Sentence Comprehension , 1990, Artif. Intell..

[111]  M. Baltin,et al.  The Mental representation of grammatical relations , 1985 .

[112]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[113]  Barbara C. Scholz,et al.  Empirical assessment of stimulus poverty arguments , 2002 .

[114]  Geoffrey E. Hinton,et al.  Schemata and Sequential Thought Processes in PDP Models , 1986 .

[115]  Susan M. Garnsey,et al.  The Contributions of Verb Bias and Plausibility to the Comprehension of Temporarily Ambiguous Sentences , 1997 .

[116]  S M Kennison,et al.  American English Usage Frequencies for Noun Phrase and Tensed Sentence Complement-Taking Verbs , 1999, Journal of psycholinguistic research.

[117]  M. Tomasello,et al.  Beyond nature-nurture: Essays in honor of Elizabeth Bates , 2005 .

[118]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: I. An account of basic findings. , 1981 .

[119]  G. Fauconnier Mappings in thought and language , 1997 .

[120]  Maryellen C. MacDonald,et al.  The lexical nature of syntactic ambiguity resolution , 1994 .

[121]  Daniel C. Richardson,et al.  Effects of merely local syntactic coherence on sentence processing , 2004 .

[122]  Todd R. Ferretti,et al.  Thematic Roles as Verb-specific Concepts , 1997 .

[123]  Rosemary J. Stevenson,et al.  Thematic roles, focus and the representation of events , 1994 .

[124]  M. Studdert-Kennedy Hand and Mind: What Gestures Reveal About Thought. , 1994 .

[125]  Andrew Kehler,et al.  Coherence, reference, and the theory of grammar , 2002, CSLI lecture notes series.

[126]  V. D. de Sa Category learning through multimodality sensing. , 1998, Neural computation.