Parsing in a Dynamical System: An Attractor-based Account of the Interaction of Lexical and Structural Constraints in Sentence Processing

A dynamical systems approach to parsing is proposed in which syntactic hypotheses are associated with attractors in a metric space. These attractors have many of the properties of traditional syntactic categories, while at the same time encoding context-dependent, lexically specie c distinctions. Hypotheses motivated by the dynamical system theory were tested in four reading time experiments examining the interaction of simple lexica l frequencies, frequencies that are contingent on an environment deened by syntactic categories, and frequencies contingent on verb argument structure. The experiments documented a variety of contingent frequency effects that cut across traditional linguistic grains, each of which was predicted by the dynamical systems model. These effects were simulated in an implementation of the theory, employing a recurrent network trained from a corpus to construct metric representations and an algorithm implementing a gravitational dynamical system to model reading time as time to gravitate to an attractor.

[1]  A. H. Kawamoto.  Nonlinear dynamics in the resolution of lexical ambiguity: A parallel distributed processing account. , 1993 .

[2]  M. Tanenhaus,et al.  Context effects in syntactic ambiguity resolution: discourse and semantic influences in parsing reduced relative clauses. , 1993, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[3]  M K Tanenhaus,et al.  A constraint-based lexicalist account of the subject/object attachment preference , 1994, Journal of psycholinguistic research.

[4]  B. MacWhinney,et al.  The Crosslinguistic Study of Sentence Processing. , 1992 .

[5]  Susan M. Garnsey,et al.  Evidence for the immediate use of verb control information in sentence processing , 1990 .

[6]  K. Rayner,et al.  Making and correcting errors during sentence comprehension: Eye movements in the analysis of structurally ambiguous sentences , 1982, Cognitive Psychology.

[7]  Bradley L. Pritchett.  Grammatical Competence and Parsing Performance , 1992 .

[8]  Fernando J. Pineda.  Recurrent backpropagation networks , 1995 .

[9]  Christopher T. Kello,et al.  Verb-specific constraints in sentence processing: separating effects of lexical preference from garden-paths. , 1993, Journal of experimental psychology. Learning, memory, and cognition.

[10]  D C Plaut,et al.  Simulating brain damage. , 1993, Scientific American.

[11]  Yves Chauvin,et al.  Backpropagation: theory, architectures, and applications , 1995 .

[12]  Lyn Frazier,et al.  Against lexical generation of syntax , 1989 .

[13]  L. Perko.  Differential Equations and Dynamical Systems , 1991 .

[14]  Geoffrey E. Hinton,et al.  Lesioning an attractor network: investigations of acquired dyslexia. , 1991, Psychological review.

[15]  J. Elman.  Learning and development in neural networks: the importance of starting small , 1993, Cognition.

[16]  M. Tanenhaus,et al.  Verb-specific constraints in sentence processing: Separating effects of lexical preference from garden-paths. , 1993 .

[17]  Marc Brysbaert,et al.  Exposure-based models of human parsing: Evidence for the use of coarse-grained (nonlexical) statistical records , 1995 .

[18]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[19]  Michael K. Tanenhaus,et al.  Integrating discourse and local constraints in resolving lexical thematic ambiguities , 1996 .

[20]  W. Nelson Francis,et al.  FREQUENCY ANALYSIS OF ENGLISH USAGE: LEXICON AND GRAMMAR , 1983 .

[21]  Jay L. Garfield,et al.  Modularity in Knowledge Representation and Natural-Language Understanding , 1987 .

[22]  Eugene Charniak,et al.  Statistical language learning , 1997 .

[23]  J. Woolley,et al.  Paradigms and processes in reading comprehension. , 1982, Journal of experimental psychology. General.

[24]  B. MacWhinney,et al.  Functionalism and the competition model , 1989 .

[25]  Beatrice Santorini,et al.  Building a Large Annotated Corpus of English: The Penn Treebank , 1993, CL.

[26]  Yuen Ren Chao,et al.  Human Behavior and the Principle of Least Effort: An Introduction to Human Ecology , 1950 .

[27]  J. Hayes.  Cognition and the development of language , 1970 .

[28]  Michael J. Spivey,et al.  Syntactic ambiguity resolution in discourse: modeling the effects of referential context and lexical frequency. , 1998, Journal of experimental psychology. Learning, memory, and cognition.

[29]  James L. McClelland,et al.  Understanding normal and impaired word reading: computational principles in quasi-regular domains. , 1996, Psychological review.

[30]  Julie C. Sedivy,et al.  Resolving attachment ambiguities with multiple constraints , 1995, Cognition.

[31]  Brian MacWhinney,et al.  Functional constraints on sentence processing: A cross-linguistic study , 1982, Cognition.

[32]  Robert L. Mercer,et al.  Class-Based n-gram Models of Natural Language , 1992, CL.

[33]  Cynthia Fisher,et al.  On the semantic content of subcategorization frames , 1991, Cognitive Psychology.

[34]  Maryellen C. MacDonald,et al.  The lexical nature of syntactic ambiguity resolution , 1994 .

[35]  Barak A. Pearlmutter.  Gradient calculations for dynamic recurrent neural networks: a survey , 1995, IEEE Trans. Neural Networks.

[36]  Daniel Jurafsky,et al.  A Probabilistic Model of Lexical and Syntactic Access and Disambiguation , 1996, Cogn. Sci..

[37]  Whitney Tabor,et al.  Lexical Change as Nonlinear Interpolation , 1995 .

[38]  J. Trueswell.  THE ROLE OF LEXICAL FREQUENCY IN SYNTACTIC AMBIGUITY RESOLUTION , 1996 .

[39]  Don C. Mitchell,et al.  Verb guidance and other lexical effects in parsing , 1989 .

[40]  John C. Trueswell,et al.  Chapter 7 – Sentence Comprehension , 1995 .

[41]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[42]  Susan M. Garnsey,et al.  Semantic Influences On Parsing: Use of Thematic Role Information in Syntactic Ambiguity Resolution , 1994 .

[43]  J. Henderson,et al.  Use of verb information in syntactic parsing: evidence from eye movements and word-by-word self-paced reading. , 1990, Journal of experimental psychology. Learning, memory, and cognition.

[44]  William D. Marslen-Wilson,et al.  Lexical Representation and Process , 1991 .

[45]  R. Abraham,et al.  Dynamics--the geometry of behavior , 1983 .

[46]  Geoffrey E. Hinton,et al.  Lesioning an attractor network: investigations of acquired dyslexia , 1991 .