Incremental syntactic tree formation in human sentence processing: A cognitive architecture based on activation decay and simulated annealing

A new cognitive architecture is proposed for the syntactic aspects of human sentence processing. The architecture, called Unification Space, is biologically inspired but not based on neural nets. Instead it relies on biosynthesis as a basic metaphor. We use simulated annealing as an optimization technique which searches for the best configuration of isolated syntactic segments or subtrees in the final parse tree. The gradually decaying activation of individual syntactic nodes determines the ‘global excitation level’ of the system. This parameter serves the function of ‘computational temperature’ in simulated annealing. We have built a computer implementation of the architecture which simulates well-known sentence understanding phenomena. We report successful simulations of the psycholinguistic effects of clause embedding, minimal attachment, right association and lexical ambiguity. In addition, we simulated impaired sentence understanding as observable in agrammatic patients. Since the Unification Space allows for contextual (semantic and pragmatic) influences on the syntactic tree formation process, it belongs to the class of interactive sentence processing models.

[1]  Jerome A. Feldman,et al.  Neural Representation of Conceptual Knowledge. , 1986 .

[2]  Jay L. Garfield,et al.  Modularity in Knowledge Representation and Natural-Language Understanding , 1987 .

[3]  Geoffrey E. Hinton,et al.  Learning and relearning in Boltzmann machines , 1986 .

[4]  Mark A. Fanty,et al.  Context-free parsing with connectionist networks , 1987 .

[5]  J. Fodor,et al.  Connectionism and cognitive architecture: A critical analysis , 1988, Cognition.

[6]  Janet D. Fodor,et al.  The sausage machine: A new two-stage parsing model , 1978, Cognition.

[7]  W D Marslen-Wilson,et al.  Sentence Perception as an Interactive Parallel Process , 1975, Science.

[8]  J. Kimball.  Seven principles of surface structure parsing in natural language , 1973 .

[9]  M. Schwartz,et al.  The word order problem in agrammatism I. Comprehension , 1980, Brain and Language.

[10]  Gerry T. M. Altmann,et al.  Ambiguity, parsing strategies, and computational models , 1988 .

[11]  Martin Kay,et al.  Parsing in functional unification grammar , 1986 .

[12]  H. Kolk,et al.  Agrammatism as a variable phenomenon , 1985 .

[13]  Lyn Frazier,et al.  The interaction of syntax and semantics during sentence processing: eye movements in the analysis of semantically biased sentences , 1983 .

[14]  Lyn Frazier,et al.  Theories of sentence processing , 1987 .

[15]  Myrna F Schwartz,et al.  The word order problem in agrammatism II. Production , 1980, Brain and Language.

[16]  G. Kempen,et al.  A dual system for producing self-repairs in spontaneous speech: Evidence from experimentally elicited corrections , 1987, Cognitive Psychology.

[17]  Gerard Kempen,et al.  An Incremental Procedural Grammar for Sentence Formulation , 1987, Cogn. Sci..

[18]  Geoffrey E. Hinton,et al.  A Distributed Connectionist Production System , 1988, Cogn. Sci..

[19]  Geoffrey E. Hinton,et al.  A Distributed Connectionist Production System , 1988, Cogn. Sci..

[20]  H. Kolk,et al.  A Computer Model of the Temporal Course of Agrammatic Sentence Understanding: The Effects of Variation in Severity and Sentence Complexity , 1991 .

[21]  K.J.M.J. De Smedt.  Incremental sentence generation: a computer model of grammatical encoding , 1990 .

[22]  Gerard Kempen,et al.  A Framework for Incremental Syntactic Tree Formation , 1987, IJCAI.

[23]  James L. McClelland,et al.  Constituent Attachment and Thematic Role Assignment in Sentence Processing: Influences of Content-Based Expectations , 1988 .

[24]  Mark Steedman,et al.  Interaction with context during human sentence processing , 1988, Cognition.

[25]  Koenraad De Smedt,et al.  Incremental Sentence Production, Self-Correction and Coordination , 1987 .

[26]  Lawrence Davis,et al.  Genetic Algorithms and Simulated Annealing , 1987 .

[27]  W. Levelt,et al.  Speaking: From Intention to Articulation , 1990 .

[28]  Jr. George N. Reeke.  Protein folding: computational approaches to an exponential-time problem , 1988 .

[29]  Zenon W. Pylyshyn,et al.  Computation and Cognition: Toward a Foundation for Cognitive Science , 1984 .