A Bottom-Up Parsing Model of Local Coherence Effects

Human sentence processing occurs incrementally. Most models of human processing rely on parsers that always build connected tree structures. But according to the theory of Good Enough parsing (Ferreira & Patson, 2007), humans parse sentences using small chunks of local information, not always forming a globally coherent parse. This difference is apparent in the study of local coherence effects (Tabor, Galantucci, & Richardson, 2004), wherein a locally plausible interpretation interferes with the correct global interpretation of a sentence. We present a model that accounts for these effects using a wide-coverage parser that captures the idea of Good Enough parsing. Using Combinatory Categorial Grammar, our parser works bottom-up, enforcing the use of local information only. We model the difficulty of processing a sentence in terms of the probability of a locally coherent reading relative to the probability of the globally coherent reading of the sentence. Our model successfully predicts psycholinguistic results.

[1]  Daniel Jurafsky,et al.  A Probabilistic Model of Lexical and Syntactic Access and Disambiguation , 1996, Cogn. Sci..

[2]  P. Frasconi,et al.  Learning first-pass structural attachment preferences with dynamic grammars and recursive neural networks , 2003, Cognition.

[3]  Frank Keller,et al.  A Psycholinguistically Motivated Version of TAG , 2008, TAG.

[4]  Ted Briscoe,et al.  The Second Release of the RASP System , 2006, ACL.

[5]  Fernanda Ferreira,et al.  The 'Good Enough' Approach to Language Comprehension , 2007, Lang. Linguistics Compass.

[6]  Fernanda Ferreira,et al.  The misinterpretation of noncanonical sentences , 2003, Cognitive Psychology.

[7]  Martin Kay,et al.  Syntactic Process , 1979, ACL.

[8]  C. Clifton,et al.  The independence of syntactic processing , 1986 .

[9]  Brian Roark,et al.  Probabilistic Top-Down Parsing and Language Modeling , 2001, CL.

[10]  Johan Bos,et al.  Linguistically Motivated Large-Scale NLP with C&C and Boxer , 2007, ACL.

[11]  Roger Levy,et al.  A model of local coherence effects in human sentence processing as consequences of updates from bottom-up prior to posterior beliefs , 2009, NAACL.

[12]  Christos Christodoulopoulos.  Creating a Natural Logic Inference System with Combinatory Categorial Grammar , 2008 .

[13]  Daniel C. Richardson,et al.  Effects of merely local syntactic coherence on sentence processing , 2004 .

[14]  Roger Levy,et al.  A noisy-channel model of rational human sentence comprehension under uncertain input , 2008, EMNLP 2008.

[15]  Julia Hockenmaier,et al.  Data and models for statistical parsing with combinatory categorial grammar , 2003 .