Stochastically Evaluating the Validity of Partial Parse Trees in Incremental Parsing

This paper proposes a method for evaluating the validity of partial parse trees constructed in incremental parsing. Our method is based on stochastic incremental parsing, and it incrementally evaluates the validity for each partial parse tree on a word-by-word basis. In our method, incremental parser returns partial parse trees at the point where the validity for the partial parse tree becomes greater than a threshold. Our technique is effective for improving the accuracy of incremental parsing.

[1]  Aravind K. Joshi,et al.  Natural language parsing: Tree adjoining grammars: How much context-sensitivity is required to provide reasonable structural descriptions? , 1985 .

[2]  Robin Cooper,et al.  Incremental Interpretation: Applications, Theory, And Relationship To Dynamic Semantics , 1994, COLING.

[3]  Vincenzo Lombardo,et al.  Incremental processing and infinite local ambiguity , 1997 .

[4]  Brian Roark,et al.  Efficient probabilistic top-down and left-corner parsing , 1999, ACL.

[5]  K. Vijay-Shanker,et al.  Automated Extraction of TAGs from the Penn Treebank , 2000, IWPT.

[6]  David Milward Incremental Interpretation of Categorial Grammar , 1995, EACL.

[7]  Brian Roark,et al.  Probabilistic Top-Down Parsing and Language Modeling , 2001, CL.

[8]  Beatrice Santorini,et al.  Building a Large Annotated Corpus of English: The Penn Treebank , 1993, CL.

[9]  Yasuyoshi Inagaki,et al.  Spoken language parsing based on incremental disambiguation , 2000, INTERSPEECH.

[10]  Nicholas J. Haddock,et al.  Incremental Interpretation and Combinatory Categorial Grammar , 1987, IJCAI.

[11]  James F. Allen,et al.  An architecture for more realistic conversational systems , 2001, IUI '01.

[12]  Giovanni Soda,et al.  Wide Coverage Incremental Parsing by Learning Attachment Preferences , 2001, AI*IA.

[13]  Mitchell P. Marcus,et al.  A theory of syntactic recognition for natural language , 1979 .

[14]  David Chiang,et al.  Statistical Parsing with an Automatically-Extracted Tree Adjoining Grammar , 2000, ACL.