Statistical Bistratal Dependency Parsing

We present an inexact search algorithm for the problem of predicting a two-layered dependency graph. The algorithm is based on a k-best version of the standard cubic-time search algorithm for projective dependency parsing, which is used as the backbone of a beam search procedure. This allows us to handle the complex non-local feature dependencies occurring in bistratal parsing if we model the interdependency between the two layers. We apply the algorithm to the syntactic---semantic dependency parsing task of the CoNLL-2008 Shared Task, and we obtain a competitive result equal to the highest published for a system that jointly learns syntactic and semantic structure.

[1]  David A. Smith,et al.  Dependency Parsing by Belief Propagation , 2008, EMNLP.

[2]  Lucien Tesnière.  Éléments de syntaxe structurale , 1959 .

[3]  Verónica Dahl,et al.  Discontinuous grammars 1 , 2 , 1989, Comput. Intell..

[4]  Richard Johansson,et al.  The CoNLL 2008 Shared Task on Joint Parsing of Syntactic and Semantic Dependencies , 2008, CoNLL.

[5]  Ivan Titov,et al.  Online graph planarisation for synchronous parsing of semantic and syntactic dependencies , 2009, IJCAI 2009.

[6]  Petr Sgall,et al.  The Meaning Of The Sentence In Its Semantic And Pragmatic Aspects , 1986 .

[7]  Liang Huang,et al.  Forest Reranking: Discriminative Parsing with Non-Local Features , 2008, ACL.

[8]  Ralph Grishman,et al.  The NomBank Project: An Interim Report , 2004, FCP@NAACL-HLT.

[9]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[10]  Noah A. Smith,et al.  Cube Summing, Approximate Inference with Non-Local Features, and Dynamic Programming without Semirings , 2009, EACL.

[11]  Richard Johansson,et al.  Dependency-based Syntactic–Semantic Analysis with PropBank and NomBank , 2008, CoNLL.

[12]  Daniel Gildea,et al.  The Proposition Bank: An Annotated Corpus of Semantic Roles , 2005, CL.

[13]  Koby Crammer,et al.  Online Large-Margin Training of Dependency Parsers , 2005, ACL.

[14]  David Chiang,et al.  Hierarchical Phrase-Based Translation , 2007, CL.

[15]  Koby Crammer,et al.  Online Passive-Aggressive Algorithms , 2003, J. Mach. Learn. Res..

[16]  Fernando Pereira,et al.  Structured Learning with Approximate Inference , 2007, NIPS.

[17]  Beatrice Santorini,et al.  Building a Large Annotated Corpus of English: The Penn Treebank , 1993, CL.

[18]  Nianwen Xue,et al.  Calibrating Features for Semantic Role Labeling , 2004, EMNLP.

[19]  Lluís Màrquez i Villodre,et al.  A Joint Model for Parsing Syntactic and Semantic Dependencies , 2008, CoNLL.

[20]  Matthias Buch-Kromann,et al.  Discontinuous Grammar: A dependency-based model of human parsing and language learning , 2009 .

[21]  Felice Dell'Orletta,et al.  DeSRL: A Linear-Time Semantic Role Labeling System , 2008, CoNLL.

[22]  David Chiang,et al.  Better k-best Parsing , 2005, IWPT.

[23]  Daniel Gildea,et al.  Automatic Labeling of Semantic Roles , 2000, ACL.

[24]  Ivan Titov,et al.  A Latent Variable Model of Synchronous Parsing for Syntactic and Semantic Dependencies , 2008, CoNLL.

[25]  Joakim Nivre,et al.  Pseudo-Projective Dependency Parsing , 2005, ACL.

[26]  van Gerardus Noord,et al.  Proceedings of the 23rd International Conference on Computational Linguistics (COLING 2010) , 2010 .

[27]  Gert Smolka,et al.  A Relational Syntax-Semantics Interface Based on Dependency Grammar , 2004, COLING.

[28]  Christopher D. Manning,et al.  Joint Learning Improves Semantic Role Labeling , 2005, ACL.

[29]  Yongqiang Li,et al.  A Cascaded Syntactic and Semantic Dependency Parsing System , 2008, CoNLL.

[30]  Jun'ichi Tsujii,et al.  Shift-Reduce Dependency DAG Parsing , 2008, COLING.

[31]  Jason Eisner,et al.  Three New Probabilistic Models for Dependency Parsing: An Exploration , 1996, COLING.

[32]  Igor Mel’čuk,et al.  Dependency Syntax: Theory and Practice , 1987 .

[33]  Gabriele Musillo,et al.  Semantic Parsing for High-Precision Semantic Role Labelling , 2008, CoNLL.