Because Syntax Does Matter: Improving Predicate-Argument Structures Parsing with Syntactic Features

Parsing full-fledged predicate-argument structures in a deep syntax framework requires graphs to be predicted. Using the DeepBank (Flickinger et al., 2012) and the Predicate-Argument Structure treebank (Miyao and Tsujii, 2005) as a test field, we show how transition-based parsers, extended to handle connected graphs, benefit from the use of topologically different syntactic features such as dependencies, tree fragments, spines or syntactic paths, bringing a much needed context to the parsing models, improving notably over long distance dependencies and elided coordinate structures. By confirming this positive impact on an accurate 2nd-order graph-based parser (Martins and Almeida, 2014), we establish a new state-of-the-art on these data sets.

[1]  Éric Villemonte de la Clergerie,et al.  Exploring beam-based shift-reduce dependency parsing with DyALog: Results from the SPMRL 2013 shared task , 2013, SPMRL@EMNLP.

[2]  Dan Klein,et al.  An Empirical Investigation of Statistical Significance in NLP , 2012, EMNLP.

[3]  Daniel Gildea,et al.  The Proposition Bank: An Annotated Corpus of Semantic Roles , 2005, CL.

[4]  Weiwei Sun,et al.  Peking: Profiling Syntactic Tree Parsing Techniques for Semantic Graph Parsing , 2014, SemEval@COLING.

[5]  Noah A. Smith,et al.  Dependency Parsing , 2009, Encyclopedia of Artificial Intelligence.

[6]  Yang Guo,et al.  Structured Perceptron with Inexact Search , 2012, NAACL.

[7]  Daniel M. Bikel,et al.  Design of a multi-lingual, parallel-processing statistical parsing engine , 2002 .

[8]  Stephan Oepen,et al.  Discriminant-Based MRS Banking , 2006, LREC.

[9]  Djamé Seddah,et al.  Exploring the Spinal-STIG Model for Parsing French , 2010, LREC.

[10]  Kenji Sagae,et al.  Analysis of Discourse Structure with Syntactic Dependencies and Data-Driven Shift-Reduce Parsing , 2009, IWPT.

[11]  Martha Palmer,et al.  Can Semantic Roles Generalize Across Genres? , 2007, NAACL.

[12]  Owen Rambow,et al.  Use of Deep Linguistic Features for the Recognition and Labeling of Semantic Arguments , 2003, EMNLP.

[13]  Jun'ichi Tsujii,et al.  Towards efficient probabilistic HPSG parsing: integrating semantic and syntactic preference to gu , 2004 .

[14]  Jaime G. Carbonell,et al.  A Discriminative Graph-Based Parser for the Abstract Meaning Representation , 2014, ACL.

[15]  Stephan Oepen,et al.  SemEval 2014 Task 8: Broad-Coverage Semantic Dependency Parsing , 2014, *SEMEVAL.

[16]  Eugene Charniak,et al.  A Maximum-Entropy-Inspired Parser , 2000, ANLP.

[17]  Jun'ichi Tsujii,et al.  Shift-Reduce Dependency DAG Parsing , 2008, COLING.

[18]  Jun'ichi Tsujii,et al.  Deep Linguistic Analysis for the Accurate Identification of Predicate-Argument Relations , 2004, COLING.

[19]  Leo Wanner,et al.  Deep-Syntactic Parsing , 2014, COLING.

[20]  Joakim Nivre,et al.  Pseudo-Projective Dependency Parsing , 2005, ACL.

[21]  Julia Hockenmaier,et al.  Data and models for statistical parsing with combinatory categorial grammar , 2003 .

[22]  Noah A. Smith,et al.  Frame-Semantic Parsing , 2014, CL.

[23]  Markham J. Geller.  Who Did What to Whom , 2010 .

[24]  Beatrice Santorini,et al.  Building a Large Annotated Corpus of English: The Penn Treebank , 1993, CL.

[25]  Joakim Nivre,et al.  An Efficient Algorithm for Projective Dependency Parsing , 2003, IWPT.

[26]  Ralph Grishman,et al.  Annotating Noun Argument Structure for NomBank , 2004, LREC.

[27]  Yoav Goldberg,et al.  Efficient Implementation of Beam-Search Incremental Parsers , 2013, ACL.

[28]  Joakim Nivre,et al.  Characterizing the Errors of Data-Driven Dependency Parsing Models , 2007, EMNLP.

[29]  Yoav Freund,et al.  Large Margin Classification Using the Perceptron Algorithm , 1998, COLT' 98.

[30]  Jun'ichi Tsujii,et al.  Probabilistic Disambiguation Models for Wide-Coverage HPSG Parsing , 2005, ACL.

[31]  Christopher D. Manning,et al.  Joint Learning Improves Semantic Role Labeling , 2005, ACL.

[32]  Dan Flickinger,et al.  Translation using Minimal Recursion Semantics , 1995, TMI.

[33]  Bernd Bohnet,et al.  Very high accuracy and fast dependency parsing is not a contradiction , 2010, COLING 2010.

[34]  Ivan Titov,et al.  A Latent Variable Model of Synchronous Parsing for Syntactic and Semantic Dependencies , 2008, CoNLL.

[35]  Yoav Freund,et al.  Large Margin Classification Using the Perceptron Algorithm , 1998, COLT.

[36]  Richard Johansson,et al.  The CoNLL-2009 Shared Task: Syntactic and Semantic Dependencies in Multiple Languages , 2009, CoNLL Shared Task.

[37]  Stephan Oepen,et al.  Who Did What to Whom? A Contrastive Study of Syntacto-Semantic Dependencies , 2012, LAW@ACL.

[38]  Dan Klein,et al.  Learning Accurate, Compact, and Interpretable Tree Annotation , 2006, ACL.

[39]  Dan Flickinger,et al.  Minimal Recursion Semantics: An Introduction , 2005 .

[40]  Brendan T. O'Connor,et al.  CMU: Arc-Factored, Discriminative Semantic Dependency Parsing , 2014, SemEval@COLING.

[41]  Michael Collins,et al.  Discriminative Training Methods for Hidden Markov Models: Theory and Experiments with Perceptron Algorithms , 2002, EMNLP.

[42]  Wolfgang Seeker,et al.  (Re)ranking Meets Morphosyntax: State-of-the-art Results from the SPMRL 2013 Shared Task , 2013, SPMRL@EMNLP.

[43]  Roberto Basili,et al.  Tree Kernels for Semantic Role Labeling , 2008, CL.

[44]  André F. T. Martins,et al.  Priberam: A Turbo Semantic Parser with Second Order Features , 2014, *SEMEVAL.

[45]  Andy Way,et al.  Long-Distance Dependency Resolution in Automatically Acquired Wide-Coverage PCFG-Based LFG Approximations , 2004, ACL.

[46]  Xavier Carreras,et al.  Introduction to the CoNLL-2005 Shared Task: Semantic Role Labeling , 2005, CoNLL.

[47]  Richard Johansson,et al.  The CoNLL 2008 Shared Task on Joint Parsing of Syntactic and Semantic Dependencies , 2008, CoNLL.