Peking at MRP 2019: Factorization- and Composition-Based Parsing for Elementary Dependency Structures

We design, implement and evaluate two semantic parsers, which represent factorizationand composition-based approaches respectively, for Elementary Dependency Structures (EDS) at the CoNLL 2019 Shared Task on Cross-Framework Meaning Representation Parsing. The detailed evaluation of the two parsers gives us a new perception about parsing into linguistically enriched meaning representations: current neural EDS parsers are able to reach an accuracy at the interannotator agreement level in the same-epochand-domain setup.

[1]  Jun'ichi Tsujii,et al.  Corpus-Oriented Grammar Development for Acquiring a Head-Driven Phrase Structure Grammar from the Penn Treebank , 2004, IJCNLP.

[2]  Mark Johnson,et al.  A constrained graph algebra for semantic parsing with AMRs , 2017, IWCS.

[3]  Yejin Choi,et al.  Neural AMR: Sequence-to-Sequence Models for Parsing and Generation , 2017, ACL.

[4]  Stephan Oepen,et al.  Towards a Catalogue of Linguistic Graph Banks , 2016, Computational Linguistics.

[5]  Weiwei Sun,et al.  Accurate SHRG-Based Semantic Parsing , 2018, ACL.

[6]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[7]  Stephan Oepen,et al.  Tokenization: Returning to a Long Solved Problem — A Survey, Contrastive Experiment, Recommendations, and Toolkit — , 2012, ACL.

[8]  Timothy Dozat,et al.  Deep Biaffine Attention for Neural Dependency Parsing , 2016, ICLR.

[9]  Joakim Nivre,et al.  Algorithms for Deterministic Incremental Dependency Parsing , 2008, CL.

[10]  Yuji Matsumoto,et al.  Statistical Dependency Analysis with Support Vector Machines , 2003, IWPT.

[11]  Peter Jonsson,et al.  Parsing to Noncrossing Dependency Graphs , 2015, Transactions of the Association for Computational Linguistics.

[12]  Chuan Wang,et al.  A Transition-based Algorithm for AMR Parsing , 2015, NAACL.

[13]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[14]  Weiwei Sun,et al.  A Comparative Analysis of Knowledge-Intensive and Data-Intensive Semantic Parsers , 2019, ArXiv.

[15]  Richard S. Zemel,et al.  Gated Graph Sequence Neural Networks , 2015, ICLR.

[16]  Giorgio Satta,et al.  Sequence-to-sequence Models for Cache Transition Systems , 2018, ACL.

[17]  FlickingerDan.  On building a more efficient grammar by exploiting types , 2000 .

[18]  Weiwei Sun,et al.  Transition-Based Parsing for Deep Dependency Structures , 2016, CL.

[19]  Luke S. Zettlemoyer,et al.  Deep Contextualized Word Representations , 2018, NAACL.

[20]  Annegret Habel,et al.  Hyperedge Replacement, Graph Grammars , 1997, Handbook of Graph Grammars.

[21]  Xiaochang Peng,et al.  Addressing the Data Sparsity Issue in Neural AMR Parsing , 2017, EACL.

[22]  Emily M. Bender,et al.  Towards an Encyclopedia of Compositional Semantics: Documenting the Interface of the English Resource Grammar , 2014, LREC.

[23]  Yue Zhang,et al.  A Graph-to-Sequence Model for AMR-to-Text Generation , 2018, ACL.

[24]  Beatrice Santorini,et al.  Building a Large Annotated Corpus of English: The Penn Treebank , 1993, CL.

[25]  Emily M. Bender,et al.  Layers of Interpretation: On Grammar and Compositionality , 2015, IWCS.

[26]  Phil Blunsom,et al.  Robust Incremental Neural Semantic Graph Parsing , 2017, ACL.

[27]  Noah A. Smith,et al.  Deep Multitask Learning for Semantic Dependency Parsing , 2017, ACL.

[28]  Jun'ichi Tsujii,et al.  Shift-Reduce Dependency DAG Parsing , 2008, COLING.

[29]  Timothy Dozat,et al.  Simpler but More Accurate Semantic Dependency Parsing , 2018, ACL.

[30]  Cao Xiao,et al.  FastGCN: Fast Learning with Graph Convolutional Networks via Importance Sampling , 2018, ICLR.

[31]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[32]  Weiwei Sun,et al.  Graph-Based Meaning Representations: Design and Processing , 2019, ACL.

[33]  Giorgio Satta,et al.  Cache Transition Systems for Graph Parsing , 2017, Computational Linguistics.

[34]  Weiwei Sun.  Word-based and Character-based Word Segmentation Models: Comparison and Combination , 2010, COLING.

[35]  Sheng Zhang,et al.  Cross-lingual Decompositional Semantic Parsing , 2018, EMNLP.

[36]  Mark Johnson,et al.  AMR dependency parsing with a typed semantic algebra , 2018, ACL.

[37]  Alexander Koller,et al.  Compositional Semantic Parsing across Graphbanks , 2019, ACL.

[38]  Fernando Pereira,et al.  Discriminative learning and spanning tree algorithms for dependency parsing , 2006 .

[39]  Weiwei Sun,et al.  Parsing Chinese Sentences with Grammatical Relations , 2019, CL.

[40]  Stephan Oepen,et al.  Discriminant-Based MRS Banking , 2006, LREC.

[41]  Grzegorz Rozenberg,et al.  Handbook of Graph Grammars and Computing by Graph Transformations, Volume 1: Foundations , 1997 .

[42]  Dan Klein,et al.  Constituency Parsing with a Self-Attentive Encoder , 2018, ACL.

[43]  Fernando Pereira,et al.  Online Learning of Approximate Dependency Parsing Algorithms , 2006, EACL.