ÚFAL MRPipe at MRP 2019: UDPipe Goes Semantic in the Meaning Representation Parsing Shared Task

We present a system description of our contribution to the CoNLL 2019 shared task, Cross-Framework Meaning Representation Parsing (MRP 2019). The proposed architecture is our first attempt towards a semantic parsing extension of the UDPipe 2.0, a lemmatization, POS tagging and dependency parsing pipeline. For the MRP 2019, which features five formally and linguistically different approaches to meaning representation (DM, PSD, EDS, UCCA and AMR), we propose a uniform, language and framework agnostic graph-to-graph neural network architecture. Without any knowledge about the graph structure, and specifically without any linguistically or framework motivated features, our system implicitly models the meaning representation graphs. After fixing a human error (we used earlier incorrect version of provided test set analyses), our submission would score third in the competition evaluation. The source code of our system is available at this https URL.

[1]  Jaime G. Carbonell,et al.  CMU at SemEval-2016 Task 8: Graph-based AMR Parsing with Infinite Ramp Loss , 2016, *SEMEVAL.

[2]  Stephan Oepen,et al.  MRP 2019: Cross-Framework Meaning Representation Parsing , 2019, CoNLL.

[3]  Stephan Oepen,et al.  In-House: An Ensemble of Pre-Existing Off-the-Shelf Parsers , 2014, SemEval@COLING.

[4]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[5]  Dan Kondratyuk,et al.  Cross Framework Meaning Representation Parsing , 2019 .

[6]  Ari Rappoport,et al.  SemEval-2019 Task 1: Cross-lingual Semantic Parsing with UCCA , 2019, *SEMEVAL.

[7]  Stephan Oepen,et al.  Discriminant-Based MRS Banking , 2006, LREC.

[8]  Min Zhang,et al.  SUDA-Alibaba at MRP 2019: Graph-Based Models with BERT , 2019, CoNLL Shared Task.

[9]  Wang Ling,et al.  Finding Function in Form: Compositional Character Models for Open Vocabulary Word Representation , 2015, EMNLP.

[10]  Stephan Oepen,et al.  Who Did What to Whom? A Contrastive Study of Syntacto-Semantic Dependencies , 2012, LAW@ACL.

[11]  Tomas Mikolov,et al.  Advances in Pre-Training Distributed Word Representations , 2017, LREC.

[12]  Alexander Koller,et al.  Saarland at MRP 2019: Compositional parsing across all graphbanks , 2019, CoNLL Shared Task.

[13]  Heidrun Guthöhrlein,et al.  [In house]. , 2011, Herz.

[14]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[15]  Ashish Agarwal,et al.  TensorFlow Eager: A Multi-Stage, Python-Embedded DSL for Machine Learning , 2019, SysML.

[16]  Philipp Koehn,et al.  Abstract Meaning Representation for Sembanking , 2013, LAW@ACL.

[17]  Ari Rappoport,et al.  Universal Conceptual Cognitive Annotation (UCCA) , 2013, ACL.

[18]  Jan Hajic,et al.  UDPipe at SIGMORPHON 2019: Contextualized Embeddings, Regularization with Morphological Categories, Corpora Merging , 2019, Proceedings of the 16th Workshop on Computational Research in Phonetics, Phonology, and Morphology.

[19]  Jonathan May,et al.  SemEval-2017 Task 9: Abstract Meaning Representation Parsing and Generation , 2017, *SEMEVAL.

[20]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[21]  Masao Utiyama,et al.  SJTU-NICT at MRP 2019: Multi-Task Learning for End-to-End Uniform Semantic Graph Parsing , 2019, CoNLL.

[22]  Yijia Liu,et al.  HIT-SCIR at MRP 2019: A Unified Pipeline for Meaning Representation Parsing via Efficient Training and Effective Encoding , 2019, CoNLL.

[23]  Nizar Habash,et al.  CoNLL 2017 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies , 2017, CoNLL.

[24]  Jan Hajic,et al.  Evaluating Contextualized Embeddings on 54 Languages in POS Tagging, Lemmatization and Dependency Parsing , 2019, ArXiv.

[25]  Marie Mikulová,et al.  Announcing Prague Czech-English Dependency Treebank 2.0 , 2012, LREC.

[26]  Kevin Duh,et al.  AMR Parsing as Sequence-to-Graph Transduction , 2019, ACL.

[27]  Dan Roth,et al.  Design Challenges and Misconceptions in Named Entity Recognition , 2009, CoNLL.

[28]  Ari Rappoport,et al.  Multitask Parsing Across Semantic Representations , 2018, ACL.

[29]  Jonathan May SemEval-2016 Task 8: Meaning Representation Parsing , 2016, SemEval@NAACL-HLT.

[30]  Milan Straka,et al.  UDPipe 2.0 Prototype at CoNLL 2018 UD Shared Task , 2018, CoNLL.