A Systematic Comparison of Syntactic Representations of Dependency Parsing

We compare the performance of a transition-based parser in regards to different annotation schemes. We propose to convert some specific syntactic constructions observed in the universal dependency treebanks into a so-called more standard representation and to evaluate parsing performances over all the languages of the project. We show that the “standard” constructions do not lead systematically to better parsing performance and that the scores vary considerably according to the languages.

[1]  Joakim Nivre,et al.  Graph Transformations in Data-Driven Dependency Parsing , 2006, ACL.

[2]  Christopher D. Manning,et al.  The Stanford Typed Dependencies Representation , 2008, CF+CDPE@COLING.

[3]  Sigrid Klerke,et al.  Down-stream effects of tree-to-dependency conversions , 2013, HLT-NAACL.

[4]  Joakim Nivre,et al.  Should Have, Would Have, Could Have. Investigating Verb Group Representations for Parsing with Universal Dependencies. , 2016, NAACL 2016.

[5]  Dan Gusfield.  Algorithms on Strings, Trees, and Sequences - Computer Science and Computational Biology , 1997 .

[6]  Roy Schwartz,et al.  Learnability-Based Syntactic Annotation Design , 2012, COLING.

[7]  Ondrej Dusek,et al.  HamleDT: Harmonized multi-language dependency treebank , 2014, Lang. Resour. Evaluation.

[8]  Joakim Nivre,et al.  An Efficient Algorithm for Projective Dependency Parsing , 2003, IWPT.

[9]  Guillaume Wisniewski,et al.  PanParser: a Modular Implementation for Efficient Transition-Based Dependency Parsing , 2018, Prague Bull. Math. Linguistics.

[10]  Joakim Nivre,et al.  Characterizing the Errors of Data-Driven Dependency Parsing Models , 2007, EMNLP.

[11]  Yuji Matsumoto,et al.  Multilingual Back-and-Forth Conversion between Content and Function Head for Easy Dependency Parsing , 2017, EACL.

[12]  Christopher D. Manning,et al.  Does Universal Dependencies need a parsing representation? An investigation of English , 2015, DepLing.

[13]  Joakim Nivre,et al.  Transition-based Dependency Parsing with Rich Non-local Features , 2011, ACL.

[14]  Veronika Laippala,et al.  Universal Dependencies 1.4 , 2015 .

[15]  Anders Søgaard,et al.  On the Derivation Perplexity of Treebanks , 2010 .