Graph-Based Dependency Parsing Using Dynamic Features in Korean

In this paper, we propose a graph-based dependency parsing model using dynamic features. The dynamic features, which are derived from the partial tree during bottom-up chart parsing, play an important role in finding the correct heads. Based on the beneficial aspects of the head-final property of Korean, we suggest a variant of the CYK parsing algorithm with an O(n3) complexity which has the ability to search for the maximum spanning tree (MST) from all projective trees. Compared to Eisner's algorithm, this algorithm is time-efficient in parsing all other head-final languages. We also explain why the graph-based approaches are seldom attempted in parsing morphologically rich languages (MRLs) and suggest a morpheme-level dependency representation as a solution. Finally, we evaluate the proposed method on the KAIST corpus using two discriminative online learning methods (the averaged perceptron algorithm and passive-aggressive algorithm) and show that the trained parser achieves the best reported parsing ac...

[1]  Yuji Matsumoto,et al.  Japanese Dependency Analysis using Cascaded Chunking , 2002, CoNLL.

[2]  Hoojung Chung,et al.  Statistical Korean dependency parsing model based on the surface contextual information , 2004 .

[3]  Joakim Nivre,et al.  Non-Projective Dependency Parsing in Expected Linear Time , 2009, ACL.

[4]  Joakim Nivre,et al.  Integrating Graph-Based and Transition-Based Dependency Parsers , 2008, ACL.

[5]  Stephen Clark,et al.  A Tale of Two Parsers: Investigating and Combining Graph-based and Transition-based Dependency Parsing , 2008, EMNLP.

[6]  Yuji Matsumoto,et al.  Japanese Dependency Parsing Using a Tournament Model , 2008, COLING 2008.

[7]  Sebastian Riedel,et al.  The CoNLL 2007 Shared Task on Dependency Parsing , 2007, EMNLP.

[8]  Xavier Carreras,et al.  Experiments with a Higher-Order Projective Dependency Parser , 2007, EMNLP.

[9]  Joakim Nivre,et al.  Dependency Parsing , 2009, Lang. Linguistics Compass.

[10]  Eric P. Xing,et al.  Stacking Dependency Parsers , 2008, EMNLP.

[11]  Sabine Buchholz,et al.  CoNLL-X Shared Task on Multilingual Dependency Parsing , 2006, CoNLL.

[12]  Akira Shimazu,et al.  A Multilingual Dependency Analysis System Using Online Passive-Aggressive Learning , 2007, EMNLP-CoNLL.

[13]  Yuji Matsumoto,et al.  Statistical Dependency Analysis with Support Vector Machines , 2003, IWPT.

[14]  Michael Collins,et al.  Efficient Third-Order Dependency Parsers , 2010, ACL.

[15]  Fernando Pereira,et al.  Online Learning of Approximate Dependency Parsing Algorithms , 2006, EACL.

[16]  Xavier Carreras,et al.  Simple Semi-supervised Dependency Parsing , 2008, ACL.

[17]  Jason Eisner,et al.  Three New Probabilistic Models for Dependency Parsing: An Exploration , 1996, COLING.

[18]  Hitoshi Isahara,et al.  Backward Beam Search Algorithm for Dependency Analysis of Japanese , 2000, COLING.

[19]  Koby Crammer,et al.  Online Passive-Aggressive Algorithms , 2003, J. Mach. Learn. Res..

[20]  Yuji Matsumoto,et al.  Japanese Dependency Structure Analysis Based on Support Vector Machines , 2000, EMNLP.

[21]  Joakim Nivre,et al.  An Efficient Algorithm for Projective Dependency Parsing , 2003, IWPT.

[22]  Fernando Pereira,et al.  Non-Projective Dependency Parsing using Spanning Tree Algorithms , 2005, HLT.

[23]  Manabu Sassano,et al.  Linear-Time Dependency Analysis for Japanese , 2004, COLING.

[24]  Michael Collins,et al.  Discriminative Training Methods for Hidden Markov Models: Theory and Experiments with Perceptron Algorithms , 2002, EMNLP.

[25]  Y. Singer,et al.  Ultraconservative online algorithms for multiclass problems , 2003 .

[26]  Yannick Versley,et al.  Statistical Parsing of Morphologically Rich Languages (SPMRL) What, How and Whither , 2010, SPMRL@NAACL-HLT.

[27]  Joakim Nivre,et al.  Pseudo-Projective Dependency Parsing , 2005, ACL.

[28]  Kemal Oflazer,et al.  Dependency Parsing of Turkish , 2008, CL.

[29]  Koby Crammer,et al.  Online Large-Margin Training of Dependency Parsers , 2005, ACL.