论文信息 - Building a Large Syntactically-Annotated Corpus of Vietnamese

Building a Large Syntactically-Annotated Corpus of Vietnamese

Treebank is an important resource for both research and application of natural language processing. For Vietnamese, we still lack such kind of corpora. This paper presents up-to-date results of a project for Vietnamese treebank construction. Since Vietnamese is an isolating language and has no word delimiter, there are many ambiguities in sentence analysis. We systematically applied a lot of linguistic techniques to handle such ambiguities. Annotators are supported by automatic-labeling tools and a tree-editor tool. Raw texts are extracted from Tuoi Tre (Youth), an online Vietnamese daily newspaper. The current annotation agreement is around 90 percent.

Phuong-Thai Nguyen | Hong Phuong Le | Nguyên Thi Minh Huyên | Van Hiep Nguyen | Xuân Luong Vu

[1] Sophia Ananiadou,et al. On the definition of word , 2004, Machine Translation.

[2] David Chiang,et al. Recovering Latent Information in Treebanks , 2002, COLING.

[3] E. Williams,et al. On the definition of word , 1987 .

[4] Ủy ban khoa học xã hội Việt Nam. Ngữ pháp tiếng Việt , 1983 .

[5] Adam L. Berger,et al. A Maximum Entropy Approach to Natural Language Processing , 1996, CL.

[6] Xuân Hạo Cao. Tiếng Việt : sơ thảo ngữ pháp chức năng , 1991 .

[7] Michael Collins,et al. Head-Driven Statistical Models for Natural Language Parsing , 2003, CL.

[8] Hô Tuòng Vinh,et al. A Hybrid Approach to Word Segmentation of Vietnamese Texts , 2008, LATA.

[9] Andrew McCallum,et al. Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[10] Nianwen Xue,et al. Developing Guidelines and Ensuring Consistency for Chinese Text Annotation , 2000, LREC.

[11] Beatrice Santorini,et al. Building a Large Annotated Corpus of English: The Penn Treebank , 1993, CL.