论文信息 - Automated Paradigm Selection for FSA based Konkani Verb Morphological Analyzer

Automated Paradigm Selection for FSA based Konkani Verb Morphological Analyzer

A Morphological Analyzer is a crucial tool for any language. In popular tools used to build morphological analyzers like XFST, HFST and Apertium’s lttoolbox, the finite state approach is used to sequence input characters. We have used the finite state approach to sequence morphemes instead of characters. In this paper we present the architecture and implementation details of a Corpus assisted FSA approach for build ing a Verb Morphological Analyzer. Our main contribution in this paper is the paradigm def inition methodology used for the verbs in a morphologically rich Indian Language Konkani. The mapping of citation form of the verbs to paradigms was carried out using an untagged corpus for Konkani. Besides a reduction in human effort required an F-Score of 0.95 was obtained whe n the mapping was tested on a tagged corpus.

[1] Markus Forsberg,et al. Functional morphology , 2004, ICFP '04.

[2] Lars Borin,et al. Unsupervised Learning of Morphology , 2011, CL.

[3] Z. Harris. From Phoneme to Morpheme , 1955 .

[4] Amba Kulkarni,et al. Building Morphological Analysers and Generators for Indian Languages using FST , 2010 .

[5] John Goldsmith,et al. Learning Phonological Categories , 2009 .

[6] Krister Lindén,et al. Corpus-based Paradigm Selection for Morphological Entries , 2009, NODALIDA.

[7] John A. Goldsmith,et al. Unsupervised Learning of the Morphology of a Natural Language , 2001, CL.

[8] Dayne Freitag,et al. Morphology Induction from Term Clusters , 2005, CoNLL.

[9] David Yarowsky,et al. Modeling and learning multilingual inflectional morphology in a minimally supervised framework , 2003 .

[10] Víctor M. Sánchez-Cartagena,et al. Choosing the correct paradigm for unknown words in rule-based machine translation systems , 2012 .

[11] Yu Hu,et al. Exploring variant definitions of pointer length in MDL , 2006, SIGMORPHON.

[12] James H. Martin,et al. Speech and language processing: an introduction to natural language processing, computational linguistics, and speech recognition, 2nd Edition , 2000, Prentice Hall series in artificial intelligence.

[13] GoldsmithJohn. Unsupervised learning of the morphology of a natural language , 2001 .

[14] Markus Forsberg,et al. Morphological Lexicon Extraction from Raw Text Data , 2006, FinTAL.