Uyghur stemming using conditional random fields

Stemming is a natural language processing task that to remove all derivational affixes from a word. This task proved to be harder for languages with complex morphology such as the Uyghur language. This paper presents a new stemming method for Uyghur words based on CRFs (Conditional Random Fields). In the proposed method all words in the training corpus are segmented into syllables and each syllable are tagged as a part of stem or as a part of affix. We experimentally evaluated this method with five test files each includes 100 sentences , results have shown that our method gets good performance, average stemming precision, recall and F-score in open test reached 98.42%, 98.34% and 98.38% respectively.