This paper describes results of the first successful effort in applying a stochastic strategy – or, namely, a second order Markov model paradigm implemented by the TnT trigram tagger – to morphosyntactic tagging of Croatian texts. Beside the tagger, for purposes of both training and testing, we had at our disposal only a 100 Kw Croatia Weekly newspaper subcorpus, manually tagged using approximately 1000 different MULTEXT-East v3 morphosyntactic tags. The test basically consisted of randomly assigning a variablesize portion of the corpus for the tagger’ s training procedure and also another fixed-size portion, sized at 10% of the corpus, for the tagging procedure itself ; this method allowed us not only to provide preliminary results regarding tagger accuracy on Croatian texts, but also to inspect the behavior of the stochastic tagging paradigm in general. The results were then taken from the test case providing 90% of the corpus for training purposes and varied from around 86% in the worst case scenario up to a peak of around 95% correctly assigned full MSD tags. Results on PoS only expectedly reached the human error level, with TnT correctly tagging above 98% of test sets on average. Most MSD errors occurred on types with the highest number of candidate tags per word form – nouns, pronouns and adjectives – while errors on PoS, although following the same pattern, were almost insignificant. Detailed insight on tagging, F-measure for all PoS categories is provided in the course of the paper along with other facts of interest.
[1]
Jan Hajic,et al.
Morphological Tagging: Data vs. Dictionaries
,
2000,
ANLP.
[2]
Alexander Dekhtyar,et al.
Information Retrieval
,
2018,
Lecture Notes in Computer Science.
[3]
Walter Daelemans,et al.
Improving Accuracy in word class tagging through the Combination of Machine Learning Systems
,
2001,
CL.
[4]
Eric Brill,et al.
Transformation-Based Error-Driven Learning and Natural Language Processing: A Case Study in Part-of-Speech Tagging
,
1995,
CL.
[5]
Jakub Zavrel,et al.
Morphosyntactic Tagging of Slovene: Evaluating Taggers and Tagsets
,
2000,
LREC.
[6]
Marko Tadić,et al.
Building the Croatian Morphological Lexicon
,
2003
.
[7]
Marko Tadic.
Building the Croatian-English Parallel Corpus
,
2000,
LREC.
[8]
Thorsten Brants,et al.
TnT – A Statistical Part-of-Speech Tagger
,
2000,
ANLP.
[9]
Bertus van Rooy,et al.
An evaluation of three POS taggers for the tagging of the Tswana Learner English Corpus
,
2003
.