论文信息 - SIMPLE RULES MALAY STEMMER

SIMPLE RULES MALAY STEMMER

Stemming is a morphological analysis that tries to associate variants of the same term with a common root form. It is important to improve recall and precision in IR systems. Malay word stemming is considered complicated compared with other languages because of its unique morphological structure. Many research in Malay stemming relies heavily on dictionary which needs higher processing cost and offers lower coverage. This paper presents a stemming approach called UniSZA stemmer which attempts to reduce dictionary dependencies and lower the processing cost by proposing 7 simple rules. Experimental results show that the approach produces higher compression ratio and processing speed compared to RAO and RFO methods.

Syed Abdullah Fadzli

[1] Tengku M. T. Sembok. Character Strings to Natural Language Processing in Information Retrieval , 2003, ICADL.

[2] Tengku Mohd Tengku Sembok. Word Stemming Algorithms and Retrieval Effectiveness in Malay and Arabic Documents Retrieval Systems , 2007 .

[3] Tengku Mohd Tengku Sembok,et al. Rules Frequency Order Stemmer for Malay Language , 2009 .

[4] Martin F. Porter,et al. An algorithm for suffix stripping , 1997, Program.

[5] Stephen F. Weiss,et al. Word segmentation by letter successor varieties , 1974, Inf. Storage Retr..

[6] Muhamad Taufik Abdullah. Sistem Bantuan Pembinaan Kamus Berasaskan Pangkalan Data Teks Bebas , 1992 .

[7] Julie Beth Lovins,et al. Development of a stemming algorithm , 1968, Mech. Transl. Comput. Linguistics.

[8] Donna K. Harman,et al. How effective is suffixing? , 1991, J. Am. Soc. Inf. Sci..

[9] Tengku Mohd Tengku Sembok,et al. Experiments with a stemming algorithm for Malay words , 1996 .

[10] Zainab Abu Bakar,et al. Characteristics and retrieval effectiveness of n-gram string similarity matching on Malay documents , 2011 .

[11] Peter Willett,et al. An evaluation of some conflation algorithms for information retrieval , 1981 .

[12] Zainab Abu Bakar,et al. Experiments in malay information retrieval , 2011, Proceedings of the 2011 International Conference on Electrical Engineering and Informatics.