Effect of ISRI Stemming on Similarity Measure for Arabic Document Clustering

Arabic Document Clustering has increasingly become an important task for obtaining good results with the unsupervised learning task. This paper aims to evaluate the impact of the five measures (Cosine similarity, Jaccard coefficient, Pearson correlation, Euclidean distance and Averaged Kullback- Leibler Divergence) for Document Clustering with two types of pre-processing morphology-based The Information Science Research Institute (ISRI) is equivalent to the root-based stemmer and light stemmer; and without stemming without morphology) for an Arabic dataset. Stemming is known as a computational process used to reduce words to their stems. For classification, it is categorised as a recall-enhancing or precision-enhancing component. It is concluded that the method of ISRI for words is proved to be better than without stemming methods which use a five similarities/distance measures for Document Clustering.

[1]  Leah S. Larkey,et al.  Arabic Information Retrieval at UMass in TREC-10 , 2001, TREC.

[2]  Laila Khreisat,et al.  Arabic Text Classification Using N-Gram Frequency Statistics A Comparative Study , 2006, DMIN.

[3]  Chinatsu Aone,et al.  Fast and effective text mining using linear-time document clustering , 1999, KDD '99.

[4]  Kazem Taghva,et al.  Arabic stemming without a root dictionary , 2005, International Conference on Information Technology: Coding and Computing (ITCC'05) - Volume II.

[5]  Ossama Emam,et al.  Examining the Effect of Improved Context Sensitive Morphology on Arabic Information Retrieval , 2005, SEMITIC@ACL.

[6]  George Karypis,et al.  A Comparison of Document Clustering Techniques , 2000 .

[7]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[8]  Rehab Duwairi A Distance-based Classifier for Arabic Text Categorization , 2005, DMIN.

[9]  Amine Bensaid,et al.  Automatic Arabic Document Categorization Based on the Naïve Bayes Algorithm , 2004 .

[10]  Martha W. Evens,et al.  Stemming methodologies over individual query words for an Arabic information retrieval system , 1999 .

[11]  Jessica Lin,et al.  Towards an error-free Arabic stemming , 2008, iNEWS '08.

[12]  Qasem A. Al-Radaideh,et al.  Using N-grams for Arabic text searching , 2004, J. Assoc. Inf. Sci. Technol..

[13]  S. A. Ouatik,et al.  Stemming and similarity measures for Arabic Documents Clustering , 2010, 2010 5th International Symposium On I/V Communications and Mobile Network.

[14]  S. Khoja,et al.  APT: Arabic Part-of-speech Tagger , 2001 .

[15]  Lisa Ballesteros,et al.  Improving stemming for Arabic information retrieval: light stemming and co-occurrence analysis , 2002, SIGIR '02.

[16]  Bassam Al-Salemi,et al.  Statistical Bayesian Learning for Automatic Arabic Text Categorization , 2011 .