Machine learning for Arabic text categorization: Research Articles

In this article we propose a distance-based classifier for categorizing Arabic text. Each category is represented as a vector of words in an m-dimensional space, and documents are classified on the basis of their closeness to feature vectors of categories. The classifier, in its learning phase, scans the set of training documents to extract features of categories that capture inherent category-specific properties; in its testing phase the classifier uses previously determined category-specific features to categorize unclassified documents. Stemming was used to reduce the dimensionality of feature vectors of documents. The accuracy of the classifier was tested by carrying out several categorization tasks on an in-house collected Arabic corpus. The results show that the proposed classifier is very accurate and robust. © 2006 Wiley Periodicals, Inc.

[1]  Shenghuo Zhu,et al.  Efficient multi-way text categorization via generalized discriminant analysis , 2003, CIKM '03.

[2]  Padmini Srinivasan,et al.  Hierarchical neural networks for text categorization (poster abstract) , 1999, SIGIR '99.

[3]  Hongjun Lu,et al.  Scalable association-based text classification , 2000, CIKM '00.

[4]  Wai Lam,et al.  Automatic Textual Document Categorization Based on Generalized Instance Sets and a Metamodel , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Ah-Hwee Tan,et al.  On Machine Learning Methods for Chinese Document Categorization , 2003, Applied Intelligence.

[6]  Susan T. Dumais,et al.  Inductive learning algorithms and representations for text categorization , 1998, CIKM '98.

[7]  David Madigan,et al.  On the Naive Bayes Model for Text Categorization , 2003, AISTATS.

[8]  Taisir Eldos,et al.  Arabic Text Data Mining: a Root-Based Hierarchical Indexing Model , 2003 .

[9]  Fabrizio Sebastiani,et al.  Machine learning in automated text categorization , 2001, CSUR.

[10]  Jennifer Widom,et al.  Exploiting hierarchical domain structure to compute similarity , 2003, TOIS.

[11]  Amine Bensaid,et al.  Automatic Arabic Document Categorization Based on the Naïve Bayes Algorithm , 2004 .

[12]  Dale Schuurmans,et al.  Augmenting Naive Bayes Classifiers with Statistical Language Models , 2004, Information Retrieval.

[13]  David D. Lewis,et al.  Evaluating and optimizing autonomous text classification systems , 1995, SIGIR '95.

[14]  Riyad Al-Shalabi,et al.  A Computational Morphology System for Arabic , 1998, SEMITIC@COLING.

[15]  William Perrizo,et al.  An optimized approach for KNN text categorization using P-trees , 2004, SAC '04.

[16]  Tarek A. El-Sadany,et al.  An Arabic Morphological System , 1989, IBM Syst. J..

[17]  Jyh-Jong Tsay,et al.  Improving linear classifier for Chinese text categorization , 2004, Inf. Process. Manag..