Automatic text categorization is the task of assigning natural language text documents to predefined categories based on their context. In order to classify text documents, we must evaluate the values of words in documents. In previous research, the value of a word is commonly represented by the product of the term frequency and the inverted document frequency of the word, which is called TF*IDF for short. Since there is a different role for a word in different category documents, we should measure the value of the word according to various categories. In this paper, we proposal a new method used to measure the importance of words in categories and a new framework for text categorization. To verity the efficiency of our new method, we conduct experiments using three text collections. The k-NN is used as the classifier in our experiments. Experimental results show that our new method makes a significant improvement in all these text collections.
[1]
Andrew McCallum,et al.
A comparison of event models for naive bayes text classification
,
1998,
AAAI 1998.
[2]
Gerard Salton,et al.
Term-Weighting Approaches in Automatic Text Retrieval
,
1988,
Inf. Process. Manag..
[3]
Yiming Yang,et al.
Expert network: effective and efficient learning from human decisions in text categorization and retrieval
,
1994,
SIGIR '94.
[4]
Hwee Tou Ng,et al.
Feature selection, perceptron learning, and a usability case study for text categorization
,
1997,
SIGIR '97.
[5]
Yiming Yang,et al.
A re-examination of text categorization methods
,
1999,
SIGIR '99.
[6]
Thorsten Joachims,et al.
Text Categorization with Support Vector Machines: Learning with Many Relevant Features
,
1998,
ECML.