论文信息 - GENERATION OF A SET OF KEY TERMS CHARACTERISING TEXT DOCUMENTS

GENERATION OF A SET OF KEY TERMS CHARACTERISING TEXT DOCUMENTS

The presented paper describes statistical methods (information gain, mutual X^2 statistics, and TF-IDF method) for key words generation from a text document collection. These key words should characterise the content of text documents and can be used to retrieve relevant documents from a document collection. Term relations were detected on the base of conditional probability of term occurrences. The focus is on the detection of those words, which occur together very often. Thus, key words, which consist from two terms were generated additionally. Several tests were carried out using the 20 News Groups collection of text documents.

Kristina Machova | Andrea Szaboova | Peter Bednar

[1] Yiming Yang,et al. A Comparative Study on Feature Selection in Text Categorization , 1997, ICML.

[2] Petr Berka. Dobývání znalostí z databází , 2003 .

[3] C. J. van Rijsbergen,et al. Information Retrieval , 1979, Encyclopedia of GIS.

[4] Jan. Paralic,et al. Java Library for Support of Text Mining and Retrieval , .

[5] Gerard Salton,et al. Term-Weighting Approaches in Automatic Text Retrieval , 1988, Inf. Process. Manag..

[6] Ján Kollár,et al. Notes on the Experience of Transforming Distributed Learning Materials into SCORM Standard Specifications , 2004 .