We propose here a method to select index words for the construction of a document vector from a corpus using the independent component analysis (ICA). It is useful to select index words of a document vector since its dimension is large. The ICA is one of the methods in analyzing the latent semantics of documents. It is reported the independent components obtained by the ICA represent the topics in the documents. The words in the independent component are considered to be the key words of the topic. The proposed method selects the key words which have high weight in each independent component and adds them to a set of index words. In addition, we selected other words related to the key words according to the chi-squared measure between the co-occurrence of the key words and each word and the appearance of the key words, and have also added them to the set of index words. Finally, an evaluation of the index words obtained has been carried out.
[1]
Erkki Oja,et al.
Independent component analysis: algorithms and applications
,
2000,
Neural Networks.
[2]
Michael McGill,et al.
Introduction to Modern Information Retrieval
,
1983
.
[3]
James V. Stone.
Independent Component Analysis: A Tutorial Introduction
,
2007
.
[4]
L. K. Hansen,et al.
Independent Components in Text
,
2000
.
[5]
T. Landauer,et al.
Indexing by Latent Semantic Analysis
,
1990
.
[6]
Mitsuru Ishizuka,et al.
Keyword extraction from a single document using word co-occurrence statistical information
,
2004,
Int. J. Artif. Intell. Tools.
[7]
Yukio Ohsawa,et al.
KeyGraph: automatic indexing by co-occurrence graph based on building construction metaphor
,
1998,
Proceedings IEEE International Forum on Research and Technology Advances in Digital Libraries -ADL'98-.
[8]
Aapo Hyvärinen,et al.
Independent Component Analysis: A Tutorial
,
1999
.