The tremendous growth in the amount of information available poses some key challenges for information filtering and retrieval. Users not only expect high quality and relevant information, but also wish that the information he presented in an as efficient way as possible. The traditional filtering methods, however, only consider the relevant values of document. These conventional methods fail to consider the efficiency of documents retrieval. In this paper, we propose a new algorithm to calculate an index called document similarity score based on elements of the document. Using the index, document profile is derived. Any documents with the similarity score above a given threshold is clustered. Using these pre-clustered documents, information filtering and retrieval can be made more efficient. Experimental results clearly show our proposed method tremendously improves the efficiency of information filtering and retrieval. We also give an example application of our proposed method in business processes.
[1]
John A. Hartigan,et al.
Clustering Algorithms
,
1975
.
[2]
John Riedl,et al.
GroupLens: an open architecture for collaborative filtering of netnews
,
1994,
CSCW '94.
[3]
Andreas Stafylopatis,et al.
A Fuzzy Rule-Based Agent for Web Retrieval-Filtering
,
2001,
Web Intelligence.
[4]
Yangyong Zhu,et al.
A New Algorithm for Performing Ratings-Based Collaborative Filtering
,
2003,
APWeb.
[5]
Stephen E. Robertson,et al.
Threshold setting in adaptive filtering
,
2000,
J. Documentation.
[6]
Xiannong Meng,et al.
Personalized Web Search with Clusters
,
2003,
International Conference on Internet Computing.
[7]
Javed Mostafa,et al.
A multilevel approach to intelligent information filtering: model, system, and evaluation
,
1997,
TOIS.
[8]
Koichi Takeda,et al.
Information retrieval on the web
,
2000,
CSUR.