Generating better concept hierarchies using automatic document classification
暂无分享,去创建一个
This paper presents a hybrid concept hierarchy development technique for web returned documents retrieved by a meta-search engine. The aim of the technique is to separate the initial retrieved documents into topical oriented categories, prior to the actual concept hierarchy generation. The topical categories correspond to different semantic aspects of the query. This is done using a 1-of-n automatic document classification, on the initial set of returned documents. Then, an individual topical concept hierarchy is automatically generated inside each of the resulted categories. Both steps are executed on the fly at retrieval time. Due to the efficiency constraints imposed by the web retrieval context, the algorithm only uses document snippets (rather than full web pages) for both document classification and concept hierarchy generation. Experimental results show that the algorithm is able to improve the quality of the concept hierarchy presented to the searcher; at the same time, the efficiency parameters are kept within reasonable intervals.
[1] W. Bruce Croft,et al. Deriving concept hierarchies from text , 1999, SIGIR '99.
[2] Eric Brill,et al. Transformation-Based Error-Driven Learning and Natural Language Processing: A Case Study in Part-of-Speech Tagging , 1995, CL.
[3] Changzhi Li,et al. SUMMARIZING SEARCH RESULTS WITH AUTOMATICTABLES OF CONTENTS , 2002 .
[4] Gerard Salton,et al. Research and Development in Information Retrieval , 1982, Lecture Notes in Computer Science.