An interactive agent-based system for concept-based web search

Abstract Search engines are useful tools in looking for information from the Internet. However, due to the difficulties of specifying appropriate queries and the problems of keyword-based similarity ranking presently encountered by search engines, general users are still not satisfied with the results retrieved. To remedy the above difficulties and problems, in this paper we present a multi-agent framework in which an interactive approach is proposed to iteratively collect a user's feedback from the pages he has identified. By analyzing the pages gathered, the system can then gradually formulate queries to efficiently describe the content a user is looking for. In our framework, the evolution strategies are employed to evolve critical feature words for concept modeling in query formulation. The experimental results show that the framework developed is efficient and useful to enhance the quality of web search, and the concept-based semantic search can thus be achieved.

[1]  Gerald Salton,et al.  Automatic text processing , 1988 .

[2]  R. Salomon.  Re-evaluating genetic algorithm performance under coordinate rotation of benchmark functions. A survey of some theoretical and practical aspects of genetic algorithms. , 1996, Bio Systems.

[3]  Katia P. Sycara,et al.  Distributed Intelligent Agents , 1996, IEEE Expert.

[4]  Monika Henzinger,et al.  Analysis of a very large web search engine query log , 1999, SIGF.

[5]  Thorsten Joachims,et al.  Web Watcher: A Tour Guide for the World Wide Web , 1997, IJCAI.

[6]  Katia P. Sycara,et al.  WebMate: a personal agent for browsing and searching , 1998, AGENTS '98.

[7]  William W. Cohen,et al.  Recommendation as Classification: Using Social and Content-Based Information in Recommendation , 1998, AAAI/IAAI.

[8]  Claudia V. Goldman,et al.  Musag an Agent That Learns What You Mean , 1997, Appl. Artif. Intell..

[9]  Michael J. Pazzani,et al.  Learning and Revising User Profiles: The Identification of Interesting Web Sites , 1997, Machine Learning.

[10]  T. Joachims.  WebWatcher : A Tour Guide for the World Wide Web , 1997 .

[11]  Subhash C. Kak,et al.  A Neural Network-based Intelligent Metasearch Engine , 1999, Inf. Sci..

[12]  Pattie Maes,et al.  Agents that reduce work and information overload , 1994, CACM.

[13]  Daniel S. Weld,et al.  Intelligent Agents on the Internet: Fact, Fiction, and Forecast , 1995, IEEE Expert.

[14]  Amanda Spink,et al.  Real life information retrieval: a study of user queries on the Web , 1998, SIGF.

[15]  D. Fogel.  Evolutionary algorithms in theory and practice , 1997, Complex..

[16]  Barry Smyth,et al.  A personalised TV listings service for the digital TV age , 2000, Knowl. Based Syst..

[17]  Chia-Hui Chang,et al.  WebYacht: A Concept-Based Search Tool for WWW , 1999, Int. J. Artif. Intell. Tools.

[18]  Alexandros Moukas.  Amalthaea Information Discovery and Filtering Using a Multiagent Evolving Ecosystem , 1997, Appl. Artif. Intell..

[19]  Z. Z. Nick,et al.  Web search using a genetic algorithm , 2001 .

[20]  Chris Buckley,et al.  Improving automatic query expansion , 1998, SIGIR '98.

[21]  Carolyn J. Crouch,et al.  Improving the retrieval effectiveness of very short queries , 2002, Inf. Process. Manag..