Effectiveness of keyword-based display and selection of retrieval results for interactive searches

Abstract.We present an approach to increasing the effectiveness of ranked-output retrieval systems that relies on graphical display and user manipulation of “views” of retrieval results, where a view is the subset of retrieved documents that contain a specified subset of query terms. This approach has been implemented in a system named VIEWER (VIEwing WEb Results), acting as an interface to available search engines. An experimental evaluation of the performance of VIEWER in contrast to AltaVista is the major focus of the paper. We first report the results of an experiment on single, short query searches where VIEWER, used as an interactive ranking system, markedly outperformed AltaVista. We then concentrate on a more realistic searching scenario, involving free query formulation, unconstrained selection of retrieval results, and possibility of query reformulation. We report the results of an experiment where the use of VIEWER, compared to AltaVista, seemed to shift the user effort from inspection to evaluation of results, increasing retrieval effectiveness, and user satisfaction. In particular, we found that the VIEWER users retrieved half as many nonrelevant documents as the AltaVista users while retrieving a comparable number of relevant documents.

[1]  Sándor Dominich.  Interaction Information Retrieval , 1994, J. Documentation.

[2]  Marti A. Hearst.  TileBars: visualization of term distribution information in full text information access , 1995, CHI '95.

[3]  James W. Cooper,et al.  Lexical navigation: visually prompted query expansion and refinement , 1997, DL '97.

[4]  John Cotton,et al.  Experiment, Design, and Statistics in Psychology. , 1974 .

[5]  Stefano Mizzaro,et al.  Evaluating user interfaces to information retrieval systems: a case study on user support , 1996, SIGIR '96.

[6]  Donald Byrd,et al.  A scrollbar-based visualization for document navigation , 1999, DL '99.

[7]  Aravindan Veerasamy,et al.  Effectiveness of a graphical display of retrieval results , 1997, SIGIR '97.

[8]  SpinkAmanda,et al.  Interaction in information retrieval , 1997 .

[9]  Mark Sanderson,et al.  Advantages of query biased summaries in information retrieval , 1998, SIGIR '98.

[10]  Gerard Salton,et al.  Automatic Text Processing: The Transformation, Analysis, and Retrieval of Information by Computer , 1989 .

[11]  Jean M. Tague,et al.  The pragmatics of information retrieval experimentation , 1981 .

[12]  Nicholas J. Belkin,et al.  Interaction in Information Retrieval: Trends Over Time , 1999, J. Am. Soc. Inf. Sci..

[13]  Claudio Carpineto,et al.  Improving the Effectiveness of WEB Search Engines Using Selectable Views of Retrieval Results , 1998, J. Univers. Comput. Sci..

[14]  M. E. Maron,et al.  Full-text information retrieval: Further analysis and clarification , 1990, Inf. Process. Manag..

[15]  Matthias Hemmje,et al.  LyberWorld—a visualization user interface supporting fulltext retrieval , 1994, SIGIR '94.

[16]  Colin Robson,et al.  Experiment, design and statistics in psychology , 1973 .

[17]  Anselm Spoerri.  InfoCrystal: Integrating Exact and Partial Matching Approaches through Visualization , 1994, RIAO.

[18]  Oren Etzioni,et al.  Web document clustering: a feasibility demonstration , 1998, SIGIR '98.

[19]  Charles L. A. Clarke,et al.  Relevance ranking for one to three term queries , 1997, Inf. Process. Manag..

[20]  W. Buxton.  Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[21]  Marti A. Hearst.  Improving Full-Text Precision on Short Queries using Simple Constraints , 1996 .

[22]  Claudio Carpineto,et al.  Information retrieval through hybrid navigation of lattice representations , 1996, Int. J. Hum. Comput. Stud..

[23]  David Bodoff,et al.  Partial coordination. I. The best of pre-coordination and post-coordination , 1998 .

[24]  Claire Cardie,et al.  SMART High Precision: TREC 7 , 1998, TREC.

[25]  Alexander Dekhtyar,et al.  Information Retrieval , 2018, Lecture Notes in Computer Science.

[26]  Matthew Chalmers,et al.  Bead: explorations in information visualization , 1992, SIGIR '92.

[27]  Jean Tague-Sutcliffe,et al.  The Pragmatics of Information Retrieval Experimentation Revisited , 1997, Inf. Process. Manag..