Advantages of query biased summaries in information retrieval

This paper presents an investigation into the utility of document summarisation in the context of information retrieval, more specifically in the application of so called query biased (or user directed) summaries: summaries customised to reflect the information need expressed in a query. Employed in the retrieved document list displayed after a retrieval took place, the summaries' utility was evaluated in a task-based environment by measuring users' speed and accuracy in identifying relevant documents. This was compared to the performance achieved when users were presented with the more typical output of an IR system: a static predefined summary composed of the title and first few sentences of retrieved documents. The results from the evaluation indicate that the use of query biased summaries significantly improves both the accuracy and speed of user relevance judgements.

[1]  Francine Chen,et al.  A trainable document summarizer , 1995, SIGIR '95.

[2]  Gerard Salton,et al.  Automatic Text Structuring and Summarization , 1997, Inf. Process. Manag..

[3]  Chris D. Paice,et al.  Constructing literature abstracts by computer: Techniques and prospects , 1990, Inf. Process. Manag..

[4]  H. P. Edmundson,et al.  Problems in automatic abstracting , 1964, CACM.

[5]  James P. Callan,et al.  Passage-level evidence in document retrieval , 1994, SIGIR '94.

[6]  G. Keppel,et al.  Design and Analysis: A Researcher's Handbook , 1976 .

[7]  Jose Abracos,et al.  Statistical methods for retrieving most significant paragraphs in newspaper articles , 1997, Workshop On Intelligent Scalable Text Summarization.

[8]  Donna K. Harman,et al.  Overview of the Fifth Text REtrieval Conference (TREC-5) , 1996, TREC.

[9]  D. Clyde,et al.  Experimental design and statistics. , 1967, Comprehensive psychiatry.

[10]  Lisa F. Rau,et al.  Automatic Condensation of Electronic Publications by Sentence Selection , 1995, Inf. Process. Manag..

[11]  Peter Schäuble,et al.  Highlighting Relevant Passages for Users of the Interactive SPIDER Retrieval System , 1995, TREC.

[12]  H. P. Edmundson,et al.  New Methods in Automatic Extracting , 1969, JACM.

[13]  Gerard Salton,et al.  Research and Development in Information Retrieval , 1982, Lecture Notes in Computer Science.

[14]  James E. Rush,et al.  Automatic abstracting and indexing. II. Production of indicative abstracts by application of contextual inference and syntactic coherence criteria , 1971 .

[15]  T. E. R. Singer,et al.  Abstracting scientific and technical literature;: An introductory guide and text for scientists, abstractors, and management , 1971 .

[16]  Seiji Miike,et al.  A full-text retrieval system with a dynamic abstract generation function , 1994, SIGIR '94.

[17]  Lisa F. Rau,et al.  SCISOR: extracting information from on-line news , 1990, CACM.

[18]  Dragomir R. Radev,et al.  Generating summaries of multiple news articles , 1995, SIGIR '95.

[19]  Inderjeet Mani,et al.  Multi-Document Summarization by Graph Search and Matching , 1997, AAAI/IAAI.

[20]  Marilyn Bohl,et al.  Information processing , 1971 .

[21]  Hans Peter Luhn,et al.  The Automatic Creation of Literature Abstracts , 1958, IBM J. Res. Dev..

[22]  Therese Firmin Hand,et al.  A Proposal for Task-based Evaluation of Text Summarization Systems , 1997, Workshop On Intelligent Scalable Text Summarization.

[23]  Martin F. Porter,et al.  An algorithm for suffix stripping , 1997, Program.