Incorporating user search behavior into relevance feedback

In this paper, we present five user experiments on incorporating behavioral information into the relevance feedback process. In particular, we concentrate on ranking terms for query expansion and selecting new terms to add to the user's query. Our experiments are an attempt to widen the evidence used for relevance feedback from simply the relevant documents to include information on how users are searching. We show that this information can lead to more successful relevance feedback techniques. We also show that the presentation of relevance feedback to the user is important in the success of relevance feedback.

[1]  Gerard Salton,et al.  Improving retrieval performance by relevance feedback , 1997, J. Am. Soc. Inf. Sci..

[2]  Pia Borlund,et al.  Evaluation of interactive information retrieval systems , 2000 .

[3]  Peter Ingwersen,et al.  The Application of Work Tasks in Connection with the Evaluation of Interactive Information Retrieval Systems: Empirical Results , 1999, MIRA.

[4]  Ian Ruthven.  On the Use of Explanations as Mediating Device for Relevance Feedback , 2002, ECDL.

[5]  Amanda Spink,et al.  From Highly Relevant to Not Relevant: Examining Different Regions of Relevance , 1998, Inf. Process. Manag..

[6]  Carol Collier Kuhlthau,et al.  A Principle of Uncertainty for Information seeking , 1993, J. Documentation.

[7]  Efthimis N. Efthimiadis,et al.  User Choices: A new Yardstick for the Evaluation of Ranking Algorithms for Interactive Query Expansion , 1995, Inf. Process. Manag..

[8]  Ricardo Baeza-Yates,et al.  Information Retrieval: Data Structures and Algorithms , 1992 .

[9]  Donna K. Harman,et al.  Relevance feedback revisited , 1992, SIGIR '92.

[10]  Donna K. Harman,et al.  Relevance Feedback and Other Query Modification Techniques , 1992, Information retrieval (Boston).

[11]  David Ellis,et al.  A Behavioural Approach to Information Retrieval System Design , 1989, J. Documentation.

[12]  Pertti Vakkari,et al.  Cognition and changes of search terms and tactics during task performance: A longitudinal case study , 2000, RIAO.

[13]  Pia Borlund,et al.  Experimental components for the evaluation of interactive information retrieval systems , 2000, J. Documentation.

[14]  Iain Campbell,et al.  Interactive Evaluation of the Ostensive Model Using a New Test Collection of Images with Multiple Relevance Assessments , 2000, Information Retrieval.

[15]  Valerie Galpin,et al.  Relevance feedback in a public access catalogue for a research library: MUSCAT at the Scott Polar Research Institute Library , 1988 .

[16]  Ian Ruthven,et al.  Abduction, explanation and relevance feedback , 1999 .

[17]  Gary Marchionini,et al.  Information processing in the context of medical care , 1995, SIGIR '95.

[18]  C. J. van Rijsbergen,et al.  Empirical investigations on query modification using abductive explanations , 2001, SIGIR '01.

[19]  Pertti Vakkari,et al.  Relevance and contributing information types of searched documents in task performance , 2000, SIGIR '00.

[20]  Micheline Beaulieu,et al.  Experiments on interfaces to support query expansion , 1997, J. Documentation.

[21]  James Allan,et al.  TREC-6 Interactive Track Report. Part 1: Experimental Procedure and Initial Results , 2005 .

[22]  W. Bruce Croft,et al.  Relevance feedback and inference networks , 1993, SIGIR.

[23]  C. J. van Rijsbergen,et al.  Combining and selecting characteristics of information use , 2002, J. Assoc. Inf. Sci. Technol..

[24]  Stephen E. Robertson,et al.  Relevance weighting of search terms , 1976, J. Am. Soc. Inf. Sci..

[25]  Joemon M. Jose,et al.  A study on the use of summaries and summary-based query expansion for a question-answering task , 2001 .

[26]  Carol Collier Kuhlthau.  Inside the Search Process: Information Seeking from the User's Perspective. , 1991 .

[27]  Stephen E. Robertson,et al.  On Term Selection for Query Expansion , 1991, J. Documentation.

[28]  Donna K. Harman,et al.  Overview of the Sixth Text REtrieval Conference (TREC-6) , 1997, Inf. Process. Manag..