A Simulated Study of Implicit Feedback Models

In this paper we report on a study of implicit feedback models for unobtrusively tracking the information needs of searchers. Such models use relevance information gathered from searcher interaction and can be a potential substitute for explicit relevance feedback. We introduce a variety of implicit feedback models designed to enhance an Information Retrieval (IR) system’s representation of searchers’ information needs. To benchmark their performance we use a simulation-centric evaluation methodology that measures how well each model learns relevance and improves search effectiveness. The results show that a heuristic-based binary voting model and one based on Jeffrey’s rule of conditioning [5] outperform the other models under investigation.

[1]  Donna K. Harman,et al.  An experimental study of factors important in document ranking , 1986, SIGIR '86.

[2]  Ian Ruthven,et al.  Re-examining the potential effectiveness of interactive query expansion , 2003, SIGIR.

[3]  Donna K. Harman,et al.  Overview of the Ninth Text REtrieval Conference (TREC-9) , 2000, TREC.

[4]  Ryen W. White,et al.  The Use of Implicit Evidence for Relevance Feedback in Web Retrieval , 2002, ECIR.

[5]  Javed Mostafa,et al.  Detection of shifts in user interests for personalized information filtering , 1996, SIGIR '96.

[6]  W WhiteRyen,et al.  A task-oriented study on the influencing effects of query-biased summarisation in web searching , 2003 .

[7]  L BarryCarol.  Document representations and clues to document relevance , 1998 .

[8]  Gerard Salton,et al.  Improving Retrieval Performance by Relevance Feedback , 1997 .

[9]  Richard W. Hamming,et al.  Error detecting and error correcting codes , 1950 .

[10]  Iain Campbell,et al.  The ostensive model of developing information needs , 2000 .

[11]  Gerard Salton,et al.  The SMART Retrieval System , 1971 .

[12]  C. J. van Rijsbergen,et al.  Probabilistic Retrieval Revisited , 1992, Comput. J..

[13]  Gerard Salton,et al.  Improving retrieval performance by relevance feedback , 1997, J. Am. Soc. Inf. Sci..

[14]  Ryen W. White,et al.  An approach for implicitly detecting information needs , 2003, CIKM '03.

[15]  Carol L. Barry.  Document Representations and Clues to Document Relevance , 1998, J. Am. Soc. Inf. Sci..

[16]  Ryen W. White,et al.  A task-oriented study on the influencing effects of query-biased summarisation in web searching , 2003, Inf. Process. Manag..

[17]  Stephen E. Robertson,et al.  On Term Selection for Query Expansion , 1991, J. Documentation.

[18]  R. Jeffrey.  The Logic of Decision , 1984 .