论文信息 - Beyond Cumulated Gain and Average Precision: Including Willingness and Expectation in the User Model

Beyond Cumulated Gain and Average Precision: Including Willingness and Expectation in the User Model

In this paper, we define a new metric family based on two concepts: The definition of the stopping criterion and the notion of satisfaction, where the former depends on the willingness and expectation of a user exploring search results. Both concepts have been discussed so far in the IR literature, but we argue in this paper that defining a proper single valued metric depends on merging them into a single conceptual framework.

Mounia Lalmas | Benjamin Piwowarski | Georges Dupret

[1] Catherine L. Smith,et al. User adaptation: good results from poor systems , 2008, SIGIR '08.

[2] Jaana Kekäläinen,et al. Cumulated gain-based evaluation of IR techniques , 2002, TOIS.

[3] Alistair Moffat,et al. Rank-biased precision for measurement of retrieval effectiveness , 2008, TOIS.

[4] Stephen E. Robertson,et al. A new interpretation of average precision , 2008, SIGIR '08.

[5] C. J. van Rijsbergen,et al. Proceedings of the 10th annual international ACM SIGIR conference on Research and development in information retrieval , 1987, SIGIR 1987.

[6] William S. Cooper,et al. On selecting a measure of retrieval effectiveness , 1973, J. Am. Soc. Inf. Sci..

[7] William S. Cooper,et al. On selecting a measure of retrieval effectiveness part II. Implementation of the philosophy , 1973, J. Am. Soc. Inf. Sci..