论文信息 - Information retrieval performance measures for a current awareness report composition aid

Information retrieval performance measures for a current awareness report composition aid

This papers studies a special ''small'' information retrieval problem where user satisfaction only depends on the ordering of documents. We look for a retrieval performance measure applicable for this setting. We define some requirements for such a measure. We develop a theoretical ordering of all outcomes. We look at some standard and purpose-build measures and assess them against the requirements. We conclude that a linear combination of two such measures is adequate.

Thomas Krichel | T. Krichel

[1] B. C. Brookes. THE MEASURES OF INFORMATION RETRIEVAL EFFECTIVENESS PROPOSED BY SWETS , 1968 .

[2] José Manuel Barrueco Cruz,et al. Organizing current awareness in a large digital library , 2003 .

[3] Vladimir N. Vapnik,et al. The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[5] Robert M. Losee. Text retrieval and filtering: analytic models of performance , 1998 .

[6] Thorsten Joachims,et al. Mapping subsets of scholarly information , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[7] William S. Cooper,et al. On selecting a measure of retrieval effectiveness , 1973, J. Am. Soc. Inf. Sci..

[8] Thomas Krichel,et al. Developing a predictive model of editor selectivity in a current awareness service of a large digital library , 2005 .

[9] Thorsten Joachims,et al. Making large scale SVM learning practical , 1998 .

[10] W. S. Cooper. Expected search length: A single measure of retrieval effectiveness based on the weak ordering action of retrieval systems , 1968 .

[11] William M. Shaw,et al. On the foundation of evaluation , 1986, J. Am. Soc. Inf. Sci..

[12] J A Swets,et al. Information Retrieval Systems. , 1963, Science.

[13] C. J. van Rijsbergen,et al. FOUNDATION OF EVALUATION , 1974 .