论文信息 - INEX 2005 Evaluation Measures

INEX 2005 Evaluation Measures

This paper describes the official measures of retrieval effectiveness employed in INEX 2005: the eXtended Cumulated Gain (XCG) measures. In addition, results of correlation analysis are reported, examining the correlation between the employed quantisation functions and the different measures for the INEX 2005 ad-hoc tasks.

Gabriella Kazai | Mounia Lalmas | M. Lalmas | G. Kazai

[1] Jaana Kekäläinen,et al. Cumulated gain-based evaluation of IR techniques , 2002, TOIS.

[2] Ellen M. Voorhees,et al. Evaluation by highly relevant documents , 2001, SIGIR '01.

[3] Gabriella Kazai,et al. Overview of INEX 2005 , 2005, INEX.

[4] Jaana Kekäläinen,et al. Using graded relevance assessments in IR evaluation , 2002, J. Assoc. Inf. Sci. Technol..

[5] Alexander Dekhtyar,et al. Information Retrieval , 2018, Lecture Notes in Computer Science.

[6] Gabriella Kazai,et al. eXtended cumulated gain measures for the evaluation of content-oriented XML retrieval , 2006, TOIS.

[7] B. M. Brown,et al. Practical Non-Parametric Statistics. , 1981 .

[8] Tetsuya Sakai,et al. New Performance Metrics Based on Multigrade Relevance: Their Application to Question Answering , 2004, NTCIR.