INEX 2007 Evaluation Measures (Draft)

This paper describes the official measures of retrieval ef- fectiveness that are planned to be employed for the ad hoc track of INEX 2007.

[1]  Mounia Lalmas,et al.  Investigating the exhaustivity dimension in content-oriented XML element retrieval evaluation , 2006, CIKM '06.

[2]  Ludovic Denoyer,et al.  The Wikipedia XML Corpus , 2006, INEX.

[3]  Gabriella Kazai.  Initiative for the Evaluation of XML Retrieval , 2009 .

[4]  James Allan,et al.  Passage Retrieval and Evaluation , 2005 .

[5]  Ellen M. Voorhees,et al.  Overview of the TREC 2004 Novelty Track. , 2005 .

[6]  Gabriella Kazai,et al.  Overview of INEX 2005 , 2005, INEX.

[7]  Jaana Kekäläinen,et al.  Using graded relevance assessments in IR evaluation , 2002, J. Assoc. Inf. Sci. Technol..

[8]  Jaap Kamps,et al.  Evaluating relevant in context: document retrieval with a twist , 2007, SIGIR.

[9]  Andrew Trotman,et al.  INEX 2005 guidelines for topic development , 2005 .

[10]  James A. Thom,et al.  HiXEval: Highlighting XML Retrieval Evaluation , 2005, INEX.

[11]  Charles L. A. Clarke,et al.  INEX 2006 retrieval task and result submission specification , 2006 .

[12]  Stephen E. Robertson.  Evaluation in Information Retrieval , 2000, ESSIR.

[13]  James A. Thom,et al.  Evaluating Focused Retrieval Tasks , 2007 .

[14]  Jovan Pehcevski,et al.  Evaluation of Effective XML Information Retrieval , 2006 .

[15]  Benjamin Piwowarski,et al.  Measurement, Theory , 2022 .

[16]  Gabriella Kazai,et al.  eXtended cumulated gain measures for the evaluation of content-oriented XML retrieval , 2006, TOIS.

[17]  Djoerd Hiemstra,et al.  The Simplest Evaluation Measures for XML Information Retrieval that Could Possibly Work , 2005 .

[18]  William R. Hersh,et al.  TREC GENOMICS Track Overview , 2003, TREC.

[19]  James Allan,et al.  HARD Track Overview in TREC 2003: High Accuracy Retrieval from Documents , 2003, TREC.