Evaluating XML retrieval effectiveness at INEX

The INitiative for the Evaluation of XML retrieval (INEX) was set up in 2002 to establish an infrastructure and provide means, in the form of large test collections and appropriate scoring methods, for evaluating the effectiveness of content-oriented XML retrieval systems. This report provides an overview of the evaluation methodology developed in INEX from 2002 to 2006.

[1]  Birger Larsen,et al.  Report on the INEX 2004 interactive track , 2005, SIGF.

[2]  Gabriella Kazai.  Initiative for the Evaluation of XML Retrieval , 2009 .

[3]  Gabriella Kazai,et al.  The overlap problem in content-oriented XML retrieval evaluation , 2004, SIGIR '04.

[4]  Gabriella Kazai,et al.  eXtended cumulated gain measures for the evaluation of content-oriented XML retrieval , 2006, TOIS.

[5]  Peter Bailey,et al.  Overview of the TREC-8 Web Track , 2000, TREC.

[6]  Mounia Lalmas,et al.  Advances in XML Information Retrieval, Third International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2004, Dagstuhl Castle, Germany, December 6-8, 2004, Revised Selected Papers , 2005, INEX.

[7]  Sameer Pradhan,et al.  Evaluation Metrics , 2007 .

[8]  Andrew Trotman,et al.  Passage Retrieval and other XML-Retrieval Tasks , 2006, SIGIR 2006.

[9]  Benjamin Piwowarski,et al.  Measurement, Theory , 2022 .

[10]  Mounia Lalmas,et al.  Investigating the exhaustivity dimension in content-oriented XML element retrieval evaluation , 2006, CIKM '06.

[11]  Ludovic Denoyer,et al.  The Wikipedia XML Corpus , 2006, INEX.

[12]  Vijay V. Raghavan,et al.  A critical investigation of recall and precision as measures of retrieval system performance , 1989, TOIS.

[13]  Gabriella Kazai,et al.  INEX 2006 Evaluation Measures , 2006, INEX.

[14]  Mounia Lalmas,et al.  Advances in XML Information Retrieval: Third International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2004, Dagstuhl Castle, ... 2004 (Lecture Notes in Computer Science) , 2005 .

[15]  Gabriella Kazai,et al.  Choosing an Ideal Recall-Base for the Evaluation of the Focused Task: Sensitivity Analysis of the XCG Evaluation Measures , 2006, INEX.

[16]  Gabriella Kazai,et al.  INEX 2007 Evaluation Measures (Draft) , 2007 .

[17]  Andrew Trotman,et al.  Report on the SIGIR 2006 workshop on XML element retrieval methodology , 2006, SIGF.

[18]  Mounia Lalmas,et al.  Providing consistent and exhaustive relevance assessments for XML retrieval evaluation , 2004, CIKM '04.

[19]  Gabriella Kazai.  INitiative for the Evaluation of XML Retrieval , 2009, Encyclopedia of Database Systems.

[20]  Andrew Trotman,et al.  Comparative Evaluation of XML Information Retrieval Systems: 5th International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2006 Dagstuhl Castle, Germany, December 17-20, 2006 Revised and Selected Papers , 2005 .

[21]  Gabriella Kazai,et al.  INEX 2005 Evaluation Measures , 2005, INEX.

[22]  Ludovic Denoyer,et al.  The XML Wikipedia Corpus , 2006 .

[23]  Andrew Trotman,et al.  Strict and vague interpretation of XML-retrieval queries , 2006, SIGIR.

[24]  Andrew Trotman,et al.  Narrowed Extended XPath I (NEXI) , 2004, INEX.

[25]  Gabriella Kazai,et al.  A Study of the Assessment of Relevance for the INEX'02 Test Collection , 2004, ECIR.

[26]  Andrew Trotman,et al.  Why structural hints in queries do not help XML-retrieval , 2006, SIGIR.

[27]  Mounia Lalmas,et al.  INEX 2002 - 2006: Understanding XML Retrieval Evaluation , 2007, DELOS.

[28]  M. de Rijke,et al.  Structured queries in XML retrieval , 2005, CIKM '05.

[29]  Gabriella Kazai,et al.  Evaluating the effectiveness of content-oriented XML retrieval , 2003 .

[30]  Jaana Kekäläinen,et al.  Using graded relevance assessments in IR evaluation , 2002, J. Assoc. Inf. Sci. Technol..

[31]  Gabriella Kazai,et al.  Notes on what to measure in INEX , 2005 .

[32]  Jaana Kekäläinen,et al.  Cumulated gain-based evaluation of IR techniques , 2002, TOIS.

[33]  James A. Thom,et al.  HiXEval: Highlighting XML Retrieval Evaluation , 2005, INEX.