论文信息 - Overview of the Initiative for the Evaluation of XML retrieval (INEX) 2002

Overview of the Initiative for the Evaluation of XML retrieval (INEX) 2002

The INitiative for the Evaluation of XML retrieval (INEX) aims at providing an infrastructure for evaluating the effectiveness of content-oriented XML retrieval. In the first round of INEX, in 2002, a test collection of real world XML documents along with standard topics and respective relevance assessments has been created. Research groups from 36 different organisations participated in this collaborative effort. In this article we describe the test collection and how it was constructed. An overview of the metrics used to evaluate the effectiveness of XML retrieval approaches and of the evaluation results of 51 submissions from the INEX 2002 participants is also provided.

[1] N. Fuhr. PAN-Uncovering Plagiarism , Authorship , and Social Software Misuse ImageCLEF 2013-Cross Language Image Annotation and Retrieval INEX-INitiative for the Evaluation of XML retrieval , 2002 .

[2] W. S. Cooper. Expected search length: A single measure of retrieval effectiveness based on the weak ordering action of retrieval systems , 1968 .

[3] Norbert Fuhr,et al. HyREX: hyper-media retrieval engine for XML , 2002, SIGIR '02.

[4] C. J. van Rijsbergen,et al. Report on the need for and provision of an 'ideal' information retrieval test collection , 1975 .

[5] Yiyu Yao,et al. On modeling information retrieval with probabilistic inference , 1995, TOIS.

[6] Vijay V. Raghavan,et al. A critical investigation of recall and precision as measures of retrieval system performance , 1989, TOIS.

[7] Mounia Lalmas,et al. Report on the INEX 2003 workshop , 2004, SIGF.

[8] Ellen M. Voorhees,et al. The Tenth Text REtrieval Conference, TREC 2001 | NIST , 2002 .

[9] W. Bruce Croft,et al. Retrieval of Complex Objects , 1992, EDBT.

[10] Jaana Kekäläinen,et al. Using graded relevance assessments in IR evaluation , 2002, J. Assoc. Inf. Sci. Technol..

[11] Vijay V. Raghavan,et al. Retrieval system evaluation using recall and precision: problems and answers , 1989, SIGIR '89.