论文信息 - Visualizing the problems with the INEX topics

Visualizing the problems with the INEX topics

Topics form a crucial component of a test collection. We show, through visualization, that the INEX 2008 topics have shortcomings, which questions their validity for evaluating XML retrieval effectiveness.

Andrew Trotman | Mounia Lalmas | Maria del Rocio Gomez Crisostomo

[1] Tetsuya Sakai,et al. Evaluating evaluation metrics based on the bootstrap , 2006, SIGIR.

[2] Andrew Trotman,et al. Why structural hints in queries do not help XML-retrieval , 2006, SIGIR.

[3] Andrew Trotman,et al. Comparative analysis of clicks and judgments for IR evaluation , 2009, WSCD '09.

[4] Ellen M. Voorhees,et al. Evaluating evaluation measure stability , 2000, SIGIR '00.

[5] Miro Lehtonen. Designing User Studies for XML Retrieval , 2006 .

[6] Peter Bailey,et al. Measuring Search Engine Quality , 2001, Information Retrieval.