论文信息 - Overview of the TREC 2011 Chemical IR Track

Overview of the TREC 2011 Chemical IR Track

Abstract : TREC 2009 was the first year of the Chemical IR Track, which focuses on evaluation of search techniques for discovery of digitally stored information on chemical patents and academic journal articles. The track included two tasks: Prior Art (PA) and Technical Survey (TS) tasks. This paper describes how we designed the two tasks and presents the official results of eight participating groups.

[1] Jaana Kekäläinen,et al. Cumulated gain-based evaluation of IR techniques , 2002, TOIS.

[2] Ben Carterette,et al. On rank correlation and the distance between rankings , 2009, SIGIR.

[3] James Allan,et al. Agreement among statistical significance tests for information retrieval evaluation at varying sample sizes , 2009, SIGIR.

[4] Alistair Moffat,et al. Statistical power in retrieval experimentation , 2008, CIKM '08.

[5] Emine Yilmaz,et al. Estimating average precision with incomplete and imperfect judgments , 2006, CIKM '06.

[6] James Allan,et al. A comparison of statistical significance tests for information retrieval evaluation , 2007, CIKM '07.

[7] Ben Carterette,et al. Hypothesis testing with incomplete relevance judgments , 2007, CIKM '07.

[8] Emine Yilmaz,et al. A simple and efficient sampling method for estimating AP and NDCG , 2008, SIGIR '08.