论文信息 - Evall: A Framework for Information Systems Evaluation

Evall: A Framework for Information Systems Evaluation

In this paper, the Evall framework for the automatic evaluation of information systems task is presented. With just one click and providing the system outputs of the algorithms, Evall allows researchers to automatically generate a Latex report including the results of their algorithms, statistical significance tests, measures descriptions, and references.

[1] David A. Hull. The TREC-7 Filtering Track: Description and Analysis , 1998, Text Retrieval Conference.

[2] Gordon V. Cormack,et al. TREC 2006 Spam Track Overview , 2006, TREC.

[3] Jacob Cohen. A Coefficient of Agreement for Nominal Scales , 1960 .

[4] George Karypis,et al. A Comparison of Document Clustering Techniques , 2000 .

[5] Marina MeWi. Comparing Clusterings , 2002 .

[6] Alistair Moffat,et al. Rank-biased precision for measurement of retrieval effectiveness , 2008, TOIS.

[7] Jaana Kekäläinen,et al. Cumulated gain-based evaluation of IR techniques , 2002, TOIS.

[8] Julio Gonzalo,et al. A general evaluation measure for document organization tasks , 2013, SIGIR.

[9] Xin Liu,et al. Document clustering based on non-negative matrix factorization , 2003, SIGIR.

[10] Michalis Vazirgiannis,et al. On Clustering Validation Techniques , 2001, Journal of Intelligent Information Systems.