论文信息 - Evaluating Categorisation in Real Life - An Argument Against Simple but Impractical Metrics

Evaluating Categorisation in Real Life - An Argument Against Simple but Impractical Metrics

Text categorisation in commercial application poses several limiting constraints on the technology solutions to be employed. This paper describes how a method with some potential improvements is evaluated for practical purposes and argues for a richer and more expressive evaluation procedure. In this paper one such method is exemplified by a precision-recall matrix which sacrifices convenience for expressiveness.

Jussi Karlgren | Pawel Herman | Vide Karlsson

[1] Greg Schohn,et al. Less is More: Active Learning with Support Vector Machines , 2000, ICML.

[2] Carlo Strapparava,et al. Improving text categorization bootstrapping via unsupervised learning , 2009, TSLP.

[3] Youngjoong Ko,et al. Text classification from unlabeled documents with bootstrapping and feature projection techniques , 2009, Inf. Process. Manag..

[4] Ido Dagan,et al. Text Categorization from Category Name via Lexical Reference , 2009, NAACL.

[5] Ido Dagan,et al. Text Categorization from category name in an industry-motivated scenario , 2015, Lang. Resour. Evaluation.

[6] Andrew McCallum,et al. A Machine Learning Approach to Building Domain-Specific Search Engines , 1999, IJCAI.

[7] Yang Zhang,et al. Building a Text Classifier by a Keyword and Wikipedia Knowledge , 2009, ADMA.

[8] Fredrik Olsson,et al. The Gavagai Living Lexicon , 2016, LREC.