论文信息 - Crowdsourcing a wikipedia vandalism corpus

Crowdsourcing a wikipedia vandalism corpus

We report on the construction of the PAN Wikipedia vandalism corpus, PAN-WVC-10, using Amazon's Mechanical Turk. The corpus compiles 32452 edits on 28468 Wikipedia articles, among which 2391 vandalism edits have been identified. 753 human annotators cast a total of 193022 votes on the edits, so that each edit was reviewed by at least 3 annotators, whereas the achieved level of agreement was analyzed in order to label an edit as "regular" or "vandalism." The corpus is available free of charge.

Martin Potthast | Martin Potthast

[1] and software — performance evaluation , .

[2] Charles L. A. Clarke,et al. Using dynamic markov compression to detect vandalism in the wikipedia , 2009, SIGIR.

[3] John Riedl,et al. Creating, destroying, and restoring value in wikipedia , 2007, GROUP.

[4] R. Stuart Geiger,et al. The work of sustaining order in wikipedia: the banning of a vandal , 2010, CSCW '10.

[5] Bart Goethals,et al. Automatic Vandalism Detection in Wikipedia : Towards a Machine Learning Approach , 2008 .

[6] Benno Stein,et al. Automatic Vandalism Detection in Wikipedia , 2008, ECIR.