Publishing a Quality Context-aware Annotated Corpus and Lexicon for Harassment Research

Having a quality annotated corpus is essential especially for applied research. Despite the recent focus of Web science community on researching about cyberbullying, the community dose not still have standard benchmarks. In this paper, we publish first, a quality annotated corpus and second, an offensive words lexicon capturing different types type of harassment as (i) sexual harassment, (ii) racial harassment, (iii) appearance-related harassment, (iv) intellectual harassment, and (v) political harassment.We crawled data from Twitter using our offensive lexicon. Then relied on the human judge to annotate the collected tweets w.r.t. the contextual types because using offensive words is not sufficient to reliably detect harassment. Our corpus consists of 25,000 annotated tweets in five contextual types. We are pleased to share this novel annotated corpus and the lexicon with the research community. The instruction to acquire the corpus has been published on the Git repository.

[1]  Gianluca Stringhini,et al.  Mean Birds: Detecting Aggression and Bullying on Twitter , 2017, WebSci.

[2]  Bert Huang,et al.  Cyberbullying Detection with Weakly Supervised Machine Learning , 2017, 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[3]  Ann Frisén,et al.  Appearance-related cyberbullying: a qualitative investigation of characteristics, content, reasons, and effects. , 2014, Body image.

[4]  Shivakant Mishra,et al.  Prediction of cyberbullying incidents in a media-based social network , 2016, 2016 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[5]  M. McHugh Interrater reliability: the kappa statistic , 2012, Biochemia medica.

[6]  Brian D. Davison,et al.  Detection of Harassment on Web 2.0 , 2009 .

[7]  Cody Buntain,et al.  A Large Labeled Corpus for Online Harassment Research , 2017, WebSci.