Overview of CONSTRAINT 2021 Shared Tasks: Detecting English COVID-19 Fake News and Hindi Hostile Posts

Fake news, hostility, defamation are some of the biggest problems faced in social media We present the findings of the shared tasks (https://constraint-shared-task-2021 github io/ ) conducted at the CONSTRAINT Workshop at AAAI 2021 The shared tasks are ‘COVID19 Fake News Detection in English’ and ‘Hostile Post Detection in Hindi’ The tasks attracted 166 and 44 team submissions respectively The most successful models were BERT or its variations © 2021, Springer Nature Switzerland AG

[1]  Animesh Mukherjee,et al.  HateXplain: A Benchmark Dataset for Explainable Hate Speech Detection , 2020, AAAI.

[2]  Bharathi Raja Chakravarthi,et al.  Findings of the Shared Task on Offensive Language Identification in Tamil, Malayalam, and Kannada , 2021, DRAVIDIANLANGTECH.

[3]  Pushpak Bhattacharyya,et al.  Divide and Conquer: An Ensemble Approach for Hostile Post Detection in Hindi , 2021, CONSTRAINT@AAAI.

[4]  Etsuko Ishii,et al.  Model Generalization on COVID-19 Fake News Detection , 2021, CONSTRAINT@AAAI.

[5]  John Cardiff,et al.  TUDublin team at Constraint@AAAI2021 - COVID19 Fake News Detection , 2021, ArXiv.

[6]  Vasudeva Varma,et al.  Task Adaptive Pretraining of Transformers for Hostility Detection , 2021, ArXiv.

[7]  Xiaobing Zhou,et al.  Extracting Latent Information from Datasets in CONSTRAINT 2021 Shared Task , 2021, CONSTRAINT@AAAI.

[8]  Ian Rowe.  Deliberation 2.0: Comparing the Deliberative Quality of Online News User Comments Across Platforms , 2015 .

[9]  William Yang Wang,et al.  Fakeddit: A New Multimodal Benchmark Dataset for Fine-grained Fake News Detection , 2020, LREC.

[10]  Dongwon Lee,et al.  CoAID: COVID-19 Healthcare Misinformation Dataset , 2020, ArXiv.

[11]  Siddharth Kumar,et al.  Two Stage Transformer Model for COVID-19 Fake News Detection and Fact Checking , 2020, NLP4IF.

[12]  Jie Li,et al.  Fake News and Hostile Posts Detection Using an Ensemble Learning Model , 2021, CONSTRAINT@AAAI.

[13]  Nishant Nikhil,et al.  LSTMs with Attention for Aggression Detection , 2018, TRAC@COLING 2018.

[14]  Jennifer Rose.  To Believe or Not to Believe: an Epistemic Exploration of Fake News, Truth, and the Limits of Knowing , 2019, Postdigital Science and Education.

[15]  Mohammed Moshiul Hoque,et al.  Combating Hostility: Covid-19 Fake News and Hostile Post Detection in Social Media , 2021, ArXiv.

[16]  Raviraj Joshi,et al.  Evaluating Deep Learning Approaches for Covid19 Fake News Detection , 2021, CONSTRAINT@AAAI.

[17]  L. Ross,et al.  The hostile media phenomenon: biased perception and perceptions of media bias in coverage of the Beirut massacre. , 1985, Journal of personality and social psychology.

[18]  Huan Liu,et al.  FakeNewsNet: A Data Repository with News Content, Social Context, and Spatiotemporal Information for Studying Fake News on Social Media , 2018, Big Data.

[19]  Aman Raj,et al.  Tackling the Infodemic: Analysis Using Transformer Based Models , 2021, CONSTRAINT@AAAI.

[20]  Asif Ekbal,et al.  Fighting an Infodemic: COVID-19 Fake News Dataset , 2020, CONSTRAINT@AAAI.

[21]  Sourya Dipta Das,et al.  A Heuristic-driven Ensemble Framework for COVID-19 Fake News Detection , 2021, CONSTRAINT@AAAI.

[22]  Radhika Mamidi,et al.  Transformer based Automatic COVID-19 Fake News Detection System , 2021, ArXiv.

[23]  Asif Ekbal,et al.  Hostility Detection Dataset in Hindi , 2020, ArXiv.

[24]  Maunendra Sankar Desarkar,et al.  Coarse and Fine-Grained Hostility Detection in Hindi Posts using Fine Tuned Multilingual Embeddings , 2021, ArXiv.

[25]  Grigorios Tsoumakas,et al.  ETHOS: a multi-label hate speech detection dataset , 2020, Complex & Intelligent Systems.

[26]  Amar Prakash Azad,et al.  No Rumours Please! A Multi-Indic-Lingual Approach for COVID Fake-Tweet Detection , 2020, 2021 Grace Hopper Celebration India (GHCI).

[27]  Akansha Gautam,et al.  Fake News Detection System using XLNet model with Topic Distributions: CONSTRAINT@AAAI2021 Shared Task , 2021, CONSTRAINT@AAAI.

[28]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[29]  Animesh Mukherjee,et al.  Hateminers : Detecting Hate speech against Women , 2018, ArXiv.

[30]  Mitesh M. Khapra,et al.  iNLPSuite: Monolingual Corpora, Evaluation Benchmarks and Pre-trained Multilingual Language Models for Indian Languages , 2020, FINDINGS.

[31]  Kalina Bontcheva,et al.  Toxic Language Detection in Social Media for Brazilian Portuguese: New Dataset and Multilingual Analysis , 2020, AACL.

[32]  Yu Xia,et al.  Exploring Text-transformers in AAAI 2021 Shared Task: COVID-19 Fake News Detection in English , 2021, CONSTRAINT@AAAI.

[33]  Mark R. Lepper,et al.  The hostile media phenomenon: biased perception and perceptions of media bias in coverage of the Beirut massacre. , 1985 .

[34]  Vasudeva Varma,et al.  Identifying COVID-19 Fake News in Social Media , 2021, ArXiv.

[35]  Marcel Salathé,et al.  COVID-Twitter-BERT: A natural language processing model to analyse COVID-19 content on Twitter , 2020, Frontiers in Artificial Intelligence.

[36]  Yang Zhou,et al.  Transformer-based Language Model Fine-tuning Methods for COVID-19 Fake News Detection , 2021, ArXiv.

[37]  Cristian Canton Ferrer,et al.  The DeepFake Detection Challenge (DFDC) Dataset. , 2020 .

[38]  P. Hrudya,et al.  DHOT-Repository and Classification of Offensive Tweets in the Hindi Language , 2020 .

[39]  Raviraj Joshi,et al.  Evaluation of Deep Learning Models for Hostility Detection in Hindi Text , 2021, ArXiv.

[40]  Juliane A. Lischka,et al.  Hostile Emotions in News Comments: A Cross-National Analysis of Facebook Discussions , 2020 .

[41]  Sebastian Ruder,et al.  Universal Language Model Fine-tuning for Text Classification , 2018, ACL.

[42]  Adarsh Kumar,et al.  Hostility Detection in Hindi leveraging Pre-Trained Language Models , 2021, CONSTRAINT@AAAI.

[43]  Shervin Malmasi,et al.  Evaluating Aggression Identification in Social Media , 2020, TRAC.

[44]  Ralf Krestel,et al.  Bagging BERT Models for Robust Aggression Identification , 2020, TRAC.

[45]  Walid Maalej,et al.  Towards understanding and detecting fake reviews in app stores , 2019, Empirical Software Engineering.

[46]  Mohammed Azhan,et al.  LaDiff ULMFiT: A Layer Differentiated training approach for ULMFiT , 2021, CONSTRAINT@AAAI.

[47]  Alexander F. Gelbukh,et al.  Aggression Detection in Social Media: Using Deep Neural Networks, Data Augmentation, and Pseudo Labeling , 2018, TRAC@COLING 2018.

[48]  Zeyd Boukhers,et al.  ECOL: Early Detection of COVID Lies Using Content, Prior Knowledge and Source Information , 2021, CONSTRAINT@AAAI.

[49]  Senja Pollak,et al.  Identification of COVID-19 related Fake News via Neural Stacking , 2021, CONSTRAINT@AAAI.

[50]  Ritesh Kumar,et al.  Benchmarking Aggression Identification in Social Media , 2018, TRAC@COLING 2018.

[51]  Yashvardhan Sharma,et al.  Stacked Embeddings and Multiple Fine-Tuned XLM-RoBERTa Models for Enhanced Hostility Identification , 2021, CONSTRAINT@AAAI.

[52]  Doug Downey,et al.  Don’t Stop Pretraining: Adapt Language Models to Domains and Tasks , 2020, ACL.

[53]  T. Li.  Cyber-Harassment: A Study of a New Method for an Old Behavior , 2005 .

[54]  Z. Chen,et al.  The Influence of Presumed Fake News Influence: Examining Public Support for Corporate Corrective Response, Media Literacy Interventions, and Governmental Regulation , 2020, What IS News?.

[55]  Maunendra Sankar Desarkar,et al.  Walk in Wild: An Ensemble Approach for Hostility Detection in Hindi Posts , 2021, ArXiv.

[56]  Anna Glazkova,et al.  g2tmn at Constraint@AAAI2021: Exploiting CT-BERT and Ensembling Learning for COVID-19 Fake News Detection , 2020, ArXiv.

[57]  Harald Holone,et al.  The filter bubble and its effect on online personal health information , 2016, Croatian medical journal.

[58]  Rohan Sukumaran,et al.  Hostility Detection and Covid-19 Fake News Detection in Social Media , 2021, ArXiv.

[59]  Ingmar Weber,et al.  Automated Hate Speech Detection and the Problem of Offensive Language , 2017, ICWSM.