Fake News Spreader Detection on Twitter using Character N-Grams

The authors of fake news often use facts from verified news sources and mix them with misinformation to create confusion and provoke unrest among the readers. The spread of fake news can thereby have serious implications on our society. They can sway political elections, push down the stock price or crush reputations of corporations or public figures. Several websites have taken on the mission of checking rumors and allegations, but are often not fast enough to check the content of all the news being disseminated. Especially social media websites have offered an easy platform for the fast propagation of information. Towards limiting fake news from being propagated among social media users, the task of this year's PAN 2020 challenge lays the focus on the fake news spreaders. The aim of the task is to determine whether it is possible to discriminate authors that have shared fake news in the past from those that have never done it. In this notebook, we describe our profiling system for the fake news detection task on Twitter. For this, we conduct different feature extraction techniques and learning experiments from a multilingual perspective, namely English and Spanish. Our final submitted systems use character n-grams as features in combination with a linear SVM for English and Logistic Regression for the Spanish language. Our submitted models achieve an overall accuracy of 73% and 79% on the English and Spanish official test set, respectively. Our experiments show that it is difficult to differentiate solidly fake news spreaders on Twitter from users who share credible information leaving room for further investigations. Our model ranked 3rd out of 72 competitors.

[1]  Benno Stein,et al.  Overview of the Author Profiling Task at PAN 2013 , 2013, CLEF.

[2]  Andreas Vlachos,et al.  FEVER: a Large-scale Dataset for Fact Extraction and VERification , 2018, NAACL.

[3]  Yang Liu,et al.  Early Detection of Fake News on Social Media Through Propagation Path Classification with Recurrent and Convolutional Networks , 2018, AAAI.

[4]  Luis Villaseñor Pineda,et al.  Evaluating Topic-Based Representations for Author Profiling in Social Media , 2016, IBERAMIA.

[5]  Janet L Kunciw Profile of a Terrorist. , 1988 .

[6]  Benno Stein,et al.  A Stylometric Inquiry into Hyperpartisan and Fake News , 2017, ACL.

[7]  Paolo Rosso,et al.  Leveraging Emotional Signals for Credibility Detection , 2019, SIGIR.

[8]  Paolo Rosso,et al.  Overview of the 8th Author Profiling Task at PAN 2020: Profiling Fake News Spreaders on Twitter , 2020, CLEF.

[9]  Reza Zafarani,et al.  Network-based Fake News Detection: A Pattern-driven Approach , 2019, SKDD.

[10]  Benno Stein,et al.  TIRA Integrated Research Architecture , 2019, Information Retrieval Evaluation in a Changing World.

[11]  William Yang Wang “Liar, Liar Pants on Fire”: A New Benchmark Dataset for Fake News Detection , 2017, ACL.

[12]  Verónica Pérez-Rosas,et al.  Automatic Detection of Fake News , 2017, COLING.

[13]  Pasqual Martí,et al.  Profiling Fake News Spreaders on Twitter , 2020, CLEF.

[14]  M. D. Rijke,et al.  Information Retrieval Evaluation in a Changing World: Lessons Learned from 20 Years of CLEF , 2019, Information Retrieval Evaluation in a Changing World.

[15]  Moshe Koppel,et al.  Authorship verification as a one-class classification problem , 2004, ICML.

[16]  Regina Barzilay,et al.  Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) , 2017, ACL 2017.