Integrating Pattern- and Fact-based Fake News Detection via Model Preference Learning

To defend against fake news, researchers have developed various methods based on texts. These methods can be grouped as 1) pattern-based methods, which focus on shared patterns among fake news posts rather than the claim itself; and 2) fact-based methods, which retrieve from external sources to verify the claim's veracity without considering patterns. The two groups of methods, which have different preferences of textual clues, actually play complementary roles in detecting fake news. However, few works consider their integration. In this paper, we study the problem of integrating pattern- and fact-based models into one framework via modeling their preference differences, i.e., making the pattern- and fact-based models focus on respective preferred parts in a post and mitigate interference from non-preferred parts as possible. To this end, we build a Preference-aware Fake News Detection Framework (Pref-FEND), which learns the respective preferences of pattern- and fact-based models for joint detection. We first design a heterogeneous dynamic graph convolutional network to generate the respective preference maps, and then use these maps to guide the joint learning of pattern- and fact-based models for final prediction. Experiments on two real-world datasets show that Pref-FEND effectively captures model preferences and improves the performance of models based on patterns, facts, or both.

[1]  Xiong Yang,et al.  Evidence-Aware Hierarchical Interactive Attention Networks for Explainable Claim Verification , 2020, IJCAI.

[2]  Lysandre Debut,et al.  HuggingFace's Transformers: State-of-the-art Natural Language Processing , 2019, ArXiv.

[3]  Christopher Leckie,et al.  Embracing Domain Differences in Fake News: Cross-domain Fake News Detection using Multi-modal Data , 2021, AAAI.

[4]  Ambreen Nazir,et al.  Category-Controlled Encoder-Decoder for Fake News Detection , 2023, IEEE Transactions on Knowledge and Data Engineering.

[5]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[6]  Yu Qiao,et al.  Attention-Driven Dynamic Graph Convolutional Network for Multi-label Image Recognition , 2020, ECCV.

[7]  Xirong Li,et al.  Mining Dual Emotion for Fake News Detection , 2019, WWW.

[8]  Lei Zhong,et al.  Article Reranking by Memory-Enhanced Key Sentence Matching for Detecting Previously Fact-Checked Claims , 2021, ACL.

[9]  Saif Mohammad,et al.  CROWDSOURCING A WORD–EMOTION ASSOCIATION LEXICON , 2013, Comput. Intell..

[10]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[11]  Jürgen Schmidhuber,et al.  Framewise phoneme classification with bidirectional LSTM and other neural network architectures , 2005, Neural Networks.

[12]  Jintao Li,et al.  Automatic Rumor Detection on Microblogs: A Survey , 2018, ArXiv.

[13]  Preslav Nakov,et al.  FANG: Leveraging Social Context for Fake News Detection Using Graph Representation , 2020, CIKM.

[14]  Changsheng Xu,et al.  Multi-modal Knowledge-aware Event Memory Network for Social Media Rumor Detection , 2019, ACM Multimedia.

[15]  S. Naeem,et al.  The Covid‐19 ‘infodemic’: a new front for information professionals , 2020, Health information and libraries journal.

[16]  Kyumin Lee,et al.  Where Are the Facts? Searching for Fact-checked Information to Alleviate the Spread of Fake News , 2020, EMNLP.

[17]  Reza Zafarani,et al.  Network-based Fake News Detection: A Pattern-driven Approach , 2019, SKDD.

[18]  Huan Liu,et al.  Hierarchical Propagation Networks for Fake News Detection: Investigation and Exploitation , 2019, ICWSM.

[19]  Christian Hansen,et al.  MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claims , 2019, EMNLP.

[20]  Kai Wang,et al.  Relational Graph Attention Network for Aspect-based Sentiment Analysis , 2020, ACL.

[21]  Linmei Hu,et al.  Heterogeneous Graph Attention Networks for Semi-supervised Short Text Classification , 2019, EMNLP.

[22]  Preslav Nakov,et al.  That is a Known Lie: Detecting Previously Fact-Checked Claims , 2020, ACL.

[23]  Huan Liu,et al.  dEFEND , 2019, Proceedings of the 28th ACM International Conference on Information and Knowledge Management.

[24]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[25]  Lemao Liu,et al.  TexSmart: A System for Enhanced Natural Language Understanding , 2021, Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing: System Demonstrations.

[26]  Niloy Ganguly,et al.  Stop Clickbait: Detecting and preventing clickbaits in online news media , 2016, 2016 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[27]  Fenglong Ma,et al.  EANN: Event Adversarial Neural Networks for Multi-Modal Fake News Detection , 2018, KDD.

[28]  Jiliang Tang,et al.  Learning Hierarchical Discourse-level Structure for Fake News Detection , 2019, NAACL.

[29]  Kam-Fai Wong,et al.  Sentence-Level Evidence Embedding for Claim Verification with Hierarchical Attention Networks , 2019, ACL.

[30]  Lemao Liu,et al.  TexSmart: A Text Understanding System for Fine-Grained NER and Enhanced Semantic Analysis , 2020, ArXiv.

[31]  Shimon Kogan,et al.  Fake News: Evidence from Financial Markets , 2019 .

[32]  Eunsol Choi,et al.  Truth of Varying Shades: Analyzing Language in Fake News and Political Fact-Checking , 2017, EMNLP.

[33]  Gerhard Weikum,et al.  DeClarE: Debunking Fake News and False Claims using Evidence-Aware Deep Learning , 2018, EMNLP.

[34]  Fenglong Ma,et al.  DETERRENT: Knowledge Guided Graph Attention Network for Detecting Healthcare Misinformation , 2020, KDD.

[35]  Francisco Rangel,et al.  FakeFlow: Fake News Detection by Modeling the Flow of Affective Information , 2021, EACL.

[36]  EANN , 2018, Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining.

[37]  Ke Sun,et al.  Chinese Lexical Analysis with Deep Bi-GRU-CRF Network , 2018, ArXiv.

[38]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[39]  Wei Lu,et al.  Attention Guided Graph Convolutional Networks for Relation Extraction , 2019, ACL.

[40]  Andreas Vlachos,et al.  The Fact Extraction and VERification (FEVER) Shared Task , 2018, FEVER@EMNLP.

[41]  Kyumin Lee,et al.  Hierarchical Multi-head Attentive Network for Evidence-aware Fake News Detection , 2021, EACL.

[42]  Svitlana Volkova,et al.  Separating Facts from Fiction: Linguistic Models to Classify Suspicious and Trusted News Posts on Twitter , 2017, ACL.

[43]  Piotr Przybyla,et al.  Capturing the Style of Fake News , 2020, AAAI.

[44]  Victor S. Lempitsky,et al.  Unsupervised Domain Adaptation by Backpropagation , 2014, ICML.

[45]  FANG , 2020, Proceedings of the 29th ACM International Conference on Information & Knowledge Management.

[46]  Paolo Rosso,et al.  Leveraging Emotional Signals for Credibility Detection , 2019, SIGIR.

[47]  Christopher Leckie,et al.  Propagation2Vec: Embedding partial propagation networks for explainable fake news early detection , 2021, Inf. Process. Manag..

[48]  Reza Zafarani,et al.  The Role of User Profiles for Fake News Detection , 2019, 2019 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[49]  Oluwaseun Ajao,et al.  Sentiment Aware Fake News Detection on Online Social Networks , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[50]  Suhang Wang,et al.  Fake News Detection on Social Media: A Data Mining Perspective , 2017, SKDD.

[51]  Jan Eric Lenssen,et al.  Fast Graph Representation Learning with PyTorch Geometric , 2019, ArXiv.

[52]  Lianwei Wu,et al.  Evidence Inference Networks for Interpretable Claim Verification , 2021, AAAI.

[53]  Arkaitz Zubiaga,et al.  All-in-one: Multi-task Learning for Rumour Verification , 2018, COLING.

[54]  Jintao Li,et al.  Rumor Detection with Hierarchical Social Attention Network , 2018, CIKM.

[55]  Hannaneh Hajishirzi,et al.  Fact or Fiction: Verifying Scientific Claims , 2020, EMNLP.

[56]  Qiang Dong,et al.  HowNet - a hybrid language and knowledge resource , 2003, International Conference on Natural Language Processing and Knowledge Engineering, 2003. Proceedings. 2003.

[57]  Vinay Setty,et al.  SADHAN: Hierarchical Attention Networks to Learn Latent Aspect Embeddings for Fake News Detection , 2019, ICTIR.

[58]  Barbara Poblete,et al.  Information credibility on twitter , 2011, WWW.