TICCA - A Co-attention Network for Multimodal Fake News Detection

The way people consuming news changed from traditional news papers to social media like Weibo and Twitter with the development of information technology, which facilitates the propagation of fake news. Several studies have made great contributions to fake news detection with multimodal contents, but the relationship between news contents and user comments is not fully exploited. In this work, we propose a fake news detection method named TICCA (Text, Images, Comments Co-Attention) using not only contents including news text and news images but also user comments, the news images features and news text features are fused by text-image co-attention, the correlation between news text and user comments is extracted by text-comment co-attention, the correlation between news images and user comments is extracted by comment-image co-attention. The experimental results show the effectiveness of our method.

[1]  Wendy Hall,et al.  Network Analysis Literacy , 2015, Lecture Notes in Social Networks.

[2]  R. Zafarani,et al.  SAFE: Similarity-Aware Multi-modal Fake News Detection , 2020, PAKDD.

[3]  W. Wang,et al.  r/Fakeddit: A New Multimodal Benchmark Dataset for Fine-grained Fake News Detection , 2019, ArXiv.

[4]  Ponnurangam Kumaraguru,et al.  SpotFake: A Multi-modal Framework for Fake News Detection , 2019, 2019 IEEE Fifth International Conference on Multimedia Big Data (BigMM).

[5]  Huan Liu,et al.  dEFEND: Explainable Fake News Detection , 2019, KDD.

[6]  Vasudeva Varma,et al.  MVAE: Multimodal Variational Autoencoder for Fake News Detection , 2019, WWW.

[7]  Jiliang Tang,et al.  Learning Hierarchical Discourse-level Structure for Fake News Detection , 2019, NAACL.

[8]  Fenglong Ma,et al.  EANN: Event Adversarial Neural Networks for Multi-Modal Fake News Detection , 2018, KDD.

[9]  Zhoujun Li,et al.  TI-CNN: Convolutional Neural Networks for Fake News Detection , 2018, ArXiv.

[10]  Huan Liu,et al.  Beyond News Contents: The Role of Social Context for Fake News Detection , 2017, WSDM.

[11]  Yongdong Zhang,et al.  Multimodal Fusion with Recurrent Neural Networks for Rumor Detection on Microblogs , 2017, ACM Multimedia.

[12]  Bennett Kleinberg,et al.  Automatic Detection of Fake News , 2017, COLING.

[13]  Suhang Wang,et al.  Fake News Detection on Social Media: A Data Mining Perspective , 2017, SKDD.

[14]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[15]  Dumitru Erhan,et al.  Show and Tell: Lessons Learned from the 2015 MSCOCO Image Captioning Challenge , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[17]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[18]  S. Hochreiter,et al.  Long Short-Term Memory , 1997, Neural Computation.

[19]  Zhen Xu,et al.  Multimodal Fusion with Co-Attention Networks for Fake News Detection , 2021, FINDINGS.