MVFNN: Multi-Vision Fusion Neural Network for Fake News Picture Detection

During this year’s Novel Coronavirus (2019-nCoV) outbreak, the spread of fake news has caused serious social panic This fact necessitates a focus on fake news detection Pictures could be viewed as fake news indicators and hence could be used to identify fake news effectively However, fake news pictures detection is more challenging since fake news picture identification is more difficult than the fake picture recognition This paper proposes a multi-vision fusion neural network (MVFNN) which consists of four main components: the visual modal module, the visual feature fusion module, the physical feature module and the ensemble module The visual modal module is responsible for extracting image features from images pixel domain, frequency domain, and tamper detection It cooperates with the visual features fusion module to detect fake news images from multi-vision fusion And the ensemble module combines visual features and physical features to detect the fake news pictures Experimental results show that our model could achieve better detection performance by at least 4 29% than the existing methods in benchmark datasets © 2020, Springer Nature Switzerland AG

[1]  Wei Gao,et al.  Detect Rumors on Twitter by Promoting Information Campaigns with Generative Adversarial Learning , 2019, WWW.

[2]  Yongdong Zhang,et al.  Novel Visual and Statistical Image Features for Microblogs News Verification , 2017, IEEE Transactions on Multimedia.

[3]  Vasudeva Varma,et al.  MVAE: Multimodal Variational Autoencoder for Fake News Detection , 2019, WWW.

[4]  Huan Liu,et al.  Beyond News Contents: The Role of Social Context for Fake News Detection , 2017, WSDM.

[5]  Neil Shah,et al.  False Information on Web and Social Media: A Survey , 2018, ArXiv.

[6]  Kenny Q. Zhu,et al.  False rumors detection on Sina Weibo by propagation structures , 2015, 2015 IEEE 31st International Conference on Data Engineering.

[7]  Huan Liu,et al.  Mining Misinformation in Social Media , 2016 .

[8]  Jintao Li,et al.  Exploiting Multi-domain Visual Information for Fake News Detection , 2019, 2019 IEEE International Conference on Data Mining (ICDM).

[9]  Jürgen Schmidhuber,et al.  Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction , 2011, ICANN.

[10]  Yongdong Zhang,et al.  Multimodal Fusion with Recurrent Neural Networks for Rumor Detection on Microblogs , 2017, ACM Multimedia.

[11]  Fenglong Ma,et al.  EANN: Event Adversarial Neural Networks for Multi-Modal Fake News Detection , 2018, KDD.

[12]  Arkaitz Zubiaga,et al.  Detection and Resolution of Rumours in Social Media , 2017, ACM Comput. Surv..

[13]  Suhang Wang,et al.  Fake News Detection on Social Media: A Data Mining Perspective , 2017, SKDD.

[14]  M. Gentzkow,et al.  Social Media and Fake News in the 2016 Election , 2017 .