Detecting Tampered Videos with Multimedia Forensics and Deep Learning

User-Generated Content (UGC) has become an integral part of the news reporting cycle. As a result, the need to verify videos collected from social media and Web sources is becoming increasingly important for news organisations. While video verification is attracting a lot of attention, there has been limited effort so far in applying video forensics to real-world data. In this work we present an approach for automatic video manipulation detection inspired by manual verification approaches. In a typical manual verification setting, video filter outputs are visually interpreted by human experts. We use two such forensics filters designed for manual verification, one based on Discrete Cosine Transform (DCT) coefficients and a second based on video requantization errors, and combine them with Deep Convolutional Neural Networks (CNN) designed for image classification. We compare the performance of the proposed approach to other works from the state of the art, and discover that, while competing approaches perform better when trained with videos from the same dataset, one of the proposed filters demonstrates superior performance in cross-dataset settings. We discuss the implications of our work and the limitations of the current experimental setup, and propose directions for future research in this area.

[1]  David Vazquez-Padin,et al.  Localization of forgeries in MPEG-2 video through GOP size and DQ analysis , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[2]  Weihong Wang,et al.  Exposing Digital Forgeries in Interlaced and Deinterlaced Video , 2007, IEEE Transactions on Information Forensics and Security.

[3]  Gaobo Yang,et al.  A MCEA based passive forensics scheme for detecting frame-based video tampering , 2012, Digit. Investig..

[4]  Davide Cozzolino,et al.  Video forgery detection and localization based on 3D patchmatch , 2015, 2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[5]  Jessica J. Fridrich,et al.  Rich Models for Steganalysis of Digital Images , 2012, IEEE Transactions on Information Forensics and Security.

[6]  Shaowei Weng,et al.  Deep Learning for Detection of Object-Based Forgery in Advanced Video , 2017, Symmetry.

[7]  Yiannis Kompatsiaris,et al.  Large-scale evaluation of splicing localization algorithms for web images , 2017, Multimedia Tools and Applications.

[8]  Andreas Rössler,et al.  FaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Faces , 2018, ArXiv.

[9]  Tianqiang Huang,et al.  A video forgery detection algorithm based on compressive sensing , 2014, Multimedia Tools and Applications.

[10]  Ioannis Patras,et al.  Comparison of Fine-Tuning and Extension Strategies for Deep Convolutional Neural Networks , 2017, MMM.

[11]  A. Piva An Overview on Image Forensics , 2013 .

[12]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Zhenzhen Zhang,et al.  Efficient video frame insertion and deletion detection based on inconsistency of correlations between local binary pattern coded frames , 2015, Secur. Commun. Networks.

[14]  K. Sitara,et al.  Digital video tampering detection: An overview of passive techniques , 2016, Digit. Investig..

[15]  Yuxing Wu,et al.  Exposing video inter-frame forgery based on velocity field consistency , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[16]  Yuting Su,et al.  Detection of Double-Compression in MPEG-2 Videos , 2010, 2010 2nd International Workshop on Intelligent Systems and Applications.

[17]  Sanjay Kumar Singh,et al.  Passive copy-move forgery detection in videos , 2014, 2014 International Conference on Computer and Communication Technology (ICCCT).

[18]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Wei Zhang,et al.  Detecting Removed Object from Video with Stationary Background , 2012, IWDW.

[20]  Jyh-Jong Tsay,et al.  A passive approach for effective detection and localization of region-level video forgery with spatio-temporal coherence analysis , 2014, Digit. Investig..

[21]  Sabu Emmanuel,et al.  Video forgery detection using HOG features and compression properties , 2012, 2012 IEEE 14th International Workshop on Multimedia Signal Processing (MMSP).

[22]  Bin Li,et al.  Automatic Detection of Object-Based Forgery in Advanced Video , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Qingzhong Liu,et al.  Detection of Double MPEG-2 Compression Based on Distributions of DCT coefficients , 2013, Int. J. Pattern Recognit. Artif. Intell..