Identification of Social-Media Platform of Videos through the Use of Shared Features

Videos have become a powerful tool for spreading illegal content such as military propaganda, revenge porn, or bullying through social networks. To counter these illegal activities, it has become essential to try new methods to verify the origin of videos from these platforms. However, collecting datasets large enough to train neural networks for this task has become difficult because of the privacy regulations that have been enacted in recent years. To mitigate this limitation, in this work we propose two different solutions based on transfer learning and multitask learning to determine whether a video has been uploaded from or downloaded to a specific social platform through the use of shared features with images trained on the same task. By transferring features from the shallowest to the deepest levels of the network from the image task to videos, we measure the amount of information shared between these two tasks. Then, we introduce a model based on multitask learning, which learns from both tasks simultaneously. The promising experimental results show, in particular, the effectiveness of the multitask approach. According to our knowledge, this is the first work that addresses the problem of social media platform identification of videos through the use of shared features.

[1]  Vladimir Iglovikov,et al.  Camera Model Identification Using Convolutional Neural Networks , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[2]  Matthew C. Stamm,et al.  Open Set Video Camera Model Verification , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Giulia Boato,et al.  Media forensics on social media platforms: a survey , 2021, EURASIP Journal on Information Security.

[4]  Belhassen Bayar,et al.  Learning Unified Deep-Features for Multiple Forensic Tasks , 2018, IH&MMSec.

[5]  Davide Cozzolino,et al.  Extracting camera-based fingerprints for video forensics , 2019, CVPR Workshops.

[6]  J. Cotton Fighting Fake News: , 2018 .

[7]  Matthew C. Stamm,et al.  Forensic Similarity for Digital Images , 2019, IEEE Transactions on Information Forensics and Security.

[8]  Matthew C. Stamm,et al.  Exposing Fake Images With Forensic Similarity Graphs , 2020, IEEE Journal of Selected Topics in Signal Processing.

[9]  Paolo Bestagini,et al.  First Steps Toward Camera Model Identification With Convolutional Neural Networks , 2016, IEEE Signal Processing Letters.

[10]  Md. Kamrul Hasan,et al.  Application of DenseNet in Camera Model Identification and Post-processing Detection , 2018, CVPR Workshops.

[11]  Weihong Wang,et al.  Exposing digital forgeries in video by detecting double MPEG compression , 2006, MM&Sec '06.

[12]  Irene Amerini,et al.  Learning Double-Compression Video Fingerprints Left From Social-Media Platforms , 2021, ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[13]  Babak Mahdian,et al.  JPEG Quantization Tables Forensics: A Statistical Approach , 2010, ICWF.

[14]  Danilo Montesi,et al.  Profile resolution across multilayer networks through smartphone camera fingerprint , 2015, IDEAS.

[15]  Giulia Boato,et al.  Tracking Multiple Image Sharing on Social Networks , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[16]  Nasir Memon,et al.  Camera Fingerprint Extraction via Spatial Domain Averaged Frames , 2020, IEEE Transactions on Information Forensics and Security.

[17]  Matthew C. Stamm,et al.  Camera model identification framework using an ensemble of demosaicing features , 2015, 2015 IEEE International Workshop on Information Forensics and Security (WIFS).

[18]  Ahmet Emir Dirik,et al.  PRNU-based source device attribution for YouTube videos , 2019, Digit. Investig..

[19]  Zeno J. M. H. Geradts,et al.  Source video camera identification for multiply compressed videos originating from YouTube , 2009, Digit. Investig..

[20]  Luisa Verdoliva Deep Learning in Multimedia Forensics , 2018, IH&MMSec.

[21]  Marco Fontani,et al.  A Video Forensic Framework for the Unsupervised Analysis of MP4-Like File Container , 2019, IEEE Transactions on Information Forensics and Security.

[22]  Andrew Owens,et al.  Fighting Fake News: Image Splice Detection via Learned Self-Consistency , 2018, ECCV.

[23]  Hany Farid,et al.  Statistical Tools for Digital Forensics , 2004, Information Hiding.

[24]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[25]  Davide Cozzolino,et al.  Combining PRNU and noiseprint for robust and efficient device source identification , 2020, EURASIP J. Inf. Secur..

[26]  Yu Zhang,et al.  A Survey on Multi-Task Learning , 2017, IEEE Transactions on Knowledge and Data Engineering.

[27]  Sebastiano Battiato,et al.  Image Manipulation on Facebook for Forensics Evidence , 2015, ICIAP.

[28]  Saiful Islam,et al.  Social Media Origin Based Image Tracing Using Deep CNN , 2019, 2019 Fifth International Conference on Image Information Processing (ICIIP).

[29]  Felix C. Freiling,et al.  Forensic source identification using JPEG image headers: The case of smartphones , 2019, Digit. Investig..

[30]  Miroslav Goljan,et al.  Digital camera identification from sensor pattern noise , 2006, IEEE Transactions on Information Forensics and Security.

[31]  L. Villalba,et al.  Digital Video Source Identification Based on Container’s Structure Analysis , 2020, IEEE Access.

[32]  Xinghao Ding,et al.  Camera Identification Based on Domain Knowledge-Driven Deep Multi-Task Learning , 2019, IEEE Access.

[33]  Marco Fontani,et al.  VISION: a video and image dataset for source identification , 2017, EURASIP Journal on Information Security.

[34]  Marco Fontani,et al.  Hybrid reference-based Video Source Identification , 2019, Sensors.

[35]  Chang-Tsun Li,et al.  PRNU-based Image Classification of Origin Social Network with CNN , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).

[36]  Belhassen Bayar,et al.  Constrained Convolutional Neural Networks: A New Approach Towards General Purpose Image Manipulation Detection , 2018, IEEE Transactions on Information Forensics and Security.

[37]  Dasara Shullani,et al.  Efficient Video Integrity Analysis Through Container Characterization , 2020, IEEE Journal of Selected Topics in Signal Processing.

[38]  Qiang Yang,et al.  A Survey on Multi-Task Learning , 2017, IEEE Transactions on Knowledge and Data Engineering.

[39]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[40]  Tiberio Uricchio,et al.  Tracing images back to their social network of origin: A CNN-based approach , 2017, 2017 IEEE Workshop on Information Forensics and Security (WIFS).

[41]  Luisa Verdoliva,et al.  A study of co-occurrence based local features for camera model identification , 2016, Multimedia Tools and Applications.

[42]  Chang-Tsun Li,et al.  Social Network Identification Through Image Classification With CNN , 2019, IEEE Access.

[43]  Andreas Rössler,et al.  ForensicTransfer: Weakly-supervised Domain Adaptation for Forgery Detection , 2018, ArXiv.

[44]  Qiong Zhang,et al.  Image Forensics Based on Transfer Learning and Convolutional Neural Network , 2017, IH&MMSec.

[45]  Davide Cozzolino,et al.  Noiseprint: A CNN-Based Camera Model Fingerprint , 2018, IEEE Transactions on Information Forensics and Security.

[46]  Roberto Caldelli,et al.  Dealing with video source identification in social networks , 2017, Signal Process. Image Commun..