CNN-Based Fast Source Device Identification

Source identification is an important topic in image forensics, since it allows to trace back the origin of an image. This represents a precious information to claim intellectual property but also to reveal the authors of illicit materials. In this letter we address the problem of device identification based on sensor noise and propose a fast and accurate solution using convolutional neural networks (CNNs). Specifically, we propose a 2-channel-based CNN that learns a way of comparing camera fingerprint and image noise at patch level. The proposed solution turns out to be much faster than the conventional approach and to ensure an increased accuracy. This makes the approach particularly suitable in scenarios where large databases of images are analyzed, like over social networks. In this vein, since images uploaded on social media usually undergo at least two compression stages, we include investigations on double JPEG compressed images, always reporting higher accuracy than standard approaches.

[1]  Paolo Bestagini,et al.  Facing Device Attribution Problem for Stabilized Video Sequences , 2018, IEEE Transactions on Information Forensics and Security.

[2]  Cameron Johnson,et al.  SPN-CNN: Boosting Sensor-Based Source Camera Attribution With Deep Learning , 2019, 2019 IEEE International Workshop on Information Forensics and Security (WIFS).

[3]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[4]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[5]  Marco Fontani,et al.  Hybrid reference-based Video Source Identification , 2019, Sensors.

[6]  Nasir D. Memon,et al.  Efficient Sensor Fingerprint Matching Through Fingerprint Binarization , 2012, IEEE Transactions on Information Forensics and Security.

[7]  Nikos Komodakis,et al.  Learning to compare image patches via convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Mo Chen,et al.  Source digital camcorder identification using sensor photo response non-uniformity , 2007, Electronic Imaging.

[9]  Mo Chen,et al.  Determining Image Origin and Integrity Using Sensor Noise , 2008, IEEE Transactions on Information Forensics and Security.

[10]  Rainer Böhme,et al.  The 'Dresden Image Database' for benchmarking digital image forensics , 2010, SAC '10.

[11]  Marc Chaumont,et al.  Camera model identification with the use of deep convolutional neural networks , 2016, 2016 IEEE International Workshop on Information Forensics and Security (WIFS).

[12]  Luisa Verdoliva,et al.  Blind PRNU-Based Image Clustering for Source Identification , 2017, IEEE Transactions on Information Forensics and Security.

[13]  Davide Cozzolino,et al.  Noiseprint: A CNN-Based Camera Model Fingerprint , 2018, IEEE Transactions on Information Forensics and Security.

[14]  Nasir D. Memon,et al.  Sensor Fingerprint Identification Through Composite Fingerprints and Group Testing , 2015, IEEE Transactions on Information Forensics and Security.

[15]  Subhransu Maji,et al.  Bilinear CNN Models for Fine-Grained Visual Recognition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[16]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[17]  Miroslav Goljan,et al.  Digital camera identification from sensor pattern noise , 2006, IEEE Transactions on Information Forensics and Security.

[18]  Luisa Verdoliva,et al.  A Bayesian-MRF Approach for PRNU-Based Image Forgery Detection , 2014, IEEE Transactions on Information Forensics and Security.

[19]  Andrew Owens,et al.  Fighting Fake News: Image Splice Detection via Learned Self-Consistency , 2018, ECCV.

[20]  Marco Fontani,et al.  VISION: a video and image dataset for source identification , 2017, EURASIP Journal on Information Security.

[21]  Chang-Tsun Li,et al.  PRNU-based Image Classification of Origin Social Network with CNN , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).

[22]  Nasir D. Memon,et al.  Fast camera fingerprint matching in very large databases , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[23]  Paolo Bestagini,et al.  Fooling PRNU-Based Detectors Through Convolutional Neural Networks , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).

[24]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[25]  Enes Altinisik,et al.  Mitigation of H.264 and H.265 Video Compression for Reliable PRNU Estimation , 2019, IEEE Transactions on Information Forensics and Security.

[26]  Chang-Tsun Li Large-Scale Image Clustering Based on Camera Fingerprints , 2017, IEEE Transactions on Information Forensics and Security.

[27]  Paolo Bestagini,et al.  First Steps Toward Camera Model Identification With Convolutional Neural Networks , 2016, IEEE Signal Processing Letters.

[28]  Jessica J. Fridrich,et al.  Managing a large database of camera fingerprints , 2010, Electronic Imaging.

[29]  Paolo Bestagini,et al.  Improving PRNU Compression Through Preprocessing, Quantization, and Coding , 2019, IEEE Transactions on Information Forensics and Security.

[30]  Matthew C. Stamm,et al.  Forensic Similarity for Digital Images , 2019, IEEE Transactions on Information Forensics and Security.

[31]  Giulia Boato,et al.  Accurate and Scalable Image Clustering Based on Sparse Representation of Camera Fingerprint , 2019, IEEE Transactions on Information Forensics and Security.

[32]  Min Wu,et al.  Exploring compression effects for improved source camera identification using strongly compressed video , 2011, 2011 18th IEEE International Conference on Image Processing.

[33]  Enrico Magli,et al.  Compressed Fingerprint Matching and Camera Identification via Random Projections , 2015, IEEE Transactions on Information Forensics and Security.