Learned Forensic Source Similarity for Unknown Camera Models

Information about an image's source camera model is important knowledge in many forensic investigations. In this paper we propose a system that compares two image patches to determine if they were captured by the same camera model. To do this, we first train a CNN based feature extractor to output generic, high level features which encode information about the source camera model of an image patch. Then, we learn a similarity measure that maps pairs of these features to a score indicating whether the two image patches were captured by the same or different camera models. We show that our proposed system accurately determines if two patches were captured by the same or different camera models, even when the camera models are unknown to the investigator. We also demonstrate the utility of this approach for image splicing detection and localization.

[1]  Matthew C. Stamm,et al.  Camera model identification framework using an ensemble of demosaicing features , 2015, 2015 IEEE International Workshop on Information Forensics and Security (WIFS).

[2]  Min Wu,et al.  Nonintrusive component forensics of visual sensors using output images , 2007, IEEE Transactions on Information Forensics and Security.

[3]  Yann LeCun,et al.  Learning a similarity metric discriminatively, with application to face verification , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[4]  Paolo Bestagini,et al.  Tampering Detection and Localization Through Clustering of Camera-Based CNN Features , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[5]  Mohan S. Kankanhalli,et al.  Identifying Source Cell Phone using Chromatic Aberration , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[6]  Belhassen Bayar,et al.  Augmented convolutional feature maps for robust CNN-based camera model identification , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[7]  Belhassen Bayar,et al.  Design Principles of Convolutional Neural Networks for Multimedia Forensics , 2017, Media Watermarking, Security, and Forensics.

[8]  Min Wu,et al.  Information Forensics: An Overview of the First Decade , 2013, IEEE Access.

[9]  Nikos Komodakis,et al.  Learning to compare image patches via convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Miroslav Goljan,et al.  Using sensor pattern noise for camera model identification , 2008, 2008 15th IEEE International Conference on Image Processing.

[11]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[12]  Marc Chaumont,et al.  Camera model identification with the use of deep convolutional neural networks , 2016, 2016 IEEE International Workshop on Information Forensics and Security (WIFS).

[13]  Paolo Bestagini,et al.  Forensic Camera Model Identification: Highlights from the IEEE Signal Processing Cup 2018 Student Competition [SP Competitions] , 2018, IEEE Signal Processing Magazine.

[14]  Yun Q. Shi,et al.  Camera Model Identification Using Local Binary Patterns , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[15]  Paolo Bestagini,et al.  A Preliminary Study on Convolutional Neural Networks for Camera Model Identification , 2017, Media Watermarking, Security, and Forensics.

[16]  Paolo Bestagini,et al.  First Steps Toward Camera Model Identification With Convolutional Neural Networks , 2016, IEEE Signal Processing Letters.

[17]  Belhassen Bayar,et al.  A Deep Learning Approach to Universal Image Manipulation Detection Using a New Convolutional Layer , 2016, IH&MMSec.

[18]  Matthew C. Stamm,et al.  Computationally efficient demosaicing filter estimation for forensic camera model identification , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[19]  Nasir D. Memon,et al.  Source camera identification based on CFA interpolation , 2005, IEEE International Conference on Image Processing 2005.

[20]  Alex ChiChung Kot,et al.  Accurate Detection of Demosaicing Regularity for Digital Image Forensics , 2009, IEEE Transactions on Information Forensics and Security.

[21]  Florent Retraint,et al.  Camera Model Identification Based on the Heteroscedastic Noise Model , 2014, IEEE Transactions on Image Processing.

[22]  Alessandro Piva,et al.  Image Forgery Localization via Fine-Grained Analysis of CFA Artifacts , 2012, IEEE Transactions on Information Forensics and Security.

[23]  Rainer Böhme,et al.  The 'Dresden Image Database' for benchmarking digital image forensics , 2010, SAC '10.

[24]  Yann LeCun,et al.  Signature Verification Using A "Siamese" Time Delay Neural Network , 1993, Int. J. Pattern Recognit. Artif. Intell..

[25]  Nasir D. Memon,et al.  Image tamper detection based on demosaicing artifacts , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).