Reliability Map Estimation for CNN-Based Camera Model Attribution

Among the image forensic issues investigated in the last few years, great attention has been devoted to blind camera model attribution. This refers to the problem of detecting which camera model has been used to acquire an image by only exploiting pixel information. Solving this problem has great impact on image integrity assessment as well as on authenticity verification. Recent advancements that use convolutional neural networks (CNNs) in the media forensic field have enabled camera model attribution methods to work well even on small image patches. These improvements are also important for determining forgery localization. Some patches of an image may not contain enough information related to the camera model (e.g., saturated patches). In this paper, we propose a CNN-based solution to estimate the camera model attribution reliability of a given image patch. We show that we can estimate a reliabilitymap indicating which portions of the image contain reliable camera traces. Testing using a well known dataset confirms that by using this information, it is possible to increase small patch camera model attribution accuracy by more than 8% on a single patch.

[1]  Marc Chaumont,et al.  Source Camera Model Identification Using Features from Contaminated Sensor Noise , 2015, IWDW.

[2]  Z. Jane Wang,et al.  Median Filtering Forensics Based on Convolutional Neural Networks , 2015, IEEE Signal Processing Letters.

[3]  Leslie N. Smith,et al.  Cyclical Learning Rates for Training Neural Networks , 2015, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[4]  Nasir D. Memon,et al.  Source camera identification based on CFA interpolation , 2005, IEEE International Conference on Image Processing 2005.

[5]  Min Wu,et al.  Information Forensics: An Overview of the First Decade , 2013, IEEE Access.

[6]  Luisa Verdoliva,et al.  Evaluation of Residual-Based Local Features for Camera Model Identification , 2015, ICIAP Workshops.

[7]  Chiou-Ting Hsu,et al.  Source Camera Identification Based on Camera Gain Histogram , 2007, 2007 IEEE International Conference on Image Processing.

[8]  Belhassen Bayar,et al.  A Deep Learning Approach to Universal Image Manipulation Detection Using a New Convolutional Layer , 2016, IH&MMSec.

[9]  Yao Zhao,et al.  Forensic detection of median filtering in digital images , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[10]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[11]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[12]  Miroslav Goljan,et al.  Using sensor pattern noise for camera model identification , 2008, 2008 15th IEEE International Conference on Image Processing.

[13]  Yun Q. Shi,et al.  Structural Design of Convolutional Neural Networks for Steganalysis , 2016, IEEE Signal Processing Letters.

[14]  Min Wu,et al.  Digital image forensics via intrinsic fingerprints , 2008, IEEE Transactions on Information Forensics and Security.

[15]  Marc Chaumont,et al.  Camera model identification based machine learning approach with high order statistics features , 2016, 2016 24th European Signal Processing Conference (EUSIPCO).

[16]  Marc Chaumont,et al.  Camera model identification with the use of deep convolutional neural networks , 2016, 2016 IEEE International Workshop on Information Forensics and Security (WIFS).

[17]  Jessica J. Fridrich,et al.  Camera identification from cropped and scaled images , 2008, Electronic Imaging.

[18]  Matthew C. Stamm,et al.  Computationally efficient demosaicing filter estimation for forensic camera model identification , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[19]  Anderson Rocha,et al.  Vision of the unseen: Current trends and challenges in digital image and video forensics , 2011, CSUR.

[20]  A. Piva.  An Overview on Image Forensics , 2013 .

[21]  Paolo Bestagini,et al.  Tampering Detection and Localization Through Clustering of Camera-Based CNN Features , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[22]  Mo Chen,et al.  JPEG-Phase-Aware Convolutional Neural Network for Steganalysis of JPEG Images , 2017, IH&MMSec.

[23]  Paolo Bestagini,et al.  A Preliminary Study on Convolutional Neural Networks for Camera Model Identification , 2017, Media Watermarking, Security, and Forensics.

[24]  Paolo Bestagini,et al.  First Steps Toward Camera Model Identification With Convolutional Neural Networks , 2016, IEEE Signal Processing Letters.

[25]  Davide Cozzolino,et al.  Image forgery localization through the fusion of camera-based, feature-based and pixel-based techniques , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[26]  Florent Retraint,et al.  Camera Model Identification Based on the Heteroscedastic Noise Model , 2014, IEEE Transactions on Image Processing.

[27]  Rainer Böhme,et al.  The 'Dresden Image Database' for benchmarking digital image forensics , 2010, SAC '10.

[28]  Matthew C. Stamm,et al.  Camera model identification framework using an ensemble of demosaicing features , 2015, 2015 IEEE International Workshop on Information Forensics and Security (WIFS).

[29]  Shujun Li,et al.  Forensic Camera Model Identification , 2015 .

[30]  Edmund Y Lam,et al.  Automatic source camera identification using the intrinsic lens radial distortion. , 2006, Optics express.

[31]  Miroslav Goljan,et al.  Digital camera identification from sensor pattern noise , 2006, IEEE Transactions on Information Forensics and Security.