DIPPAS: A Deep Image Prior PRNU Anonymization Scheme

Source device identification is an important topic in image forensics since it allows to trace back the origin of an image. Its forensics counter-part is source device anonymization, that is, to mask any trace on the image that can be useful for identifying the source device. A typical trace exploited for source device identification is the Photo Response Non-Uniformity (PRNU), a noise pattern left by the device on the acquired images. In this paper, we devise a methodology for suppressing such a trace from natural images without significant impact on image quality. Specifically, we turn PRNU anonymization into an optimization problem in a Deep Image Prior (DIP) framework. In a nutshell, a Convolutional Neural Network (CNN) acts as generator and returns an image that is anonymized with respect to the source PRNU, still maintaining high visual quality. With respect to widely-adopted deep learning paradigms, our proposed CNN is not trained on a set of input-target pairs of images. Instead, it is optimized to reconstruct the PRNU-free image from the original image under analysis itself. This makes the approach particularly suitable in scenarios where large heterogeneous databases are analyzed and prevents any problem due to lack of generalization. Through numerical examples on publicly available datasets, we prove our methodology to be effective compared to state-of-the-art techniques.

[1]  Hui Zeng,et al.  Removing camera fingerprint to disguise photograph source , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[2]  Andrea Vedaldi,et al.  Deep Image Prior , 2017, International Journal of Computer Vision.

[3]  Paolo Bestagini,et al.  Fooling PRNU-Based Detectors Through Convolutional Neural Networks , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).

[4]  Raja Giryes,et al.  Back-Projection Based Fidelity Term for Ill-Posed Linear Inverse Problems , 2019, IEEE Transactions on Image Processing.

[5]  Jarosław Bernacki On robustness of camera identification algorithms , 2021, Multim. Tools Appl..

[6]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[7]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[8]  Oleksii Sidorov,et al.  Deep Hyperspectral Prior: Single-Image Denoising, Inpainting, Super-Resolution , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[9]  Fantong Kong,et al.  Deep prior-based seismic data interpolation via multi-res U-net , 2020 .

[10]  Paul Honeine,et al.  BB-UNet: U-Net With Bounding Box Prior , 2020, IEEE Journal of Selected Topics in Signal Processing.

[11]  Vincenzo Lipari,et al.  Wavefield compression for seismic imaging via convolutional neural networks , 2019, SEG Technical Program Expanded Abstracts 2019.

[12]  Emmanuel J. Candès,et al.  The curvelet transform for image denoising , 2002, IEEE Trans. Image Process..

[13]  Augusto Sarti,et al.  Seismic data interpolation through convolutional autoencoder , 2018 .

[14]  Dirk Roose,et al.  Wavelet-based image denoising using a Markov random field a priori model , 1997, IEEE Trans. Image Process..

[15]  Marco Fontani,et al.  VISION: a video and image dataset for source identification , 2017, EURASIP Journal on Information Security.

[16]  Mathews Jacob,et al.  MoDL: Model-Based Deep Learning Architecture for Inverse Problems , 2017, IEEE Transactions on Medical Imaging.

[17]  Mo Chen,et al.  Source digital camcorder identification using sensor photo response non-uniformity , 2007, Electronic Imaging.

[18]  Guangming Shi,et al.  Denoising Prior Driven Deep Neural Network for Image Restoration , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Vincenzo Lipari,et al.  Inpainting-Based camera anonymization , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[20]  Ahmet Emir Dirik,et al.  Adaptive photo-response non-uniformity noise removal against image source attribution , 2015, Digit. Investig..

[21]  Mo Chen,et al.  Determining Image Origin and Integrity Using Sensor Noise , 2008, IEEE Transactions on Information Forensics and Security.

[22]  Pierre Moulin,et al.  Analysis of Multiresolution Image Denoising Schemes Using Generalized Gaussian and Complexity Priors , 1999, IEEE Trans. Inf. Theory.

[23]  Nasir D. Memon,et al.  Analysis of Seam-Carving-Based Anonymization of Images Against PRNU Noise Pattern-Based Source Attribution , 2014, IEEE Transactions on Information Forensics and Security.

[24]  Rainer Böhme,et al.  The 'Dresden Image Database' for benchmarking digital image forensics , 2010, SAC '10.

[25]  Matthias Kirchner,et al.  Patch-Based Desynchronization of Digital Camera Sensor Fingerprints , 2016, Media Watermarking, Security, and Forensics.

[26]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[27]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[28]  Nima Tajbakhsh,et al.  UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentation , 2020, IEEE Transactions on Medical Imaging.

[29]  Demetrio Labate,et al.  Optimally Sparse Multidimensional Representation Using Shearlets , 2007, SIAM J. Math. Anal..

[30]  Xiaoming Tao,et al.  Hyperspectral Image Denoising via Matrix Factorization and Deep Prior Regularization , 2020, IEEE Transactions on Image Processing.

[31]  Paolo Bestagini,et al.  CNN-Based Fast Source Device Identification , 2020, IEEE Signal Processing Letters.

[32]  Mohammad Sohel Rahman,et al.  MultiResUNet : Rethinking the U-Net Architecture for Multimodal Biomedical Image Segmentation , 2019, Neural Networks.

[33]  Cameron Johnson,et al.  SPN-CNN: Boosting Sensor-Based Source Camera Attribution With Deep Learning , 2019, 2019 IEEE International Workshop on Information Forensics and Security (WIFS).

[34]  Francesco Picetti,et al.  Seismic image processing through the generative adversarial network , 2019, Interpretation.

[35]  Miroslav Goljan,et al.  Digital camera identification from sensor pattern noise , 2006, IEEE Transactions on Information Forensics and Security.

[36]  Alessandro Foi,et al.  Nonlocality-Reinforced Convolutional Neural Networks for Image Denoising , 2018, IEEE Signal Processing Letters.

[37]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.