Recolored Image Detection via a Deep Discriminative Model

Image recoloring is a technique that can transfer image color or theme and result in an imperceptible change in human eyes. Although image recoloring is one of the most important image manipulation techniques, there is no special method designed for detecting this kind of forgery. In this paper, we propose a trainable end-to-end system for distinguishing recolored images from natural images. The proposed network takes the original image and two derived inputs based on illumination consistency and inter-channel correlation of the original input into consideration and outputs the probability that it is recolored. Our algorithm adopts a convolutional neural network (CNN)- based deep architecture, which consists of three feature extraction blocks and a feature fusion module. To train the deep neural network, we synthesize a data set comprised of recolored images and corresponding ground truth using different recoloring methods. Extensive experimental results on the recolored images generated by various methods show that our proposed network is well generalized and very robust.

[1]  Hany Farid,et al.  Exposing Digital Forgeries Through Specular Highlights on the Eye , 2007, Information Hiding.

[2]  Xiaochun Cao,et al.  Single Image Dehazing via Multi-scale Convolutional Neural Networks , 2016, ECCV.

[3]  Zhang Xiong,et al.  3D lighting-based image forgery detection using shape-from-shading , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[4]  Jianru Xue,et al.  Image forensic signature for content authenticity analysis , 2012, J. Vis. Commun. Image Represent..

[5]  K. J. Ray Liu,et al.  Forensic detection of image manipulation using statistical intrinsic fingerprints , 2010, IEEE Transactions on Information Forensics and Security.

[6]  Wei Liu,et al.  Gated Fusion Network for Single Image Dehazing , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[7]  Anderson Rocha,et al.  Illuminant-Based Transformed Spaces for Image Forensics , 2016, IEEE Transactions on Information Forensics and Security.

[8]  G. Buchsbaum A spatial processor model for object colour perception , 1980 .

[9]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[10]  Stephen DiVerdi,et al.  Palette-based photo recoloring , 2015, ACM Trans. Graph..

[11]  Michele De Santis,et al.  Holographic watermarking for authentication of cut images , 2011 .

[12]  Héctor M. Pérez Meana,et al.  Watermarking-based image authentication with recovery capability using halftoning technique , 2013, Signal Process. Image Commun..

[13]  Tiegang Gao,et al.  A robust detection algorithm for copy-move forgery in digital images. , 2012, Forensic science international.

[14]  Zhi-ping Zhou,et al.  Image splicing detection based on image quality and analysis of variance , 2010, 2010 2nd International Conference on Education Technology and Computer.

[15]  Rozenn Dahyot,et al.  L2 registration for colour transfer , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[16]  Jichang Guo,et al.  Passive forensics for copy-move image forgery using a method based on DCT and SVD. , 2013, Forensic science international.

[17]  Fatos T. Yarman-Vural,et al.  SASI: a generic texture descriptor for image retrieval , 2003, Pattern Recognit..

[18]  Jianhua Li,et al.  Detecting Digital Image Splicing in Chroma Spaces , 2010, IWDW.

[19]  Chi-Man Pun,et al.  Image Forgery Detection Using Adaptive Oversegmentation and Feature Point Matching , 2015, IEEE Transactions on Information Forensics and Security.

[20]  Joost van de Weijer,et al.  Object recoloring based on intrinsic image estimation , 2011, 2011 International Conference on Computer Vision.

[21]  Zhao Junhong Detection of Copy-Move Forgery based on one improved LLE method , 2010, 2010 2nd International Conference on Advanced Computer Control.

[22]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Muhammad Ghulam,et al.  Passive copy move image forgery detection using undecimated dyadic wavelet transform , 2012, Digit. Investig..

[24]  Xuemin Wu,et al.  Image Splicing Detection Using Illuminant Color Inconsistency , 2011, 2011 Third International Conference on Multimedia Information Networking and Security.

[25]  Christian Riess,et al.  Scene Illumination as an Indicator of Image Manipulation , 2010, Information Hiding.

[26]  Ning Zhang,et al.  Primary-consistent soft-decision color demosaicking for digital cameras (patent pending) , 2004, IEEE Transactions on Image Processing.

[27]  Bo Tao,et al.  Texture Recognition and Image Retrieval Using Gradient Indexing , 2000, J. Vis. Commun. Image Represent..

[28]  Thomas W. Parks,et al.  Demosaicing using optimal recovery , 2005, IEEE Transactions on Image Processing.

[29]  Jen-Chun Lee,et al.  An Efficient Detection Algorithm for Copy-Move Forgery , 2015, 2015 10th Asia Joint Conference on Information Security.

[30]  Guna Seetharaman,et al.  Harnessing Motion Blur to Unveil Splicing , 2014, IEEE Transactions on Information Forensics and Security.

[31]  Madhumita Sengupta,et al.  Authentication Through Hough Transformation Generated Signature on G-Let D3 Domain (AHSG)☆ , 2013 .

[32]  Mo Chen,et al.  Determining Image Origin and Integrity Using Sensor Noise , 2008, IEEE Transactions on Information Forensics and Security.

[33]  Joost van de Weijer,et al.  Improving Color Constancy by Photometric Edge Weighting , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Vijay H. Mankar,et al.  Digital image forgery detection using passive techniques: A survey , 2013, Digit. Investig..

[35]  Asifullah Khan,et al.  Authentication and recovery of images using multiple watermarks , 2010, Comput. Electr. Eng..

[36]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[37]  Yao Zhao,et al.  Contrast Enhancement-Based Forensics in Digital Images , 2014, IEEE Transactions on Information Forensics and Security.

[38]  Xiaochun Cao,et al.  Fake Colorized Image Detection , 2018, IEEE Transactions on Information Forensics and Security.

[39]  Dani Lischinski,et al.  Colorization using optimization , 2004, ACM Trans. Graph..

[40]  Belhassen Bayar,et al.  A Generic Approach Towards Image Manipulation Parameter Estimation Using Convolutional Neural Networks , 2017, IH&MMSec.

[41]  Li Jing,et al.  Image Copy-Move Forgery Detecting Based on Local Invariant Feature , 2012, J. Multim..

[42]  Claudio Cusano,et al.  Single and Multiple Illuminant Estimation Using Convolutional Neural Networks , 2015, IEEE Transactions on Image Processing.

[43]  P.K. Bora,et al.  Illuminant colour based image forensics , 2008, TENCON 2008 - 2008 IEEE Region 10 Conference.

[44]  Anil Kokaram,et al.  The linear Monge-Kantorovitch linear colour mapping for example-based colour transfer , 2007 .

[45]  Pat Hanrahan,et al.  Probabilistic color-by-numbers , 2013, ACM Trans. Graph..

[46]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[47]  Qinping Zhao,et al.  Sparse Dictionary Learning for Edit Propagation of High-Resolution Images , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[48]  Fabio Pellacini,et al.  AppProp: all-pairs appearance-space edit propagation , 2008, ACM Trans. Graph..

[49]  Hany Farid,et al.  Exposing digital forgeries by detecting inconsistencies in lighting , 2005, MM&Sec '05.

[50]  Yücel Altunbasak,et al.  Color plane interpolation using alternating projections , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[51]  Jing Huang,et al.  Image indexing using color correlograms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[52]  Joost van de Weijer,et al.  Author Manuscript, Published in "ieee Transactions on Image Processing Edge-based Color Constancy , 2022 .

[53]  Oscar C. Au,et al.  Inter-channel demosaicking traces for digital image forensics , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[54]  François Pitié,et al.  Automated colour grading using colour distribution transfer , 2007, Comput. Vis. Image Underst..

[55]  Chun-Shien Lu,et al.  Structural digital signature for image authentication: an incidental distortion resistant scheme , 2003, IEEE Trans. Multim..

[56]  Xunyu Pan,et al.  Region Duplication Detection Using Image Feature Matching , 2010, IEEE Transactions on Information Forensics and Security.