A Deep Learning based Method for Image Splicing Detection

Image manipulation has become an easy task due to the availability of user-friendly multimedia tools. The images can be manipulated in several ways. Image splicing is one of such image manipulation methods in which two or more images are merged to obtain a single composite image. These manipulated images can be misused to cheat others. This paper proposes a deep learning-based method to detect image splicing in the images. First, the input image is preprocessed using a technique called ‘Noiseprint’ to get the noise residual by suppressing the image content. Second, the popular ResNet-50 network is used as a feature extractor. Finally, the obtained features are classified as spliced or authentic using the SVM classifier. The experiments performed on the CUISDE dataset show that the proposed method outperforms other existing methods. The proposed method achieves an average classification accuracy of 97.24%.

[1]  Muhammad Ghulam,et al.  Image forgery detection using steerable pyramid transform and local binary pattern , 2013, Machine Vision and Applications.

[2]  Ahmed Taha,et al.  A Passive Approach for Detecting Image Splicing Based on Deep Learning and Wavelet Transform , 2020 .

[3]  Yiannis Kompatsiaris,et al.  Large-scale evaluation of splicing localization algorithms for web images , 2017, Multimedia Tools and Applications.

[4]  C.-C. Jay Kuo,et al.  Image Splicing Localization using a Multi-task Fully Convolutional Network (MFCN) , 2017, J. Vis. Commun. Image Represent..

[5]  Jianfeng Ma,et al.  Image splicing forgery detection combining coarse to refined convolutional neural network and adaptive clustering , 2020, Inf. Sci..

[6]  R. Srivastava,et al.  A technique for image splicing detection using hybrid feature set , 2020, Multimedia Tools and Applications.

[7]  Shih-Fu Chang,et al.  Blind detection of photomontage using higher order statistics , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[8]  Yuhui Zheng,et al.  An Improved Splicing Localization Method by Fully Convolutional Networks , 2018, IEEE Access.

[9]  Vipin Tyagi,et al.  A copy-move image forgery detection technique based on Gaussian-Hermite moments , 2019, Multimedia Tools and Applications.

[10]  Mahdi Hariri,et al.  Image splicing forgery detection using local binary pattern and discrete wavelet transform , 2015, 2015 2nd International Conference on Knowledge-Based Engineering and Innovation (KBEI).

[11]  Akshay Girdhar,et al.  Digital image splicing detection technique using optimal threshold based local ternary pattern , 2020, Multimedia Tools and Applications.

[12]  S. P. Ghrera,et al.  Pixel-Based Image Forgery Detection: A Review , 2014 .

[13]  Philip Howard,et al.  A Study of Misinformation in WhatsApp groups with a focus on the Brazilian Presidential Elections. , 2019, WWW.

[14]  Kunj Bihari Meena,et al.  A Novel Method to Distinguish Photorealistic Computer Generated Images from Photographic Images , 2019, 2019 Fifth International Conference on Image Information Processing (ICIIP).

[15]  Yiming Pi,et al.  Image-splicing forgery detection based on local binary patterns of DCT coefficients , 2015, Secur. Commun. Networks.

[16]  Bo Liu,et al.  Locating splicing forgery by fully convolutional networks and conditional random field , 2018, Signal Process. Image Commun..

[17]  Jinwei Wang,et al.  Quaternion Markov Splicing Detection for Color Images Based on Quaternion Discrete Cosine Transform , 2020 .

[18]  Jianhua Li,et al.  Passive Image-Splicing Detection by a 2-D Noncausal Markov Model , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  B M Mehtre,et al.  Tamper detection of social media images using quality artifacts and texture features. , 2019, Forensic science international.

[20]  T. Aaron Gulliver,et al.  Image splicing detection using mask-RCNN , 2020, Signal, Image and Video Processing.

[21]  Wei Lu,et al.  Joint image splicing detection in DCT and Contourlet transform domain , 2016, J. Vis. Commun. Image Represent..

[22]  Jiangqun Ni,et al.  Deep Learning Local Descriptor for Image Splicing Detection and Localization , 2020, IEEE Access.

[23]  Davide Cozzolino,et al.  Noiseprint: A CNN-Based Camera Model Fingerprint , 2018, IEEE Transactions on Information Forensics and Security.

[24]  Jianhua Li,et al.  Optimal chroma-like channel design for passive color image splicing detection , 2012, EURASIP J. Adv. Signal Process..

[25]  Vipin Tyagi,et al.  Methods to Distinguish Photorealistic Computer Generated Images from Photographic Images: A Review , 2019, ICACDS.

[26]  Anderson Rocha,et al.  Image Splicing Detection Through Illumination Inconsistencies and Deep Learning , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[27]  Sabu M. Thampi,et al.  Digital image forgery detection using compact multi-texture representation , 2017, J. Intell. Fuzzy Syst..

[28]  Vipin Tyagi,et al.  A copy-move image forgery detection technique based on tetrolet transform , 2020, J. Inf. Secur. Appl..

[29]  Xiaofeng Wang,et al.  Coarse-to-fine Grained Image Splicing Localization Method Based on Noise Level Inconsistency , 2020, 2020 International Conference on Computing, Networking and Communications (ICNC).

[30]  Xiaochun Cao,et al.  Detecting and Extracting the Photo Composites Using Planar Homography and Graph Cut , 2010, IEEE Transactions on Information Forensics and Security.

[31]  Vipin Tyagi,et al.  A hybrid copy-move image forgery detection technique based on Fourier-Mellin and scale invariant feature transforms , 2020, Multimedia Tools and Applications.

[32]  Muhammad Ghulam,et al.  Passive detection of image forgery using DCT and local binary pattern , 2016, Signal, Image and Video Processing.

[33]  Wei Lu,et al.  Digital image splicing detection based on Markov features in DCT and DWT domain , 2012, Pattern Recognit..

[34]  Xiangyang Luo,et al.  Image splicing detection based on convolutional neural network with weight combination strategy , 2020, J. Inf. Secur. Appl..

[35]  Tao Jing,et al.  Image splicing detection based on moment features and Hilbert-Huang Transform , 2010, 2010 IEEE International Conference on Information Theory and Information Security.

[36]  Jiangqun Ni,et al.  A deep learning approach to detection of splicing and copy-move forgeries in images , 2016, 2016 IEEE International Workshop on Information Forensics and Security (WIFS).

[37]  Wei Lu,et al.  Digital Image Splicing Detection Based on Markov Features in QDCT and QWT Domain , 2018, Int. J. Digit. Crime Forensics.

[38]  Vipin Tyagi,et al.  Image Forgery Detection: Survey and Future Directions , 2019, Data, Engineering and Applications.

[39]  Shih-Fu Chang,et al.  Detecting Image Splicing using Geometry Invariants and Camera Characteristics Consistency , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[40]  Rasha O. Mahmoud,et al.  Deep Learning on Digital Image Splicing Detection Using CFA Artifacts , 2020, Int. J. Sociotechnology Knowl. Dev..