Diffusion-based image inpainting forensics via weighted least squares filtering enhancement

The rapid development of blockchain technology has greatly changed people’s daily lives from financial market to healthcare field. Today, adulterated images appear in large numbers, causing a serious threat to personal privacy and social stability. At present, the research on blockchain is mainly focused on chain data transmission. Though the blockchain can ensure that the chain data transmission is not tampered, it is difficult to ensure that the data is real when placed on the system initially. In addition, the immutability will be destroyed when 51% attacks occur. Taking this point into consideration, it is necessary to identify the image authenticity on the blockchain. Diffusion-based inpainting is a common method of image tampering. Considering the blurring effect introduced by diffusion-based image inpainting, this paper proposes an image forensics method of diffusion-based image inpainting via weighted least squares filtering enhancement. The texture of the forged image is clear in the untouched regions, and the blurring effect leads to some texture changes in the inpainted regions. Weighted least squares filtering can preserve the texture structure of the untouched regions better and highlight the blurring effect of the inpainted regions. In view of the different reflects of the tampered information in different color channels, weighted least squares filtering is applied to enhance each color channel of the input image, which can capture the impact of image inpainting from multiple perspectives. The experimental results show that the proposed method not only makes up for the deficiency of previous blockchain forensics effectively, but also has better detection performance than the existing work.

[1]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[2]  Joarder Kamruzzaman,et al.  Passive Detection of Splicing and Copy-Move Attacks in Image Forgery , 2018, ICONIP.

[3]  Jun Wang,et al.  Hybrid JND model-guided watermarking method for screen content images , 2018, Multimedia Tools and Applications.

[4]  Jiwu Huang,et al.  Localization of Diffusion-Based Inpainting in Digital Images , 2017, IEEE Transactions on Information Forensics and Security.

[5]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[6]  Shichao Zhang,et al.  Robust Image Hashing with Tensor Decomposition , 2019, IEEE Transactions on Knowledge and Data Engineering.

[7]  Gerald Schaefer,et al.  UCID: an uncompressed color image database , 2003, IS&T/SPIE Electronic Imaging.

[8]  Joachim Weickert,et al.  Diffusion-Based Inpainting for Coding Remote-Sensing Data , 2017, IEEE Geoscience and Remote Sensing Letters.

[9]  Wei Lu,et al.  An Adaptive Pansharpening Method by Using Weighted Least Squares Filter , 2016, IEEE Geoscience and Remote Sensing Letters.

[10]  Kutluyil Dogançay,et al.  Reduced-Complexity Constrained Recursive Least-Squares Adaptive Filtering Algorithm , 2012, IEEE Transactions on Signal Processing.

[11]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[12]  Xiaohui Yang,et al.  Novel image inpainting algorithm based on adaptive fourth-order partial differential equation , 2017, IET Image Process..

[13]  Shuai Wang,et al.  Blockchain-Enabled Smart Contracts: Architecture, Applications, and Future Trends , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[14]  Christine Guillemot,et al.  Image Inpainting : Overview and Recent Advances , 2014, IEEE Signal Processing Magazine.

[15]  Serkan Öztürk,et al.  A novel hash function based fragile watermarking method for image integrity , 2019, Multimedia Tools and Applications.

[16]  Minh N. Do,et al.  Fast Global Image Smoothing Based on Weighted Least Squares , 2014, IEEE Transactions on Image Processing.

[17]  Lei Shi,et al.  A Global Weighted Least-Squares Optimization Framework for Speckle Filtering of PolSAR Imagery , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Sergey Kharkovsky,et al.  Overview and Recent Advances , 2007 .

[19]  Hua Han,et al.  Revealing the traces of nonaligned double JPEG compression in digital images , 2020 .

[20]  Zhiyong Su,et al.  Learning to Hash for Personalized Image Authentication , 2020 .

[21]  Heung-Kyu Lee,et al.  Robust watermarking in curvelet domain for preserving cleanness of high-quality images , 2018, Multimedia Tools and Applications.

[22]  Haipeng Yao,et al.  Resource Trading in Blockchain-Based Industrial Internet of Things , 2019, IEEE Transactions on Industrial Informatics.

[23]  Dhani Ariatmanto,et al.  An improved robust image watermarking by using different embedding strengths , 2020, Multimedia Tools and Applications.

[24]  Alex ChiChung Kot,et al.  Blurred Image Splicing Localization by Exposing Blur Type Inconsistency , 2015, IEEE Transactions on Information Forensics and Security.

[25]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[26]  David Tschumperlé,et al.  Exemplar-Based Inpainting: Technical Review and New Heuristics for Better Geometric Reconstructions , 2015, IEEE Transactions on Image Processing.

[27]  Xuanjing Shen,et al.  Image splicing detection based on Markov features in discrete octonion cosine transform domain , 2018, IET Image Process..

[28]  Seung Yeob Nam,et al.  Regional Blockchain for Vehicular Networks to Prevent 51% Attacks , 2019, IEEE Access.

[29]  Yong Jiang,et al.  Image fusion using multiscale edge-preserving decomposition based on weighted least squares filter , 2014, IET Image Process..