An adaptive VPDE image denoising model based on structure tensor

Image denoising is one of the challenging topics in image processing. Since the formation mechanism of the degraded image is unknown, it is difficult to achieve effective image denoising. Most existing denoising methods are easy to blur the edges of the image so that it is difficult to maintain more image detail information. In recent years, partial differential equation (PDE) has been applied to image denoising, which has shown good application prospects. However, the image denoising methods based on PDE are easy to appear staircase effect and edge blur, and can not achieve satisfactory denoising effect. To avoid some problems, an adaptive variational PDE (VPDE) image denoising model based on the structure tensor is proposed and analyzed. In the proposed model, since the structure tensor can provide more local structural information and direction information of the gradient, the eigenvalues of the structure tensor of an image are used to construct the norm parameter. Through theoretical analysis and experiments, we can confirm that the proposed norm parameter has the following adaptive characteristics: (1) In the flat region of the image, the proposed norm parameter tends to 2, so which has the characteristic of isotropic diffusion. (2) At the edge region of the image, the norm parameter tends to 1, and which spreads only along the tangential direction of the image edge. The experimental results from both subjective and objective aspects show that using these adaptive characteristics, the proposed image denoising model can effectively avoid staircase effect, preserve the image details, and obtain satisfactory denoising effect.

[1]  Bing Song Topics in Variational PDE Image Segmentation, Inpainting and Denoising , 2003 .

[2]  Liangpei Zhang,et al.  Hyperspectral Image Denoising Employing a Spectral–Spatial Adaptive Total Variation Model , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Xavier Bresson,et al.  Adaptive Regularization With the Structure Tensor , 2015, IEEE Transactions on Image Processing.

[4]  Jung-San Lee,et al.  Selective scalable secret image sharing with verification , 2015, Multimedia Tools and Applications.

[5]  Wei Xie,et al.  Variational method for joint optical flow estimation and edge-aware image restoration , 2017, Pattern Recognit..

[6]  V. Kamalaveni,et al.  Improved self-snake based anisotropic diffusion model for edge preserving image denoising using structure tensor , 2017, Multimedia Tools and Applications.

[7]  Peng Qi-cong Adaptive image denoising model based on total variation , 2006 .

[8]  Li Bo An Adaptive PDE Image Processing Method Based on L_p Norm , 2008 .

[9]  Xuelong Li,et al.  Bayesian Tensor Approach for 3-D Face Modeling , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  X. Tan,et al.  A local structural adaptive partial differential equation for image denoising , 2013, Multimedia Tools and Applications.

[11]  Hamid Reza Shahdoosti,et al.  MRI and PET image fusion using structure tensor and dual ripplet-II transform , 2017, Multimedia Tools and Applications.

[12]  Jiangtao Xi,et al.  Reduced-complexity Krylov subspace methods for large-scale MIMO channel estimation , 2018, Digit. Signal Process..

[13]  Xiaobo Zhang,et al.  A novel variational model for image decomposition , 2019, Signal Image Video Process..

[14]  Xinbo Gao,et al.  Hyperspectral image denoising via minimizing the partial sum of singular values and superpixel segmentation , 2019, Neurocomputing.

[15]  Cong Jin,et al.  An approach to remove impulse noise from a corrupted image , 2013 .

[16]  Jie Yan,et al.  Image denoising by generalized total variation regularization and least squares fidelity , 2015, Multidimens. Syst. Signal Process..

[17]  Michael Möller,et al.  A Novel Framework for Nonlocal Vectorial Total Variation Based on ℓ p, q, r -norms , 2015, EMMCVPR.

[18]  Nelly Pustelnik,et al.  A Nonlocal Structure Tensor-Based Approach for Multicomponent Image Recovery Problems , 2014, IEEE Transactions on Image Processing.

[19]  Enhong Chen,et al.  Image Denoising and Inpainting with Deep Neural Networks , 2012, NIPS.

[20]  Thomas Brox,et al.  Nonlinear structure tensors , 2006, Image Vis. Comput..

[21]  A. Tikhonov,et al.  Numerical Methods for the Solution of Ill-Posed Problems , 1995 .

[22]  Wei Li,et al.  Transfer learning-based default prediction model for consumer credit in China , 2018, The Journal of Supercomputing.

[23]  Jun Ma,et al.  NeuroStylist: Neural Compatibility Modeling for Clothing Matching , 2017, ACM Multimedia.

[24]  Li Bo,et al.  A novel and fast nonlocal means denoising algorithm using a structure tensor , 2018, The Journal of Supercomputing.

[25]  Gilles Aubert,et al.  The topological gradient method for semi-linear problems and application to edge detection and noise removal , 2016 .

[26]  Petros Maragos,et al.  Structure Tensor Total Variation , 2015, SIAM J. Imaging Sci..

[27]  Minghua Zhao,et al.  A Chinese character structure preserved denoising method for Chinese tablet calligraphy document images based on KSVD dictionary learning , 2017, Multimedia Tools and Applications.

[28]  Yang Liu,et al.  Variational model with kernel metric-based data term for noisy image segmentation , 2018, Digit. Signal Process..

[29]  Zhenyu Zhou,et al.  An image denoising model based on a fourth-order nonlinear partial differential equation , 2018, Comput. Math. Appl..

[30]  Xianming Liu,et al.  When Image Denoising Meets High-Level Vision Tasks: A Deep Learning Approach , 2017, IJCAI.

[31]  Robert Pless,et al.  Analysis of Persistent Motion Patterns Using the 3D Structure Tensor , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[32]  Wei Yu,et al.  On learning optimized reaction diffusion processes for effective image restoration , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  苏志勋,et al.  基于 L p 范数的局部自适应偏微分方程图像恢复 , 2009 .

[34]  Pheng-Ann Heng,et al.  Adaptive total variation denoising based on difference curvature , 2010, Image Vis. Comput..

[35]  Peyman Milanfar,et al.  Global Image Denoising , 2014, IEEE Transactions on Image Processing.

[36]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2016, Texts in Computer Science.

[37]  Theo Gevers,et al.  Evaluation of Color Spatio-Temporal Interest Points for Human Action Recognition , 2014, IEEE Transactions on Image Processing.

[38]  Yi-Fei Pu,et al.  A fractional partial differential equation based multiscale denoising model for texture image , 2014 .

[39]  Junfeng Yang,et al.  A TVSCAD approach for image deblurring with impulsive noise , 2017 .

[40]  Petros Maragos,et al.  Convex Generalizations of Total Variation Based on the Structure Tensor with Applications to Inverse Problems , 2013, SSVM.

[41]  Stanley Osher,et al.  Nonlocal Structure Tensor Functionals for Image Regularization , 2015, IEEE Transactions on Computational Imaging.

[42]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .