Non-convex and non-smooth variational decomposition for image restoration

Abstract The variational image decomposition model decomposes an image into a structural and an oscillatory component by regularization technique and functional minimization. It is an important task in various image processing methods, such as image restoration, image segmentation, and object recognition. In this paper, we propose a non-convex and non-smooth variational decomposition model for image restoration that uses non-convex and non-smooth total variation (TV) to measure the structure component and the negative Sobolev space H − 1 to model the oscillatory component. The new model combines the advantages of non-convex regularization and weaker-norm texture modeling, and it can well remove the noises while preserving the valuable edges and contours of the image. The iteratively reweighted l1 (IRL1) algorithm is employed to solve the proposed non-convex minimization problem. For each subproblem, we use the alternating direction method of multipliers (ADMM) algorithm to solve it. Numerical results validate the effectiveness of the proposed model for both synthetic and real images in terms of peak signal-to-noise ratio (PSNR) and mean structural similarity index (MSSIM).

[1]  Liming Tang,et al.  Multiscale Texture Extraction with Hierarchical (BV,Gp,L2) Decomposition , 2012, Journal of Mathematical Imaging and Vision.

[2]  Xiaojun Chen,et al.  Smoothing Nonlinear Conjugate Gradient Method for Image Restoration Using Nonsmooth Nonconvex Minimization , 2010, SIAM J. Imaging Sci..

[3]  Jean-François Aujol,et al.  Mathematical Modeling of Textures: Application to Color Image Decomposition with a Projected Gradient Algorithm , 2010, Journal of Mathematical Imaging and Vision.

[4]  Yongzhong Song,et al.  Image restoration with a high-order total variation minimization method☆ , 2013 .

[5]  G. Aubert,et al.  Modeling Very Oscillating Signals. Application to Image Processing , 2005 .

[6]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[7]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[8]  Mila Nikolova,et al.  Fast Nonconvex Nonsmooth Minimization Methods for Image Restoration and Reconstruction , 2010, IEEE Transactions on Image Processing.

[9]  Guy Gilboa,et al.  Nonlocal Operators with Applications to Image Processing , 2008, Multiscale Model. Simul..

[10]  Bogdan Dumitrescu,et al.  Iterative reweighted l1 design of sparse FIR filters , 2012, Signal Process..

[11]  Liming Tang,et al.  Image selective restoration using multi-scale variational decomposition , 2016, J. Vis. Commun. Image Represent..

[12]  Chaomin Shen,et al.  Image restoration combining a total variational filter and a fourth-order filter , 2007, J. Vis. Commun. Image Represent..

[13]  José M. Bioucas-Dias,et al.  Restoration of Poissonian Images Using Alternating Direction Optimization , 2010, IEEE Transactions on Image Processing.

[14]  Shuaiqi Liu,et al.  Total variation image restoration using hyper-Laplacian prior with overlapping group sparsity , 2016, Signal Process..

[15]  Antonin Chambolle,et al.  Image Decomposition Application to SAR Images , 2003, Scale-Space.

[16]  Dimitri P. Bertsekas,et al.  On the Douglas—Rachford splitting method and the proximal point algorithm for maximal monotone operators , 1992, Math. Program..

[17]  Zhang Jun,et al.  A class of fractional-order multi-scale variational models and alternating projection algorithm for image denoising , 2011 .

[18]  Pierre Kornprobst,et al.  Mathematical problems in image processing - partial differential equations and the calculus of variations , 2010, Applied mathematical sciences.

[19]  Stanley Osher,et al.  Image Denoising and Decomposition with Total Variation Minimization and Oscillatory Functions , 2004, Journal of Mathematical Imaging and Vision.

[20]  Fang Li,et al.  An efficient nonconvex regularization for wavelet frame and total variation based image restoration , 2015, J. Comput. Appl. Math..

[21]  Stanley Osher,et al.  Image Decomposition and Restoration Using Total Variation Minimization and the H1 , 2003, Multiscale Model. Simul..

[22]  Hyenkyun Woo,et al.  Non-convex hybrid total variation for image denoising , 2013, J. Vis. Commun. Image Represent..

[23]  David L. Phillips,et al.  A Technique for the Numerical Solution of Certain Integral Equations of the First Kind , 1962, JACM.

[24]  Tony F. Chan,et al.  Structure-Texture Image Decomposition—Modeling, Algorithms, and Parameter Selection , 2006, International Journal of Computer Vision.

[25]  Yongfei Wu,et al.  A Retinex modulated piecewise constant variational model for image segmentation and bias correction , 2018 .

[26]  Myungjoo Kang,et al.  Efficient Nonsmooth Nonconvex Optimization for Image Restoration and Segmentation , 2015, J. Sci. Comput..

[27]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Bingsheng He,et al.  Linearized Alternating Direction Method with Gaussian Back Substitution for Separable Convex Programming , 2011 .

[29]  Shuicheng Yan,et al.  Nonconvex Nonsmooth Low Rank Minimization via Iteratively Reweighted Nuclear Norm , 2015, IEEE Transactions on Image Processing.

[30]  J. S. Moll.  The anisotropic total variation flow , 2005 .

[31]  José M. Bioucas-Dias,et al.  An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems , 2009, IEEE Transactions on Image Processing.

[32]  Liming Tang,et al.  Nonconvex and nonsmooth total generalized variation model for image restoration , 2018, Signal Process..

[33]  Lihong Huang,et al.  A new nonlocal total variation regularization algorithm for image denoising , 2014, Math. Comput. Simul..

[34]  Rick Chartrand,et al.  Nonconvex Regularization for Shape Preservation , 2007, 2007 IEEE International Conference on Image Processing.

[35]  Jack Xin,et al.  A Weighted Difference of Anisotropic and Isotropic Total Variation Model for Image Processing , 2015, SIAM J. Imaging Sci..

[36]  Gaigai Cai,et al.  Nonconvex Sparse Regularization and Convex Optimization for Bearing Fault Diagnosis , 2018, IEEE Transactions on Industrial Electronics.

[37]  Yves Meyer,et al.  Oscillating Patterns in Image Processing and Nonlinear Evolution Equations: The Fifteenth Dean Jacqueline B. Lewis Memorial Lectures , 2001 .

[38]  Rick Chartrand,et al.  Exact Reconstruction of Sparse Signals via Nonconvex Minimization , 2007, IEEE Signal Processing Letters.

[39]  V. Barbu,et al.  A PDE variational approach to image denoising and restoration , 2009 .

[40]  Leon Wenliang Zhong,et al.  Fast Low-Rank Matrix Learning with Nonconvex Regularization , 2015, 2015 IEEE International Conference on Data Mining.

[41]  Stanley Osher,et al.  Modeling Textures with Total Variation Minimization and Oscillating Patterns in Image Processing , 2003, J. Sci. Comput..

[42]  Deanna Needell,et al.  Noisy signal recovery via iterative reweighted L1-minimization , 2009, 2009 Conference Record of the Forty-Third Asilomar Conference on Signals, Systems and Computers.

[43]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[44]  Luminita A. Vese,et al.  Image Decomposition Using Total Variation and div(BMO) , 2005, Multiscale Model. Simul..

[45]  Antonin Chambolle,et al.  Dual Norms and Image Decomposition Models , 2005, International Journal of Computer Vision.

[46]  Ting-Zhu Huang,et al.  Image restoration using total variation with overlapping group sparsity , 2013, Inf. Sci..

[47]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[48]  Mila Nikolova,et al.  Efficient Reconstruction of Piecewise Constant Images Using Nonsmooth Nonconvex Minimization , 2008, SIAM J. Imaging Sci..

[49]  Min Li,et al.  Convergence Analysis of the Generalized Alternating Direction Method of Multipliers with Logarithmic–Quadratic Proximal Regularization , 2015, J. Optim. Theory Appl..

[50]  Myungjoo Kang,et al.  Nonconvex higher-order regularization based Rician noise removal with spatially adaptive parameters , 2015, J. Vis. Commun. Image Represent..

[51]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.