Convex composite wavelet frame and total variation-based image deblurring using nonconvex penalty functions

Abstract. Total variation (TV)-based image deblurring method can bring on staircase artifacts in the homogenous region of the latent images recovered from the degraded images while a wavelet/frame-based image deblurring method will lead to spurious noise spikes and pseudo-Gibbs artifacts in the vicinity of discontinuities of the latent images. To suppress these artifacts efficiently, we propose a nonconvex composite wavelet/frame and TV-based image deblurring model. In this model, the wavelet/frame and the TV-based methods may complement each other, which are verified by theoretical analysis and experimental results. To further improve the quality of the latent images, nonconvex penalty function is used to be the regularization terms of the model, which may induce a stronger sparse solution and will more accurately estimate the relative large gradient or wavelet/frame coefficients of the latent images. In addition, by choosing a suitable parameter to the nonconvex penalty function, the subproblem that splits by the alternative direction method of multipliers algorithm from the proposed model can be guaranteed to be a convex optimization problem; hence, each subproblem can converge to a global optimum. The mean doubly augmented Lagrangian and the isotropic split Bregman algorithms are used to solve these convex subproblems where the designed proximal operator is used to reduce the computational complexity of the algorithms. Extensive numerical experiments indicate that the proposed model and algorithms are comparable to other state-of-the-art model and methods.

[1]  David Zhang,et al.  A Generalized Iterated Shrinkage Algorithm for Non-convex Sparse Coding , 2013, 2013 IEEE International Conference on Computer Vision.

[2]  Xiaoming Yuan,et al.  A Note on the Alternating Direction Method of Multipliers , 2012, J. Optim. Theory Appl..

[3]  Ronald R. Coifman,et al.  Combining the Calculus of Variations and Wavelets for Image Enhancement , 2000 .

[4]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[5]  Ivan W. Selesnick,et al.  Artifact-Free Wavelet Denoising: Non-convex Sparse Regularization, Convex Optimization , 2015, IEEE Signal Processing Letters.

[6]  Suchi Saria,et al.  Convex envelopes of complexity controlling penalties: the case against premature envelopment , 2011, AISTATS.

[7]  Tony F. Chan,et al.  Total Variation Wavelet Inpainting , 2006, Journal of Mathematical Imaging and Vision.

[8]  Ivan W. Selesnick,et al.  Sparse Signal Estimation by Maximally Sparse Convex Optimization , 2013, IEEE Transactions on Signal Processing.

[9]  Zhi-Quan Luo,et al.  Convergence analysis of alternating direction method of multipliers for a family of nonconvex problems , 2014, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[10]  Driss Aboutajdine,et al.  Fast Edge-Aware Processing via First Order Proximal Approximation , 2015, IEEE Transactions on Visualization and Computer Graphics.

[11]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Ivan W. Selesnick,et al.  Convex 1-D Total Variation Denoising with Non-convex Regularization , 2015, IEEE Signal Processing Letters.

[13]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[14]  Benar Fux Svaiter,et al.  Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward–backward splitting, and regularized Gauss–Seidel methods , 2013, Math. Program..

[15]  Wotao Yin,et al.  Global Convergence of ADMM in Nonconvex Nonsmooth Optimization , 2015, Journal of Scientific Computing.

[16]  Jacques Froment,et al.  Artifact free signal denoising with wavelets , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[17]  Dai-Qiang Chen,et al.  Regularized Generalized Inverse Accelerating Linearized Alternating Minimization Algorithm for Frame-Based Poissonian Image Deblurring , 2014, SIAM J. Imaging Sci..

[18]  Martin Vetterli,et al.  Spatially adaptive wavelet thresholding with context modeling for image denoising , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[19]  Carlo Fischione,et al.  On the Convergence of Alternating Direction Lagrangian Methods for Nonconvex Structured Optimization Problems , 2014, IEEE Transactions on Control of Network Systems.

[20]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[21]  Serena Morigi,et al.  Convex Image Denoising via Non-convex Regularization with Parameter Selection , 2016, Journal of Mathematical Imaging and Vision.

[22]  Yan Zhou,et al.  Wavelet Frame Based Image Restoration via Combined Sparsity and Nonlocal Prior of Coefficients , 2016, J. Sci. Comput..

[23]  Zhengwei Shen,et al.  Coupled image restoration model with non-convex non-smooth ℓ p wavelet frame and total variation regularisation , 2016, IET Image Process..

[24]  Jacques Froment,et al.  Reconstruction of Wavelet Coefficients Using Total Variation Minimization , 2002, SIAM J. Sci. Comput..

[25]  Ivan W. Selesnick,et al.  Convex Denoising using Non-Convex Tight Frame Regularization , 2015, IEEE Signal Processing Letters.

[26]  Bin Dong,et al.  An Efficient Algorithm for ℓ0 Minimization in Wavelet Frame Based Image Restoration , 2013, J. Sci. Comput..

[27]  Junfeng Yang,et al.  A New Alternating Minimization Algorithm for Total Variation Image Reconstruction , 2008, SIAM J. Imaging Sci..

[28]  Rob Fergus,et al.  Fast Image Deconvolution using Hyper-Laplacian Priors , 2009, NIPS.

[29]  Nelly Pustelnik,et al.  Parallel Proximal Algorithm for Image Restoration Using Hybrid Regularization , 2009, IEEE Transactions on Image Processing.

[30]  S. Osher,et al.  Image restoration: Total variation, wavelet frames, and beyond , 2012 .

[31]  Mila Nikolova,et al.  Fast Nonconvex Nonsmooth Minimization Methods for Image Restoration and Reconstruction , 2010, IEEE Transactions on Image Processing.

[32]  Guoyin Li,et al.  Global Convergence of Splitting Methods for Nonconvex Composite Optimization , 2014, SIAM J. Optim..

[33]  Zhengwei Shen,et al.  Composite analysis-based model for image restoration solved by alternating direction method of multipliers fast iterative shrinkage-thresholding algorithm , 2016 .

[34]  Michael K. Ng,et al.  Iterative Algorithms Based on Decoupling of Deblurring and Denoising for Image Restoration , 2008, SIAM J. Sci. Comput..

[35]  R. Jia,et al.  Applied and Computational Harmonic Analysis Convergence Analysis of the Bregman Method for the Variational Model of Image Denoising , 2022 .

[36]  D. Donoho,et al.  Translation-Invariant De-Noising , 1995 .