Image restoration using total variation with overlapping group sparsity

Image restoration is one of the most fundamental issues in imaging science. Total variation regularization is widely used in image restoration problems for its capability to preserve edges. In the literature, however, it is also well known for producing staircase artifacts. In this work we extend the total variation with overlapping group sparsity, which we previously developed for one dimension signal processing, to image restoration. A convex cost function is given and an efficient algorithm is proposed for solving the corresponding minimization problem. In the experiments, we compare our method with several state-of-the-art methods. The results illustrate the efficiency and effectiveness of the proposed method in terms of PSNR and computing time.

[1]  Xavier Bresson,et al.  Bregmanized Nonlocal Regularization for Deconvolution and Sparse Reconstruction , 2010, SIAM J. Imaging Sci..

[2]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[3]  Michael Unser,et al.  Hessian-Based Norm Regularization for Image Restoration With Biomedical Applications , 2012, IEEE Transactions on Image Processing.

[4]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[5]  Tony F. Chan,et al.  Image Denoising Using Mean Curvature of Image Surface , 2012, SIAM J. Imaging Sci..

[6]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[7]  Mingqiang Zhu,et al.  An Efficient Primal-Dual Hybrid Gradient Algorithm For Total Variation Image Restoration , 2008 .

[8]  Michael K. Ng,et al.  A Fast Total Variation Minimization Method for Image Restoration , 2008, Multiscale Model. Simul..

[9]  A. Chambolle.  Practical, Unified, Motion and Missing Data Treatment in Degraded Video , 2004, Journal of Mathematical Imaging and Vision.

[10]  Robert D. Nowak,et al.  Majorization–Minimization Algorithms for Wavelet-Based Image Restoration , 2007, IEEE Transactions on Image Processing.

[11]  Yong Xu,et al.  Locality and similarity preserving embedding for feature selection , 2014, Neurocomputing.

[12]  M. Jiang,et al.  High-order total variation minimization for interior tomography , 2010, Inverse problems.

[13]  Lizhi Cheng,et al.  Deconvolving Poissonian images by a novel hybrid variational model , 2011, J. Vis. Commun. Image Represent..

[14]  Gabriele Steidl,et al.  A Note on the Dual Treatment of Higher-Order Regularization Functionals , 2005, Computing.

[15]  L PhillipsDavid.  A Technique for the Numerical Solution of Certain Integral Equations of the First Kind , 1962 .

[16]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[17]  Carola-Bibiane Schönlieb,et al.  A Combined First and Second Order Variational Approach for Image Reconstruction , 2012, Journal of Mathematical Imaging and Vision.

[18]  Lionel Moisan,et al.  Total Variation as a Local Filter , 2011, SIAM J. Imaging Sci..

[19]  T. Pock,et al.  Second order total generalized variation (TGV) for MRI , 2011, Magnetic resonance in medicine.

[20]  Karen O. Egiazarian,et al.  BM3D Frames and Variational Image Deblurring , 2011, IEEE Transactions on Image Processing.

[21]  Xue-Cheng Tai,et al.  A dual algorithm for minimization of the LLT model , 2009, Adv. Comput. Math..

[22]  Tony F. Chan,et al.  High-Order Total Variation-Based Image Restoration , 2000, SIAM J. Sci. Comput..

[23]  Gene H. Golub,et al.  A Nonlinear Primal-Dual Method for Total Variation-Based Image Restoration , 1999, SIAM J. Sci. Comput..

[24]  Jean-Michel Morel,et al.  Image Denoising Methods. A New Nonlocal Principle , 2010, SIAM Rev..

[25]  Ivan W. Selesnick,et al.  Translation-invariant shrinkage/thresholding of group sparse signals , 2014, Signal Process..

[26]  Yurii Nesterov,et al.  Introductory Lectures on Convex Optimization - A Basic Course , 2014, Applied Optimization.

[27]  Junfeng Yang,et al.  A New Alternating Minimization Algorithm for Total Variation Image Reconstruction , 2008, SIAM J. Imaging Sci..

[28]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[29]  Dimitri P. Bertsekas,et al.  On the Douglas—Rachford splitting method and the proximal point algorithm for maximal monotone operators , 1992, Math. Program..

[30]  D. Hunter,et al.  A Tutorial on MM Algorithms , 2004 .

[31]  A Tikhonov,et al.  Solution of Incorrectly Formulated Problems and the Regularization Method , 1963 .

[32]  Arvid Lundervold,et al.  Noise removal using fourth-order partial differential equation with applications to medical magnetic resonance images in space and time , 2003, IEEE Trans. Image Process..

[33]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[34]  Mohamed-Jalal Fadili,et al.  Group sparsity with overlapping partition functions , 2011, 2011 19th European Signal Processing Conference.

[35]  Fadil Santosa,et al.  Recovery of Blocky Images from Noisy and Blurred Data , 1996, SIAM J. Appl. Math..

[36]  Raymond H. Chan,et al.  A Multiplicative Iterative Algorithm for Box-Constrained Penalized Likelihood Image Restoration , 2012, IEEE Transactions on Image Processing.

[37]  Joumana Farah,et al.  A proximal approach for signal recovery based on information measures , 2013, 21st European Signal Processing Conference (EUSIPCO 2013).

[38]  David L. Phillips,et al.  A Technique for the Numerical Solution of Certain Integral Equations of the First Kind , 1962, JACM.

[39]  M. Nikolova.  An Algorithm for Total Variation Minimization and Applications , 2004 .

[40]  Xue-Cheng Tai,et al.  Augmented Lagrangian Method, Dual Methods, and Split Bregman Iteration for ROF, Vectorial TV, and High Order Models , 2010, SIAM J. Imaging Sci..

[41]  Xiaoming Yuan,et al.  A descent method for structured monotone variational inequalities , 2007, Optim. Methods Softw..

[42]  Ivan W. Selesnick,et al.  Translation-invariant shrinkage/thresholding of group sparse signals , 2013, Signal Process..

[43]  José M. Bioucas-Dias,et al.  Fast Image Recovery Using Variable Splitting and Constrained Optimization , 2009, IEEE Transactions on Image Processing.

[44]  Raymond H. Chan,et al.  Constrained Total Variation Deblurring Models and Fast Algorithms Based on Alternating Direction Method of Multipliers , 2013, SIAM J. Imaging Sci..

[45]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Bingsheng He,et al.  Linearized Alternating Direction Method with Gaussian Back Substitution for Separable Convex Programming , 2011 .

[47]  Otmar Scherzer,et al.  Variational Methods on the Space of Functions of Bounded Hessian for Convexification and Denoising , 2005, Computing.

[48]  Guy Gilboa,et al.  Nonlocal Operators with Applications to Image Processing , 2008, Multiscale Model. Simul..

[49]  T. Chan,et al.  On the Convergence of the Lagged Diffusivity Fixed Point Method in Total Variation Image Restoration , 1999 .

[50]  Stanley Osher,et al.  Explicit Algorithms for a New Time Dependent Model Based on Level Set Motion for Nonlinear Deblurring and Noise Removal , 2000, SIAM J. Sci. Comput..

[51]  Mathews Jacob,et al.  Higher Degree Total Variation (HDTV) Regularization for Image Recovery , 2012, IEEE Transactions on Image Processing.

[52]  Mostafa Kaveh,et al.  Fourth-order partial differential equations for noise removal , 2000, IEEE Trans. Image Process..

[53]  Rabab Kreidieh Ward,et al.  Compressive color imaging with group-sparsity on analysis prior , 2010, 2010 IEEE International Conference on Image Processing.

[54]  Marc Teboulle,et al.  Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems , 2009, IEEE Transactions on Image Processing.

[55]  Anastasios N. Venetsanopoulos,et al.  Regularization theory in image restoration-the stabilizing functional approach , 1990, IEEE Trans. Acoust. Speech Signal Process..

[56]  Curtis R. Vogel,et al.  Iterative Methods for Total Variation Denoising , 1996, SIAM J. Sci. Comput..

[57]  Ke Chen,et al.  A new iterative algorithm for mean curvature-based variational image denoising , 2014 .

[58]  Jie Huang,et al.  Two soft-thresholding based iterative algorithms for image deblurring , 2014, Inf. Sci..

[59]  Bingsheng He,et al.  Some convergence properties of a method of multipliers for linearly constrained monotone variational inequalities , 1998, Oper. Res. Lett..

[60]  Xue-Cheng Tai,et al.  Iterative Image Restoration Combining Total Variation Minimization and a Second-Order Functional , 2005, International Journal of Computer Vision.

[61]  Ke Lu,et al.  Single-image motion deblurring using an adaptive image prior , 2014, Inf. Sci..

[62]  Ivan W. Selesnick,et al.  Total variation denoising with overlapping group sparsity , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[63]  M. Hestenes.  Multiplier and gradient methods , 1969 .

[64]  Jian-Feng Cai,et al.  Linearized Bregman Iterations for Frame-Based Image Deblurring , 2009, SIAM J. Imaging Sci..

[65]  Zongben Xu,et al.  Kronecker product approximations for image restoration with whole-sample symmetric boundary conditions , 2012, Inf. Sci..

[66]  José M. Bioucas-Dias,et al.  Restoration of Poissonian Images Using Alternating Direction Optimization , 2010, IEEE Transactions on Image Processing.

[67]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.