A Fast Adaptive Parameter Estimation for Total Variation Image Restoration

Estimation of the regularization parameter, which strikes a balance between the data fidelity and regularity, is essential for successfully solving ill-posed image restoration problems. Based on the classical total variation (TV) model and prevalent alternating direction method of multipliers, we hammer out a fast algorithm being able to simultaneously estimate the regularization parameter and restore the degraded image. By applying variable splitting technique to both the regularization term and data fidelity term, we overcome the nondifferentiability of TV and achieve a closed form to update the regularization parameter in each iteration. The solution is guaranteed to satisfy Morozov's discrepancy principle. Furthermore, we present a convergence proof for the proposed algorithm on the premise of a variable regularization parameter. Experimental results demonstrate that the proposed algorithm is superior in speed and competitive in accuracy compared with several state-of-the-art methods. Besides, the proposed method can be smoothly extended to the multichannel image restoration.

[1]  Raymond H. Chan,et al.  Parameter selection for total-variation-based image restoration using discrepancy principle , 2012, IEEE Transactions on Image Processing.

[2]  K. Egiazarian,et al.  Blind image deconvolution , 2007 .

[3]  José M. Bioucas-Dias,et al.  Adaptive total variation image deblurring: A majorization-minimization approach , 2009, Signal Process..

[4]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[5]  Raymond H. Chan,et al.  A Multiplicative Iterative Algorithm for Box-Constrained Penalized Likelihood Image Restoration , 2012, IEEE Transactions on Image Processing.

[6]  Simon Setzer,et al.  Operator Splittings, Bregman Methods and Frame Shrinkage in Image Processing , 2011, International Journal of Computer Vision.

[7]  Brendt Wohlberg,et al.  UPRE method for total variation parameter selection , 2010, Signal Process..

[8]  Rafael Molina,et al.  Iterative image restoration using nonstationary priors. , 2013, Applied optics.

[9]  M. Nikolova An Algorithm for Total Variation Minimization and Applications , 2004 .

[10]  C. Vogel Computational Methods for Inverse Problems , 1987 .

[11]  Marc Teboulle,et al.  Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems , 2009, IEEE Transactions on Image Processing.

[12]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[13]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[14]  Susanto Rahardja,et al.  Alternating Direction Method for Balanced Image Restoration , 2012, IEEE Transactions on Image Processing.

[15]  Tony F. Chan,et al.  Image processing and analysis - variational, PDE, wavelet, and stochastic methods , 2005 .

[16]  Bingsheng He,et al.  Convergence Analysis of Primal-Dual Algorithms for a Saddle-Point Problem: From Contraction Perspective , 2012, SIAM J. Imaging Sci..

[17]  Mathews Jacob,et al.  Higher Degree Total Variation (HDTV) Regularization for Image Recovery , 2012, IEEE Transactions on Image Processing.

[18]  S. Osher,et al.  Image restoration: Total variation, wavelet frames, and beyond , 2012 .

[19]  Carola-Bibiane Schönlieb,et al.  Wavelet Decomposition Method for L2//TV-Image Deblurring , 2012, SIAM J. Imaging Sci..

[20]  Gene H. Golub,et al.  Generalized cross-validation as a method for choosing a good ridge parameter , 1979, Milestones in Matrix Computation.

[21]  Junfeng Yang,et al.  ALTERNATING DIRECTION ALGORITHMS FOR TOTAL VARIATION DECONVOLUTION IN IMAGE RECONSTRUCTION , 2009 .

[22]  Junfeng Yang,et al.  A New Alternating Minimization Algorithm for Total Variation Image Reconstruction , 2008, SIAM J. Imaging Sci..

[23]  Tony F. Chan,et al.  Modular solvers for image restoration problems using the discrepancy principle , 2002, Numer. Linear Algebra Appl..

[24]  Pascal Getreuer,et al.  Rudin-Osher-Fatemi Total Variation Denoising using Split Bregman , 2012, Image Process. Line.

[25]  Yiqiu Dong,et al.  Spatially dependent regularization parameter selection in total generalized variation models for image restoration , 2013, Int. J. Comput. Math..

[26]  J.-C. Pesquet,et al.  A Douglas–Rachford Splitting Approach to Nonsmooth Convex Variational Signal Recovery , 2007, IEEE Journal of Selected Topics in Signal Processing.

[27]  Mathews Jacob,et al.  Generalized Higher Degree Total Variation (HDTV) Regularization , 2014, IEEE Transactions on Image Processing.

[28]  Aggelos K. Katsaggelos,et al.  Variational Bayesian Blind Deconvolution Using a Total Variation Prior , 2009, IEEE Transactions on Image Processing.

[29]  Junfeng Yang,et al.  A Fast Algorithm for Edge-Preserving Variational Multichannel Image Restoration , 2009, SIAM J. Imaging Sci..

[30]  Aggelos K. Katsaggelos,et al.  Parameter Estimation in TV Image Restoration Using Variational Distribution Approximation , 2008, IEEE Transactions on Image Processing.

[31]  H. Engl,et al.  Using the L--curve for determining optimal regularization parameters , 1994 .

[32]  Antonin Chambolle,et al.  An Upwind Finite-Difference Method for Total Variation-Based Image Smoothing , 2011, SIAM J. Imaging Sci..

[33]  Nick G. Kingsbury,et al.  Improved Bounds for Subband-Adaptive Iterative Shrinkage/Thresholding Algorithms , 2013, IEEE Transactions on Image Processing.

[34]  M. Goldman,et al.  Continuous Primal-Dual Methods for Image Processing , 2010, SIAM J. Imaging Sci..

[35]  Per Christian Hansen,et al.  Analysis of Discrete Ill-Posed Problems by Means of the L-Curve , 1992, SIAM Rev..

[36]  Stéphane Mallat,et al.  A Wavelet Tour of Signal Processing, 2nd Edition , 1999 .

[37]  Michael Unser,et al.  Hessian Schatten-Norm Regularization for Linear Inverse Problems , 2012, IEEE Transactions on Image Processing.

[38]  Nikolas P. Galatsanos,et al.  Methods for choosing the regularization parameter and estimating the noise variance in image restoration and their relation , 1992, IEEE Trans. Image Process..

[39]  Jean-Luc Starck,et al.  Deconvolution and Blind Deconvolution in Astronomy , 2007 .

[40]  You-Wei,et al.  Adaptive Parameter Selection for Total Variation Image Deconvolution , 2009 .

[41]  José M. Bioucas-Dias,et al.  An Alternating Direction Algorithm for Total Variation Reconstruction of Distributed Parameters , 2012, IEEE Transactions on Image Processing.

[42]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[43]  Wotao Yin,et al.  On the Global and Linear Convergence of the Generalized Alternating Direction Method of Multipliers , 2016, J. Sci. Comput..

[44]  Xue-Cheng Tai,et al.  Augmented Lagrangian Method, Dual Methods, and Split Bregman Iteration for ROF, Vectorial TV, and High Order Models , 2010, SIAM J. Imaging Sci..

[45]  José M. Bioucas-Dias,et al.  An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems , 2009, IEEE Transactions on Image Processing.

[46]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[47]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[48]  Pascal Getreuer,et al.  Contour Stencils: Total Variation along Curves for Adaptive Image Interpolation , 2011, SIAM J. Imaging Sci..

[49]  Pascal Getreuer,et al.  Total Variation Deconvolution using Split Bregman , 2012, Image Process. Line.

[50]  Michael K. Ng,et al.  Solving Constrained Total-variation Image Restoration and Reconstruction Problems via Alternating Direction Methods , 2010, SIAM J. Sci. Comput..

[51]  Richard G. Baraniuk,et al.  Fast Alternating Direction Optimization Methods , 2014, SIAM J. Imaging Sci..

[52]  Catalina Sbert,et al.  Chambolle's Projection Algorithm for Total Variation Denoising , 2013, Image Process. Line.

[53]  Fang Li,et al.  Selection of regularization parameter in total variation image restoration. , 2009, Journal of the Optical Society of America. A, Optics, image science, and vision.

[54]  V. A. Morozov,et al.  Methods for Solving Incorrectly Posed Problems , 1984 .

[55]  Nikolas P. Galatsanos,et al.  Variational Bayesian Image Restoration Based on a Product of $t$-Distributions Image Prior , 2008, IEEE Transactions on Image Processing.

[56]  Mathews Jacob,et al.  Nonlocal Regularization of Inverse Problems: A Unified Variational Framework , 2013, IEEE Transactions on Image Processing.