An iterative algorithm for linear inverse problems with compound regularizers

In several imaging inverse problems, it may be of interest to encourage the solution to have characteristics which are most naturally expressed by the combination of more than one regularizer. The resulting optimization problems can not be dealt with by the current state-of-the-art algorithms, which are designed for single regularizers (such as total variation or sparseness-inducing penalties, but not both simultaneously). In this paper, we introduce an iterative algorithm to solve the optimization problem resulting from image (or signal) inverse problems with two (or more) regularizers. We illustrate the new algorithm in a problem of restoration of "group sparse" images, i.e., images displaying a special type of sparseness in which the active pixels tend to cluster together. Experimental results show the effectiveness of the proposed algorithm in solving the corresponding optimization problem.

[1]  R. Tibshirani,et al.  An introduction to the bootstrap , 1993 .

[2]  Patrick L. Combettes,et al.  Proximal Thresholding Algorithm for Minimization over Orthonormal Bases , 2007, SIAM J. Optim..

[3]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[4]  José M. Bioucas-Dias,et al.  A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration , 2007, IEEE Transactions on Image Processing.

[5]  Robert D. Nowak,et al.  SPACE-TIME SPARSITY REGULARIZATION FOR THE MAGNETOENCEPHALOGRAPHY INVERSE PROBLEM , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[6]  Patrick L. Combettes,et al.  Signal Recovery by Proximal Forward-Backward Splitting , 2005, Multiscale Model. Simul..

[7]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[8]  Antonin Chambolle,et al.  Nonlinear wavelet image processing: variational problems, compression, and noise removal through wavelet shrinkage , 1998, IEEE Trans. Image Process..

[9]  Wolfgang Osten,et al.  Introduction to Inverse Problems in Imaging , 1999 .

[10]  Antonin Chambolle,et al.  Total Variation Minimization and a Class of Binary MRF Models , 2005, EMMCVPR.

[11]  Stephen J. Wright,et al.  Sparse Reconstruction by Separable Approximation , 2008, IEEE Transactions on Signal Processing.

[12]  Michael Elad,et al.  A wide-angle view at iterated shrinkage algorithms , 2007, SPIE Optical Engineering + Applications.

[13]  Andrew K. Bolstad,et al.  An expectation-maximization algorithm for space-time sparsity regularization of the MEG inverse problem , 2007 .

[14]  Mário A. T. Figueiredo,et al.  Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems , 2007, IEEE Journal of Selected Topics in Signal Processing.

[15]  Robert D. Nowak,et al.  On Total Variation Denoising: A New Majorization-Minimization Algorithm and an Experimental Comparisonwith Wavalet Denoising , 2006, 2006 International Conference on Image Processing.

[16]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[17]  Jérôme Darbon,et al.  A Fast and Exact Algorithm for Total Variation Minimization , 2005, IbPRIA.

[18]  Michael Elad,et al.  Submitted to Ieee Transactions on Image Processing Image Decomposition via the Combination of Sparse Representations and a Variational Approach , 2022 .

[19]  NG MICHAELK.,et al.  ITERATIVE ALGORITHMS BASED ON THE DECOUPLE OF DEBLURRING AND DENOISING FOR IMAGE RESTORATION , 2008 .

[20]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[21]  Andy M. Yip,et al.  Recent Developments in Total Variation Image Restoration , 2004 .

[22]  Robert D. Nowak,et al.  Majorization–Minimization Algorithms for Wavelet-Based Image Restoration , 2007, IEEE Transactions on Image Processing.

[23]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[24]  Michael K. Ng,et al.  Iterative Algorithms Based on Decoupling of Deblurring and Denoising for Image Restoration , 2008, SIAM J. Sci. Comput..

[25]  M. Nikolova.  An Algorithm for Total Variation Minimization and Applications , 2004 .

[26]  Justin Romberg,et al.  Practical Signal Recovery from Random Projections , 2005 .

[27]  Antonin Chambolle,et al.  A l1-Unified Variational Framework for Image Restoration , 2004, ECCV.

[28]  Mario Bertero,et al.  Introduction to Inverse Problems in Imaging , 1998 .