A multilevel based reweighting algorithm with joint regularizers for sparse recovery

Sparsity is one of the key concepts that allows the recovery of signals that are subsampled at a rate significantly lower than required by the Nyquist-Shannon sampling theorem. Our proposed framework uses arbitrary multiscale transforms, such as those build upon wavelets or shearlets, as a sparsity promoting prior which allow to decompose the image into different scales such that image features can be optimally extracted. In order to further exploit the sparsity of the recovered signal we combine the method of reweighted $\ell^1$, introduced by Cand\`es et al., with iteratively updated weights accounting for the multilevel structure of the signal. This is done by directly incorporating this approach into a split Bregman based algorithmic framework. Furthermore, we add total generalized variation (TGV) as a second regularizer into the split Bregman algorithm. The resulting algorithm is then applied to a classical and widely considered task in signal- and image processing which is the reconstruction of images from their Fourier measurements. Our numerical experiments show a highly improved performance at relatively low computational costs compared to many other well established methods and strongly suggest that sparsity is better exploited by our method.

[1]  G. Steidl,et al.  Variational Methods with Higher–Order Derivatives in Image Processing , 2007 .

[2]  G. Kutyniok,et al.  Construction of Compactly Supported Shearlet Frames , 2010, 1003.5481.

[3]  Jean-Luc Starck,et al.  Compressed Sensing in Astronomy , 2008, IEEE Journal of Selected Topics in Signal Processing.

[4]  Gabriele Steidl,et al.  Deblurring Poissonian images by split Bregman techniques , 2010, J. Vis. Commun. Image Represent..

[5]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[6]  Yi Wang,et al.  Description of parallel imaging in MRI using multiple coils , 2000, Magnetic resonance in medicine.

[7]  Wang-Q Lim,et al.  ShearLab 3D , 2014, 1402.5670.

[8]  Jeffrey A. Fessler,et al.  A convergence proof of the split Bregman method for regularized least-squares problems , 2014, ArXiv.

[9]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[10]  Kristian Bredies,et al.  A TGV-Based Framework for Variational Image Decompression, Zooming, and Reconstruction. Part I: Analytics , 2015, SIAM J. Imaging Sci..

[11]  Kristian Bredies,et al.  A TGV-Based Framework for Variational Image Decompression, Zooming, and Reconstruction. Part I: Analytics , 2015, SIAM J. Imaging Sci..

[12]  Wojciech Czaja,et al.  Compressed Sensing Electron Tomography for Determining Biological Structure , 2016, Scientific Reports.

[13]  P. Boesiger,et al.  SENSE: Sensitivity encoding for fast MRI , 1999, Magnetic resonance in medicine.

[14]  Deanna Needell,et al.  Stable Image Reconstruction Using Total Variation Minimization , 2012, SIAM J. Imaging Sci..

[15]  O. Christensen An introduction to frames and Riesz bases , 2002 .

[16]  Wang-Q Lim,et al.  The Discrete Shearlet Transform: A New Directional Transform and Compactly Supported Shearlet Frames , 2010, IEEE Transactions on Image Processing.

[17]  B. Mercier,et al.  A dual algorithm for the solution of nonlinear variational problems via finite element approximation , 1976 .

[18]  Gitta Kutyniok,et al.  Shearlet-based compressed sensing for fast 3D cardiac MR imaging using iterative reweighting , 2017, Physics in medicine and biology.

[19]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[20]  Jackie Ma Generalized sampling reconstruction from Fourier measurements using compactly supported shearlets , 2014 .

[21]  D. Donoho Sparse Components of Images and Optimal Atomic Decompositions , 2001 .

[22]  Emil Y. Sidky,et al.  Quantifying Admissible Undersampling for Sparsity-Exploiting Iterative Image Reconstruction in X-Ray CT , 2011, IEEE Transactions on Medical Imaging.

[23]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[24]  K J Blinowska,et al.  Introduction to wavelet analysis. , 1997, British journal of audiology.

[25]  Gitta Kutyniok,et al.  Linear Stable Sampling Rate: Optimality of 2D Wavelet Reconstructions from Fourier Measurements , 2015, SIAM J. Math. Anal..

[26]  Wang-Q Lim,et al.  Compactly supported shearlets are optimally sparse , 2010, J. Approx. Theory.

[27]  Gabriele Steidl,et al.  Convex multiclass segmentation with shearlet regularization , 2011, Int. J. Comput. Math..

[28]  Wotao Yin,et al.  Bregman Iterative Algorithms for (cid:2) 1 -Minimization with Applications to Compressed Sensing ∗ , 2008 .

[29]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[30]  E. Candès,et al.  New tight frames of curvelets and optimal representations of objects with piecewise C2 singularities , 2004 .

[31]  Philip Schniter,et al.  Iteratively Reweighted ℓ1 Approaches to Sparse Composite Regularization , 2015, IEEE Trans. Computational Imaging.

[32]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[33]  Gerlind Plonka-Hoch,et al.  Curvelet-Wavelet Regularized Split Bregman Iteration for Compressed Sensing , 2011, Int. J. Wavelets Multiresolution Inf. Process..

[34]  Jian-Feng Cai,et al.  Split Bregman Methods and Frame Based Image Restoration , 2009, Multiscale Model. Simul..

[35]  T. Pock,et al.  Second order total generalized variation (TGV) for MRI , 2011, Magnetic resonance in medicine.

[36]  K. Bredies,et al.  Regularization of linear inverse problems with total generalized variation , 2014 .

[37]  Sören Häuser,et al.  Fast Finite Shearlet Transform: a tutorial , 2012 .

[38]  P. Midgley,et al.  Practical Implementation of Compressive Sensing for High Resolution STEM , 2016, Microscopy and Microanalysis.

[39]  D. Labate,et al.  Sparse Multidimensional Representations using Anisotropic Dilation and Shear Operators , 2006 .

[40]  Di Guo,et al.  Magnetic resonance image reconstruction from undersampled measurements using a patch-based nonlocal operator , 2014, Medical Image Anal..

[41]  Xue-Cheng Tai,et al.  Augmented Lagrangian Method, Dual Methods, and Split Bregman Iteration for ROF, Vectorial TV, and High Order Models , 2010, SIAM J. Imaging Sci..

[42]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[43]  Ben Adcock,et al.  Breaking the coherence barrier: asymptotic incoherence and asymptotic sparsity in compressed sensing , 2013, ArXiv.

[44]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[45]  Mário A. T. Figueiredo,et al.  Signal restoration with overcomplete wavelet transforms: comparison of analysis and synthesis priors , 2009, Optical Engineering + Applications.

[46]  Jens Frahm,et al.  Suppression of MRI Truncation Artifacts Using Total Variation Constrained Data Extrapolation , 2008, Int. J. Biomed. Imaging.

[47]  Wang-Q Lim,et al.  Optimal Compressive Imaging of Fourier Data , 2015, SIAM J. Imaging Sci..

[48]  Knut-Andreas Lie,et al.  Scale Space and Variational Methods in Computer Vision, Second International Conference, SSVM 2009, Voss, Norway, June 1-5, 2009. Proceedings , 2009, SSVM.

[49]  Holger Rauhut,et al.  A Mathematical Introduction to Compressive Sensing , 2013, Applied and Numerical Harmonic Analysis.

[50]  Junfeng Yang,et al.  A New Alternating Minimization Algorithm for Total Variation Image Reconstruction , 2008, SIAM J. Imaging Sci..

[51]  Wang-Q Lim,et al.  Optimally Sparse Approximations of 3D Functions by Compactly Supported Shearlet Frames , 2011, SIAM J. Math. Anal..

[52]  Steven A. Orszag,et al.  CBMS-NSF REGIONAL CONFERENCE SERIES IN APPLIED MATHEMATICS , 1978 .

[53]  Dimitri P. Bertsekas,et al.  On the Douglas—Rachford splitting method and the proximal point algorithm for maximal monotone operators , 1992, Math. Program..

[54]  Wotao Yin,et al.  An Iterative Regularization Method for Total Variation-Based Image Restoration , 2005, Multiscale Model. Simul..

[55]  Stephen P. Boyd,et al.  Compressed sensing based cone-beam computed tomography reconstruction with a first-order method. , 2010, Medical physics.

[56]  Klaas Paul Pruessmann,et al.  Realistic Analytical Phantoms for Parallel Magnetic Resonance Imaging , 2012, IEEE Transactions on Medical Imaging.

[57]  Arjan Kuijper,et al.  Scale Space and Variational Methods in Computer Vision , 2013, Lecture Notes in Computer Science.

[58]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .