Isotropic and anisotropic filtering norm-minimization: A generalization of the TV and TGV minimizations using NESTA

Abstract Compressive sensing (CS) allows for the reconstruction of sparse signals based on measurements acquired at sub-Nyquist sampling rates. Amongst the common CS methods, total variation (TV) minimization is a common approach used to reconstruct images that are approximately piece-wise constant. The discrete gradient operation in TV can be described as a filtering operation using the horizontal and vertical finite differences filters. In this paper, we generalize the TV minimization procedure for any set of digital filters. The proposed method allows one to reconstruct signals that are sparse when filtered with some set of filters, other than the finite difference operators. Our implementation is based on a fast and accurate first-order optimization algorithm which is called NESTA, in a reference to the Nesterov’s algorithm. We incorporate isotropic and anisotropic filtering combinations to the original TV minimization method implemented in the original NESTA algorithm. We also propose 3 forms of the second order total generalized variation (TGV) when using first and second order filters. In order to evaluate the method, we perform a systematic set of experiments using synthetic and real magnetic resonance images, with several sets of filters and cost functions and under different undersampling factors and noise levels. A statistical analysis of the results shows that the best configurations of our method provide a significantly better image quality when compared to the TV and TGV for MRI reconstruction.

[1]  Mark James,et al.  Biomedical Informatics Research Network: Building a National Collaboratory to Hasten the Derivation of New Understanding and Treatment of Disease , 2005, HealthGrid.

[2]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[3]  Marta M. Betcke,et al.  Multicontrast MRI Reconstruction with Structure-Guided Total Variation , 2015, SIAM J. Imaging Sci..

[4]  Laurent Condat,et al.  Discrete Total Variation: New Definition and Minimization , 2017, SIAM J. Imaging Sci..

[5]  Robert M. Gray,et al.  Toeplitz and Circulant Matrices: A Review , 2005, Found. Trends Commun. Inf. Theory.

[6]  Sungheon Kim,et al.  Golden‐angle radial sparse parallel MRI: Combination of compressed sensing, parallel imaging, and golden‐angle radial sampling for fast and flexible dynamic volumetric MRI , 2014, Magnetic resonance in medicine.

[7]  Marc Teboulle,et al.  Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems , 2009, IEEE Transactions on Image Processing.

[8]  Emmanuel J. Candès,et al.  NESTA: A Fast and Accurate First-Order Method for Sparse Recovery , 2009, SIAM J. Imaging Sci..

[9]  Harald Birkholz,et al.  A unifying approach to isotropic and anisotropic total variation denoising models , 2011, J. Comput. Appl. Math..

[10]  Changsoo Shin,et al.  Waveform inversion using a back-propagation algorithm and a Huber function norm , 2009 .

[11]  A. J. Jerri The Shannon sampling theorem—Its various extensions and applications: A tutorial review , 1977, Proceedings of the IEEE.

[12]  Ming Yan,et al.  Fast L1–L2 Minimization via a Proximal Operator , 2016, Journal of Scientific Computing.

[13]  R.G. Baraniuk,et al.  Compressive Sensing [Lecture Notes] , 2007, IEEE Signal Processing Magazine.

[14]  B. F. Logan,et al.  The Fourier reconstruction of a head section , 1974 .

[15]  Michael Elad,et al.  Analysis versus synthesis in signal priors , 2006, 2006 14th European Signal Processing Conference.

[16]  Jack Xin,et al.  A Weighted Difference of Anisotropic and Isotropic Total Variation Model for Image Processing , 2015, SIAM J. Imaging Sci..

[17]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[18]  Jack Xin,et al.  Minimization of ℓ1-2 for Compressed Sensing , 2015, SIAM J. Sci. Comput..

[19]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[20]  Olgica Milenkovic,et al.  Subspace Pursuit for Compressive Sensing Signal Reconstruction , 2008, IEEE Transactions on Information Theory.

[21]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[22]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[23]  E. Candès,et al.  Sparsity and incoherence in compressive sampling , 2006, math/0611957.

[24]  Junzhou Huang,et al.  Fast multi-contrast MRI reconstruction. , 2014, Magnetic resonance imaging.

[25]  G. Walter,et al.  Wavelets and Other Orthogonal Systems , 2018 .

[26]  Miguel R. D. Rodrigues,et al.  Compressed Sensing With Prior Information: Strategies, Geometry, and Bounds , 2017, IEEE Transactions on Information Theory.

[27]  Yurii Nesterov,et al.  Smooth minimization of non-smooth functions , 2005, Math. Program..

[28]  Junzhou Huang,et al.  Real Time Dynamic MRI with Dynamic Total Variation , 2014, MICCAI.

[29]  Adam M. Oberman,et al.  Anisotropic Total Variation Regularized L^1-Approximation and Denoising/Deblurring of 2D Bar Codes , 2010, 1007.1035.

[30]  S. Osher,et al.  Decomposition of images by the anisotropic Rudin‐Osher‐Fatemi model , 2004 .

[31]  Mylène C. Q. Farias,et al.  Evaluation of Different Types of Filters in Magnetic Resonance Imaging Using Compressive Sensing with Pre-Filtering , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[32]  T. Pock,et al.  Second order total generalized variation (TGV) for MRI , 2011, Magnetic resonance in medicine.

[33]  Y. Nesterov A method for unconstrained convex minimization problem with the rate of convergence o(1/k^2) , 1983 .

[34]  Junfeng Yang,et al.  A New Alternating Minimization Algorithm for Total Variation Image Reconstruction , 2008, SIAM J. Imaging Sci..

[35]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[36]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[37]  D. F. Morrison Multivariate Analysis of Variance , 2005 .

[38]  Junfeng Yang,et al.  A Fast Alternating Direction Method for TVL1-L2 Signal Reconstruction From Partial Fourier Data , 2010, IEEE Journal of Selected Topics in Signal Processing.

[39]  Jack Xin,et al.  Computing Sparse Representation in a Highly Coherent Dictionary Based on Difference of $$L_1$$L1 and $$L_2$$L2 , 2015, J. Sci. Comput..