Greedy algorithms for nonnegativity-constrained simultaneous sparse recovery

This work proposes a family of greedy algorithms to jointly reconstruct a set of vectors that are (i) nonnegative and (ii) simultaneously sparse with a shared support set. The proposed algorithms generalize previous approaches that were designed to impose these constraints individually. Similar to previous greedy algorithms for sparse recovery, the proposed algorithms iteratively identify promising support indices. In contrast to previous approaches, the support index selection procedure has been adapted to prioritize indices that are consistent with both the nonnegativity and shared support constraints. Empirical results demonstrate for the first time that the combined use of simultaneous sparsity and nonnegativity constraints can substantially improve recovery performance relative to existing greedy algorithms that impose less signal structure.

[1]  H. Rauhut,et al.  Atoms of All Channels, Unite! Average Case Analysis of Multi-Channel Sparse Recovery Using Greedy Algorithms , 2008 .

[2]  J. Tropp Algorithms for simultaneous sparse approximation. Part II: Convex relaxation , 2006, Signal Process..

[3]  Ashish Raj,et al.  Spatial HARDI: Improved visualization of complex white matter architecture with Bayesian spatial regularization , 2011, NeuroImage.

[4]  Derek K. Jones,et al.  Investigating the prevalence of complex fiber configurations in white matter tissue with diffusion magnetic resonance imaging , 2013, Human brain mapping.

[5]  Maxime Descoteaux,et al.  Quantitative evaluation of 10 tractography algorithms on a realistic diffusion MR phantom , 2011, NeuroImage.

[6]  Jie Chen,et al.  Theoretical Results on Sparse Representations of Multiple-Measurement Vectors , 2006, IEEE Transactions on Signal Processing.

[7]  Patrik O. Hoyer,et al.  Non-negative Matrix Factorization with Sparseness Constraints , 2004, J. Mach. Learn. Res..

[8]  Massimo Fornasier,et al.  Recovery Algorithms for Vector-Valued Data with Joint Sparsity Constraints , 2008, SIAM J. Numer. Anal..

[9]  D. Donoho,et al.  Sparse nonnegative solution of underdetermined linear equations by linear programming. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Yoram Bresler,et al.  Subspace Methods for Joint Sparse Recovery , 2010, IEEE Transactions on Information Theory.

[11]  Joel A. Tropp,et al.  Algorithms for simultaneous sparse approximation. Part I: Greedy pursuit , 2006, Signal Process..

[12]  Frank E. Harrell,et al.  Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis , 2001 .

[13]  Simon Foucart,et al.  RECOVERING JOINTLY SPARSE VECTORS VIA HARD THRESHOLDING PURSUIT , 2011 .

[14]  Mike E. Davies,et al.  Normalized Iterative Hard Thresholding: Guaranteed Stability and Performance , 2010, IEEE Journal of Selected Topics in Signal Processing.

[15]  Gitta Kutyniok,et al.  1 . 2 Sparsity : A Reasonable Assumption ? , 2012 .

[16]  K. Trinkaus,et al.  Quantification of increased cellularity during inflammatory demyelination. , 2011, Brain : a journal of neurology.

[17]  Simon Foucart,et al.  Hard Thresholding Pursuit: An Algorithm for Compressive Sensing , 2011, SIAM J. Numer. Anal..

[18]  Jeffrey D. Blanchard,et al.  Greedy Algorithms for Joint Sparse Recovery , 2014, IEEE Transactions on Signal Processing.

[19]  A. Raj,et al.  Bayesian algorithm using spatial priors for multiexponential T2 relaxometry from multiecho spin echo MRI , 2012, Magnetic resonance in medicine.

[20]  J. Mangin,et al.  New diffusion phantoms dedicated to the study and validation of high‐angular‐resolution diffusion imaging (HARDI) models , 2008, Magnetic resonance in medicine.

[21]  Rachid Deriche,et al.  Non-Negative Spherical Deconvolution (NNSD) for estimation of fiber Orientation Distribution Function in single-/multi-shell diffusion MRI , 2014, NeuroImage.

[22]  Ao Tang,et al.  A Unique “Nonnegative” Solution to an Underdetermined System: From Vectors to Matrices , 2010, IEEE Transactions on Signal Processing.

[23]  Justin P. Haldar,et al.  Compressed-Sensing MRI With Random Encoding , 2011, IEEE Transactions on Medical Imaging.

[24]  S. Mallat,et al.  Adaptive greedy approximations , 1997 .

[25]  Olgica Milenkovic,et al.  Subspace Pursuit for Compressive Sensing Signal Reconstruction , 2008, IEEE Transactions on Information Theory.

[26]  Yonina C. Eldar,et al.  Rank Awareness in Joint Sparse Recovery , 2010, IEEE Transactions on Information Theory.

[27]  Michael Elad,et al.  Stable recovery of sparse overcomplete representations in the presence of noise , 2006, IEEE Transactions on Information Theory.

[28]  M. Yuan,et al.  Model selection and estimation in regression with grouped variables , 2006 .

[29]  Brendt Wohlberg,et al.  A nonconvex ADMM algorithm for group sparsity with sparse groups , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[30]  Justin P. Haldar,et al.  A Majorize-Minimize Framework for Rician and Non-Central Chi MR Images , 2015, IEEE Transactions on Medical Imaging.

[31]  Bhaskar D. Rao,et al.  Sparse solutions to linear inverse problems with multiple measurement vectors , 2005, IEEE Transactions on Signal Processing.

[32]  Michael Elad,et al.  On the Uniqueness of Nonnegative Sparse Solutions to Underdetermined Systems of Equations , 2008, IEEE Transactions on Information Theory.

[33]  M. Horsfield,et al.  Optimal strategies for measuring diffusion in anisotropic systems by magnetic resonance imaging , 1999, Magnetic resonance in medicine.

[34]  Justin P. Haldar,et al.  Rank-Constrained Solutions to Linear Matrix Equations Using PowerFactorization , 2009, IEEE Signal Processing Letters.

[35]  Yonina C. Eldar,et al.  Structured Compressed Sensing: From Theory to Applications , 2011, IEEE Transactions on Signal Processing.

[36]  Matthias Hein,et al.  Non-negative least squares for high-dimensional linear models: consistency and sparse recovery without regularization , 2012, 1205.0953.

[37]  Justin P. Haldar,et al.  Linear transforms for Fourier data on the sphere: Application to high angular resolution diffusion MRI of the brain , 2013, NeuroImage.

[38]  Heidi Johansen-Berg,et al.  Diffusion MRI at 25: Exploring brain tissue structure and function , 2012, NeuroImage.

[39]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[40]  Mariano Rivera,et al.  Diffusion Basis Functions Decomposition for Estimating White Matter Intravoxel Fiber Geometry , 2007, IEEE Transactions on Medical Imaging.

[41]  Lie Wang,et al.  Orthogonal Matching Pursuit for Sparse Signal Recovery With Noise , 2011, IEEE Transactions on Information Theory.

[42]  Antonio J. Plaza,et al.  A Signal Processing Perspective on Hyperspectral Unmixing: Insights from Remote Sensing , 2014, IEEE Signal Processing Magazine.

[43]  N. Makris,et al.  High angular resolution diffusion imaging reveals intravoxel white matter fiber heterogeneity , 2002, Magnetic resonance in medicine.

[44]  Joel A. Tropp,et al.  ALGORITHMS FOR SIMULTANEOUS SPARSE APPROXIMATION , 2006 .

[45]  N. Meinshausen Sign-constrained least squares estimation for high-dimensional regression , 2012, 1202.0889.

[46]  Alex L. MacKay,et al.  Quantitative interpretation of NMR relaxation data , 1989 .

[47]  Ronald Cools,et al.  The Birth of Numerical Analysis , 2009 .

[48]  Charles L. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[49]  Deanna Needell,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, ArXiv.

[50]  Justin P. Haldar,et al.  Sparsity Constrained Mixture Modeling for the Estimation of Kinetic Parameters in Dynamic PET , 2014, IEEE Transactions on Medical Imaging.

[51]  R. Deriche,et al.  Regularized, fast, and robust analytical Q‐ball imaging , 2007, Magnetic resonance in medicine.

[52]  Dany Leviatan,et al.  Simultaneous approximation by greedy algorithms , 2006, Adv. Comput. Math..

[53]  Paul D. Gader,et al.  A Signal Processing Perspective on Hyperspectral Unmixing , 2014 .

[54]  F. DuarteM.,et al.  Structured Compressed Sensing , 2011 .