Robust Recovery of Signals From a Structured Union of Subspaces

Traditional sampling theories consider the problem of reconstructing an unknown signal x from a series of samples. A prevalent assumption which often guarantees recovery from the given measurements is that x lies in a known subspace. Recently, there has been growing interest in nonlinear but structured signal models, in which x lies in a union of subspaces. In this paper, we develop a general framework for robust and efficient recovery of such signals from a given set of samples. More specifically, we treat the case in which x lies in a sum of k subspaces, chosen from a larger set of m possibilities. The samples are modeled as inner products with an arbitrary set of sampling functions. To derive an efficient and robust recovery algorithm, we show that our problem can be formulated as that of recovering a block-sparse vector whose nonzero elements appear in fixed blocks. We then propose a mixed lscr2/lscr1 program for block sparse recovery. Our main result is an equivalence condition under which the proposed convex algorithm is guaranteed to recover the original signal. This result relies on the notion of block restricted isometry property (RIP), which is a generalization of the standard RIP used extensively in the context of compressed sensing. Based on RIP, we also prove stability of our approach in the presence of noise and modeling errors. A special case of our framework is that of recovering multiple measurement vectors (MMV) that share a joint sparsity pattern. Adapting our results to this context leads to new MMV recovery methods as well as equivalence conditions under which the entire set can be determined efficiently.

[1]  Harry Nyquist Certain Topics in Telegraph Transmission Theory , 1928 .

[2]  A. J. Jerri The Shannon sampling theorem—Its various extensions and applications: A tutorial review , 1977, Proceedings of the IEEE.

[3]  A. J. Jerri Correction to "The Shannon sampling theorem—Its various extensions and applications: A tutorial review" , 1979 .

[4]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[5]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Stanislaw J. Szarek,et al.  Condition numbers of random matrices , 1991, J. Complex..

[7]  Richard H. Sherman,et al.  Chaotic communications in the presence of noise , 1993, Optics & Photonics.

[8]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[9]  P. P. Vaidyanathan,et al.  Generalized sampling theorems in multiresolution subspaces , 1997, IEEE Trans. Signal Process..

[10]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[11]  M. Unser Sampling-50 years after Shannon , 2000, Proceedings of the IEEE.

[12]  P. Vaidyanathan Generalizations of the sampling theorem: Seven decades after Nyquist , 2001 .

[13]  Thierry Blu,et al.  Sampling signals with finite rate of innovation , 2002, IEEE Trans. Signal Process..

[14]  Yonina C. Eldar Sampling with Arbitrary Sampling and Reconstruction Spaces and Oblique Dual Frame Vectors , 2003 .

[15]  Yonina C. Eldar Sampling Without Input Constraints: Consistent Reconstruction in Arbitrary Spaces , 2004 .

[16]  Yonina C. Eldar,et al.  Oblique dual frames and shift-invariant spaces , 2004 .

[17]  Bhaskar D. Rao,et al.  Sparse solutions to linear inverse problems with multiple measurement vectors , 2005, IEEE Transactions on Signal Processing.

[18]  Dmitry M. Malioutov,et al.  A sparse signal reconstruction perspective for source localization with sensor arrays , 2005, IEEE Transactions on Signal Processing.

[19]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[20]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[21]  Yonina C. Eldar,et al.  General Framework for Consistent Sampling in Hilbert Spaces , 2005, Int. J. Wavelets Multiresolution Inf. Process..

[22]  Yonina C. Eldar,et al.  Characterization of Oblique Dual Frame Pairs , 2006, EURASIP J. Adv. Signal Process..

[23]  Yonina C. Eldar,et al.  A minimum squared-error framework for generalized sampling , 2006, IEEE Transactions on Signal Processing.

[24]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[25]  J. Tropp Algorithms for simultaneous sparse approximation. Part II: Convex relaxation , 2006, Signal Process..

[26]  Joel A. Tropp,et al.  ALGORITHMS FOR SIMULTANEOUS SPARSE APPROXIMATION , 2006 .

[27]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[28]  Jie Chen,et al.  Theoretical Results on Sparse Representations of Multiple-Measurement Vectors , 2006, IEEE Transactions on Signal Processing.

[29]  Joel A. Tropp,et al.  Algorithms for simultaneous sparse approximation. Part I: Greedy pursuit , 2006, Signal Process..

[30]  Thierry Blu,et al.  Sampling Moments and Reconstructing Signals of Finite Rate of Innovation: Shannon Meets Strang–Fix , 2007, IEEE Transactions on Signal Processing.

[31]  Yonina C. Eldar,et al.  Nonlinear and Nonideal Sampling: Theory and Methods , 2008, IEEE Transactions on Signal Processing.

[32]  Mike E. Davies,et al.  Iterative Hard Thresholding for Compressed Sensing , 2008, ArXiv.

[33]  Yonina C. Eldar Uncertainty Relations for Analog Signals , 2008, ArXiv.

[34]  Yonina C. Eldar,et al.  Nonlinear and Non-Ideal Sampling : Theory and Methods , 2008 .

[35]  R. DeVore,et al.  A Simple Proof of the Restricted Isometry Property for Random Matrices , 2008 .

[36]  Minh N. Do,et al.  A Theory for Sampling Signals from a Union of Subspaces , 2022 .

[37]  Babak Hassibi,et al.  Recovering Sparse Signals Using Sparse Measurement Matrices in Compressed DNA Microarrays , 2008, IEEE Journal of Selected Topics in Signal Processing.

[38]  E. Candès The restricted isometry property and its implications for compressed sensing , 2008 .

[39]  Yonina C. Eldar,et al.  Reduce and Boost: Recovering Arbitrary Sets of Jointly Sparse Vectors , 2008, IEEE Transactions on Signal Processing.

[40]  Yonina C. Eldar,et al.  Beyond Bandlimited Sampling: Nonlinearities, Smoothness and Sparsity , 2008, ArXiv.

[41]  J. Tropp,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, Commun. ACM.

[42]  Yonina C. Eldar Compressed Sensing of Analog Signals in Shift-Invariant Spaces , 2008, IEEE Transactions on Signal Processing.

[43]  Babak Hassibi,et al.  On the Reconstruction of Block-Sparse Signals With an Optimal Number of Measurements , 2008, IEEE Transactions on Signal Processing.

[44]  Mike E. Davies,et al.  Sampling Theorems for Signals From the Union of Finite-Dimensional Linear Subspaces , 2009, IEEE Transactions on Information Theory.

[45]  Yonina C. Eldar,et al.  Low Rate Sampling Schemes for Time Delay Estimation , 2009, ArXiv.

[46]  Yonina C. Eldar,et al.  Blind Multiband Signal Reconstruction: Compressed Sensing for Analog Signals , 2007, IEEE Transactions on Signal Processing.

[47]  Yonina C. Eldar Uncertainty Relations for Shift-Invariant Analog Signals , 2008, IEEE Transactions on Information Theory.

[48]  Yonina C. Eldar,et al.  Convex Optimization in Signal Processing and Communications: Optimization techniques in modern sampling theory , 2009 .

[49]  Yonina C. Eldar,et al.  Beyond bandlimited sampling , 2009, IEEE Signal Processing Magazine.

[50]  Yonina C. Eldar,et al.  Convex Optimization in Signal Processing and Communications , 2009 .

[51]  Yonina C. Eldar,et al.  From Theory to Practice: Sub-Nyquist Sampling of Sparse Wideband Analog Signals , 2009, IEEE Journal of Selected Topics in Signal Processing.

[52]  Convex Optimization in Signal Processing and Communications , 2010 .

[53]  Yonina C. Eldar,et al.  Average Case Analysis of Multichannel Sparse Recovery Using Convex Relaxation , 2009, IEEE Transactions on Information Theory.

[54]  Yonina C. Eldar,et al.  Block-Sparse Signals: Uncertainty Relations and Efficient Recovery , 2009, IEEE Transactions on Signal Processing.

[55]  Yonina C. Eldar,et al.  Optimization techniques in modern sampling theory , 2010, Convex Optimization in Signal Processing and Communications.

[56]  Yonina C. Eldar,et al.  Time-Delay Estimation From Low-Rate Samples: A Union of Subspaces Approach , 2009, IEEE Transactions on Signal Processing.

[57]  Volkan Cevher,et al.  Model-Based Compressive Sensing , 2008, IEEE Transactions on Information Theory.

[58]  Deanna Needell,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, ArXiv.