Compressed Sensing of Analog Signals in Shift-Invariant Spaces

A traditional assumption underlying most data converters is that the signal should be sampled at a rate exceeding twice the highest frequency. This statement is based on a worst-case scenario in which the signal occupies the entire available bandwidth. In practice, many signals are sparse so that only part of the bandwidth is used. In this paper, we develop methods for low-rate sampling of continuous-time sparse signals in shift-invariant (SI) spaces, generated by m kernels with period T . We model sparsity by treating the case in which only k out of the m generators are active, however, we do not know which k are chosen. We show how to sample such signals at a rate much lower than m/T, which is the minimal sampling rate without exploiting sparsity. Our approach combines ideas from analog sampling in a subspace with a recently developed block diagram that converts an infinite set of sparse equations to a finite counterpart. Using these two components we formulate our problem within the framework of finite compressed sensing (CS) and then rely on algorithms developed in that context. The distinguishing feature of our results is that in contrast to standard CS, which treats finite-length vectors, we consider sampling of analog signals for which no underlying finite-dimensional model exists. The proposed framework allows to extend much of the recent literature on CS to the analog domain.

[1]  I F Gorodnitsky,et al.  Neuromagnetic source imaging with FOCUSS: a recursive weighted minimum norm algorithm. , 1995, Electroencephalography and clinical neurophysiology.

[2]  Cormac Herley,et al.  Minimum rate sampling and reconstruction of signals with arbitrary frequency support , 1999, IEEE Trans. Inf. Theory.

[3]  Yonina C. Eldar,et al.  Nonlinear and Non-Ideal Sampling : Theory and Methods , 2008 .

[4]  Emmanuel J. Cand The Restricted Isometry Property and Its Implications for Compressed Sensing , 2008 .

[5]  Yonina C. Eldar,et al.  Beyond Bandlimited Sampling: Nonlinearities, Smoothness and Sparsity , 2008, ArXiv.

[6]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[7]  E. Candès The restricted isometry property and its implications for compressed sensing , 2008 .

[8]  P. Vaidyanathan,et al.  Periodically nonuniform sampling of bandpass signals , 1998 .

[9]  Thierry Blu,et al.  Sampling signals with finite rate of innovation , 2002, IEEE Trans. Signal Process..

[10]  Richard G. Baraniuk,et al.  Theory and Implementation of an Analog-to-Information Converter using Random Demodulation , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[11]  D. Donoho,et al.  Maximal Sparsity Representation via l 1 Minimization , 2002 .

[12]  H. Nyquist,et al.  Certain Topics in Telegraph Transmission Theory , 1928, Transactions of the American Institute of Electrical Engineers.

[13]  Michael Elad,et al.  Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ1 minimization , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[14]  Michael Unser,et al.  A general sampling theory for nonideal acquisition devices , 1994, IEEE Trans. Signal Process..

[15]  Richard H. Sherman,et al.  Chaotic communications in the presence of noise , 1993, Optics & Photonics.

[16]  Akram Aldroubi,et al.  Nonuniform Sampling and Reconstruction in Shift-Invariant Spaces , 2001, SIAM Rev..

[17]  J. Tropp Algorithms for simultaneous sparse approximation. Part II: Convex relaxation , 2006, Signal Process..

[18]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Yonina C. Eldar,et al.  From Theory to Practice: Sub-Nyquist Sampling of Sparse Wideband Analog Signals , 2009, IEEE Journal of Selected Topics in Signal Processing.

[20]  M. Unser Sampling-50 years after Shannon , 2000, Proceedings of the IEEE.

[21]  J. Kruskal Three-way arrays: rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics , 1977 .

[22]  Joel A. Tropp,et al.  Algorithms for simultaneous sparse approximation. Part I: Greedy pursuit , 2006, Signal Process..

[23]  Yonina C. Eldar,et al.  Generalized Shift-Invariant Systems and Frames for Subspaces , 2005 .

[24]  Yonina C. Eldar,et al.  Reduce and Boost: Recovering Arbitrary Sets of Jointly Sparse Vectors , 2008, IEEE Transactions on Signal Processing.

[25]  Yonina C. Eldar,et al.  Robust Recovery of Signals From a Structured Union of Subspaces , 2008, IEEE Transactions on Information Theory.

[26]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[27]  E. Candès,et al.  Sparsity and incoherence in compressive sampling , 2006, math/0611957.

[28]  Mike E. Davies,et al.  Sampling Theorems for Signals From the Union of Finite-Dimensional Linear Subspaces , 2009, IEEE Transactions on Information Theory.

[29]  Yonina C. Eldar,et al.  Spectrum-blind reconstruction of multi-band signals , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[30]  R. DeVore,et al.  The Structure of Finitely Generated Shift-Invariant Spaces in , 1992 .

[31]  Yonina C. Eldar,et al.  Robust Recovery of Signals From a Union of Subspaces , 2008, ArXiv.

[32]  Yonina C. Eldar,et al.  Blind Multiband Signal Reconstruction: Compressed Sensing for Analog Signals , 2007, IEEE Transactions on Signal Processing.

[33]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[34]  Ingrid Daubechies,et al.  The wavelet transform, time-frequency localization and signal analysis , 1990, IEEE Trans. Inf. Theory.

[35]  Bhaskar D. Rao,et al.  Sparse solutions to linear inverse problems with multiple measurement vectors , 2005, IEEE Transactions on Signal Processing.

[36]  D. Hardin,et al.  Fractal Functions and Wavelet Expansions Based on Several Scaling Functions , 1994 .

[37]  Minh N. Do,et al.  A Theory for Sampling Signals from a Union of Subspaces , 2022 .

[38]  P. Vaidyanathan Generalizations of the sampling theorem: Seven decades after Nyquist , 2001 .

[39]  Richard G. Baraniuk,et al.  Random Filters for Compressive Sampling and Reconstruction , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[40]  Yonina C. Eldar,et al.  Beyond bandlimited sampling , 2009, IEEE Signal Processing Magazine.

[41]  Yonina C. Eldar,et al.  A minimum squared-error framework for generalized sampling , 2006, IEEE Transactions on Signal Processing.

[42]  Thierry Blu,et al.  Sampling Moments and Reconstructing Signals of Finite Rate of Innovation: Shannon Meets Strang–Fix , 2007, IEEE Transactions on Signal Processing.

[43]  Yonina C. Eldar,et al.  Nonlinear and Nonideal Sampling: Theory and Methods , 2008, IEEE Transactions on Signal Processing.

[44]  Jie Chen,et al.  Theoretical Results on Sparse Representations of Multiple-Measurement Vectors , 2006, IEEE Transactions on Signal Processing.

[45]  Yoram Bresler,et al.  Perfect reconstruction formulas and bounds on aliasing error in sub-nyquist nonuniform sampling of multiband signals , 2000, IEEE Trans. Inf. Theory.

[46]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[47]  Yonina C. Eldar,et al.  Characterization of Oblique Dual Frame Pairs , 2006, EURASIP J. Adv. Signal Process..

[48]  Yonina C. Eldar Sampling with Arbitrary Sampling and Reconstruction Spaces and Oblique Dual Frame Vectors , 2003 .

[49]  A. Aldroubi,et al.  Sampling procedures in function spaces and asymptotic equivalence with shannon's sampling theory , 1994 .

[50]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[51]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[52]  Yonina C. Eldar,et al.  Oblique dual frames and shift-invariant spaces , 2004 .