Compressed Sensing of Analog Signals

A traditional assumption underlying most data converters i s that the signal should be sampled at a rate which exceeds twice the highest frequency. This statement is base d on a worst-case scenario in which the signal occupies the entire available bandwidth. In practice, many signals p o ses a sparse structure so that a large part of the bandwidth is not exploited. In this paper, we consider a fram ework for utilizing this sparsity in order to sample such analog signals at a low rate. More specifically, we consi der continuous-time signals that lie in a shift-invariant (SI) space generated by m kernels, so that any signal in the space can be expressed as an infinite linear combination of the shifted kernels. If the period of the underlying SI spa ce is equal toT , then such signals can be perfectly reconstructed from samples at a rate of m/T . Here we treat the case in which only k out of them generators are active, meaning that the signal actually lies in a lower dime nsional space spanned by k generators. However, we do not know whichk are chosen. By relying on results developed in the context of compressed sensing (CS) of finite-length vectors, we develop a general framework for sa mpling such signals at a rate much lower than m/T . The distinguishing feature of our results is that in contras t to the problems treated in the context of CS, here we consider sampling of analog-signals for which no underly ing finite-dimensional model exists. Our approach combines ideas from analog sampling in a subspace with a rece ntly developed block diagram that converts an infinite set of sparse equations to a finite counterpart. Usin g these two components we formulate our problem within the framework of finite CS and then rely on efficient and stable algorithms developed in that context. Our results allow to extend much of the recent literature on CS to the truly analog domain. Department of Electrical Engineering, Technion—Israel In stitute of Technology, Haifa 32000, Israel. Phone: +972-48293256, fax: +9724-8295757, E-mail: yonina@ee.technion.ac.il. This work w as supported in part by the Israel Science Foundation under G rant no. 1081/07 and by the European Commission in the framework of the FP7 Net work of Excellence in Wireless COMmunications NEWCOM++ (co ntract no. 216715). 2

[1]  A. Quazi An overview on the time delay estimate in active and passive systems for target localization , 1981 .

[2]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[3]  Yonina C. Eldar,et al.  Generalized Shift-Invariant Systems and Frames for Subspaces , 2005 .

[4]  P. Vaidyanathan Generalizations of the sampling theorem: Seven decades after Nyquist , 2001 .

[5]  I F Gorodnitsky,et al.  Neuromagnetic source imaging with FOCUSS: a recursive weighted minimum norm algorithm. , 1995, Electroencephalography and clinical neurophysiology.

[6]  Thierry Blu,et al.  Sampling signals with finite rate of innovation , 2002, IEEE Trans. Signal Process..

[7]  Richard G. Baraniuk,et al.  Theory and Implementation of an Analog-to-Information Converter using Random Demodulation , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[8]  A. Aldroubi,et al.  Sampling procedures in function spaces and asymptotic equivalence with shannon's sampling theory , 1994 .

[9]  M. Skolnik,et al.  Introduction to Radar Systems , 2021, Advances in Adaptive Radar Detection and Range Estimation.

[10]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[11]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[12]  Richard H. Sherman,et al.  Chaotic communications in the presence of noise , 1993, Optics & Photonics.

[13]  Minh N. Do,et al.  A Theory for Sampling Signals from a Union of Subspaces , 2022 .

[14]  Cormac Herley,et al.  Minimum rate sampling and reconstruction of signals with arbitrary frequency support , 1999, IEEE Trans. Inf. Theory.

[15]  Yonina C. Eldar,et al.  Nonlinear and Non-Ideal Sampling : Theory and Methods , 2008 .

[16]  J. Tropp Algorithms for simultaneous sparse approximation. Part II: Convex relaxation , 2006, Signal Process..

[17]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[18]  Joel A. Tropp,et al.  Algorithms for simultaneous sparse approximation. Part I: Greedy pursuit , 2006, Signal Process..

[19]  P. Vaidyanathan,et al.  Periodically nonuniform sampling of bandpass signals , 1998 .

[20]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[21]  A. J. Jerri The Shannon sampling theorem—Its various extensions and applications: A tutorial review , 1977, Proceedings of the IEEE.

[22]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  R. DeVore,et al.  The Structure of Finitely Generated Shift-Invariant Spaces in , 1992 .

[24]  G.L. Turin,et al.  Introduction to spread-spectrum antimultipath techniques and their application to urban digital radio , 1980, Proceedings of the IEEE.

[25]  J. Kruskal Three-way arrays: rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics , 1977 .

[26]  M. Unser Sampling-50 years after Shannon , 2000, Proceedings of the IEEE.

[27]  Yonina C. Eldar,et al.  Blind Multiband Signal Reconstruction: Compressed Sensing for Analog Signals , 2007, IEEE Transactions on Signal Processing.

[28]  Thierry Blu,et al.  Extrapolation and Interpolation) , 2022 .

[29]  Yonina C. Eldar,et al.  Beyond Bandlimited Sampling: Nonlinearities, Smoothness and Sparsity , 2008, ArXiv.

[30]  Jie Chen,et al.  Theoretical Results on Sparse Representations of Multiple-Measurement Vectors , 2006, IEEE Transactions on Signal Processing.

[31]  Yonina C. Eldar,et al.  Reduce and Boost: Recovering Arbitrary Sets of Jointly Sparse Vectors , 2008, IEEE Transactions on Signal Processing.

[32]  A. J. Jerri Correction to "The Shannon sampling theorem—Its various extensions and applications: A tutorial review" , 1979 .

[33]  J.A. Tropp Random Filters for Compressive Sampling , 2006, 2006 40th Annual Conference on Information Sciences and Systems.

[34]  E. Candès The restricted isometry property and its implications for compressed sensing , 2008 .

[35]  D. Donoho,et al.  Maximal Sparsity Representation via l 1 Minimization , 2002 .

[36]  Michael Unser,et al.  A general sampling theory for nonideal acquisition devices , 1994, IEEE Trans. Signal Process..

[37]  E. Candès,et al.  Inverse Problems Sparsity and incoherence in compressive sampling , 2007 .

[38]  Yonina C. Eldar,et al.  A minimum squared-error framework for generalized sampling , 2006, IEEE Transactions on Signal Processing.

[39]  Martin Vetterli,et al.  Sampling and reconstruction of signals with finite rate of innovation in the presence of noise , 2005, IEEE Transactions on Signal Processing.

[40]  Ingrid Daubechies,et al.  The wavelet transform, time-frequency localization and signal analysis , 1990, IEEE Trans. Inf. Theory.

[41]  Bhaskar D. Rao,et al.  Sparse solutions to linear inverse problems with multiple measurement vectors , 2005, IEEE Transactions on Signal Processing.

[42]  D. Hardin,et al.  Fractal Functions and Wavelet Expansions Based on Several Scaling Functions , 1994 .

[43]  Joel A. Tropp,et al.  ALGORITHMS FOR SIMULTANEOUS SPARSE APPROXIMATION , 2006 .

[44]  Yonina C. Eldar,et al.  Oblique dual frames and shift-invariant spaces , 2004 .

[45]  Yoram Bresler,et al.  Perfect reconstruction formulas and bounds on aliasing error in sub-nyquist nonuniform sampling of multiband signals , 2000, IEEE Trans. Inf. Theory.

[46]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[47]  Yonina C. Eldar,et al.  Characterization of Oblique Dual Frame Pairs , 2006, EURASIP J. Adv. Signal Process..

[48]  Jian Li,et al.  Range-Doppler Imaging Via a Train of Probing Pulses , 2009, IEEE Transactions on Signal Processing.

[49]  Robert J. Urick,et al.  Principles of underwater sound , 1975 .

[50]  H. Nyquist,et al.  Abridgment of certain topics in telegraph transmission theory , 1928, Journal of the A.I.E.E..