Unlimited Sampling of Sparse Signals

In a recent paper [1], we introduced the concept of “Unlimited Sampling”. This unique approach circumvents the clipping or saturation problem in conventional analog-to-digital converters (ADCs) by considering a radically different ADC architecture which resets the input voltage before saturation. Such ADCs, also known as Self-Reset ADCs (SR-ADCs), allow for sensing modulo samples. In analogy to Shannon's sampling theorem, the unlimited sampling theorem proves that a bandlimited signal can be recovered from modulo samples provided that a certain sampling density criterion, that is independent of the ADC threshold, is satisfied. In this way, our result allows for perfect recovery of a bandlimited function whose amplitude exceeds the ADC threshold by orders of magnitude. By capitalizing on this result, in this paper, we consider the inverse problem of recovering a sparse signal from its low-pass filtered version. This problem frequently arises in several areas of science and engineering and in context of signal processing, it is studied in several flavors, namely, sparse or FRI sampling, super-resolution and sparse deconvolution. By considering the SR-ADC architecture, we develop a sampling theory for modulo sampling of lowpass filtered spikes. Our main result consists of a new sparse sampling theorem and an algorithm which stably recovers a $K$ -sparse signal from low-pass, modulo samples. We validate our results using numerical experiments.

[1]  S. Levy,et al.  Reconstruction of a sparse spike train from a portion of its spectrum and application to high-resolution deconvolution , 1981 .

[2]  K Itoh,et al.  Analysis of the phase unwrapping algorithm. , 1982, Applied optics.

[3]  Julius O. Smith,et al.  Restoring a clipped signal , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[4]  T. Speed,et al.  Parametric deconvolution of positive spike trains , 2000 .

[5]  Thierry Blu,et al.  Sampling signals with finite rate of innovation , 2002, IEEE Trans. Signal Process..

[6]  Youngjoong Joo,et al.  Wide dynamic range CMOS image sensor with pixel level ADC , 2003 .

[7]  Tomas Olofsson,et al.  Deconvolution and model-based restoration of clipped ultrasonic signals , 2005, IEEE Transactions on Instrumentation and Measurement.

[8]  M. Vetterli,et al.  Sparse Sampling of Signal Innovations , 2008, IEEE Signal Processing Magazine.

[9]  R. Michael Buehrer,et al.  Analysis and Implementation of a Time-Interleaved ADC Array for a Software-Defined UWB Receiver , 2009, IEEE Transactions on Vehicular Technology.

[10]  Ayush Bhandari,et al.  Sampling and Reconstruction of Sparse Signals in Fractional Fourier Domain , 2010, IEEE Signal Processing Letters.

[11]  Y. Ben‐Zion,et al.  An Algorithm for Detecting Clipped Waveforms and Suggested Correction Procedures , 2010 .

[12]  Yonina C. Eldar,et al.  Innovation Rate Sampling of Pulse Streams With Application to Ultrasound Imaging , 2010, IEEE Transactions on Signal Processing.

[13]  Michael Elad,et al.  A constrained matching pursuit approach to audio declipping , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Emmanuel J. Candès,et al.  Towards a Mathematical Theory of Super‐resolution , 2012, ArXiv.

[15]  Sundeep Rangan,et al.  Estimation of Sparse MIMO Channels with Common Support , 2011, IEEE Transactions on Communications.

[16]  Pina Marziliano,et al.  Sampling Signals With a Finite Rate of Innovation on the Sphere , 2013, IEEE Transactions on Signal Processing.

[17]  Parikshit Shah,et al.  Compressed Sensing Off the Grid , 2012, IEEE Transactions on Information Theory.

[18]  Ali H. Sayed,et al.  Mitigation of clipping in sensors , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[19]  Chandra Sekhar Seelamantula,et al.  Super-Resolution Reconstruction in Frequency-Domain Optical-Coherence Tomography Using the Finite-Rate-of-Innovation Principle , 2014, IEEE Transactions on Signal Processing.

[20]  Yonina C. Eldar Sampling Theory: Beyond Bandlimited Systems , 2015 .

[21]  Helmut Bölcskei,et al.  A Theory of Super-Resolution from Short-Time Fourier Transform Measurements , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[22]  J. Ohta,et al.  An Implantable CMOS Image Sensor With Self-Reset Pixels for Functional Brain Imaging , 2016, IEEE Transactions on Electron Devices.

[23]  Vesa Välimäki,et al.  Aliasing Reduction in Clipped Signals , 2016, IEEE Transactions on Signal Processing.

[24]  Yonina C. Eldar,et al.  A swiss army knife for finite rate of innovation sampling theory , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[25]  Ramesh Raskar,et al.  Signal Processing for Time-of-Flight Imaging Sensors: An introduction to inverse problems in computational 3-D imaging , 2016, IEEE Signal Processing Magazine.

[26]  Yue M. Lu,et al.  Sampling Sparse Signals on the Sphere: Algorithms and Applications , 2015, IEEE Transactions on Signal Processing.

[27]  Jinhai Zhang,et al.  Restoration of clipped seismic waveforms using projection onto convex sets method , 2016, Scientific Reports.

[28]  Andrew M. Wallace,et al.  Super-resolved time-of-flight sensing via FRI sampling theory , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[29]  Thierry Blu,et al.  Towards Generalized FRI Sampling With an Application to Source Resolution in Radioastronomy , 2017, IEEE Transactions on Signal Processing.

[30]  Ramesh Raskar,et al.  On unlimited sampling , 2017, 2017 International Conference on Sampling Theory and Applications (SampTA).