An Analysis of Block Sampling Strategies in Compressed Sensing

Compressed sensing is a theory which guarantees the exact recovery of sparse signals from a small number of linear projections. The sampling schemes suggested by current compressed sensing theories are often of little practical relevance, since they cannot be implemented on real acquisition systems. In this paper, we study a new random sampling approach that consists of projecting the signal over blocks of sensing vectors. A typical example is the case of blocks made of horizontal lines in the 2-D Fourier plane. We provide the theoretical results on the number of blocks that are sufficient for exact sparse signal reconstruction. This number depends on two properties named intra- and inter-support block coherence. We then show that our bounds coincide with the best so far results in a series of examples, including Gaussian measurements or isolated measurements. We also show that the result is sharp when used with specific blocks in time-frequency bases, in the sense that the minimum required amount of blocks to reconstruct sparse signals cannot be improved up to a multiplicative logarithmic factor. The proposed results provide a good insight on the possibilities and limits of block compressed sensing in imaging devices, such as magnetic resonance imaging, radio-interferometry, or ultra-sound imaging.

[1]  Nicolas Chauffert,et al.  Variable density sampling with continuous sampling trajectories , 2013 .

[2]  Seung-Jean Kim,et al.  A fast method for designing time-optimal gradient waveforms for arbitrary k-space trajectories , 2008, IEEE Transactions on Medical Imaging.

[3]  Emmanuel J. Candès,et al.  A Probabilistic and RIPless Theory of Compressed Sensing , 2010, IEEE Transactions on Information Theory.

[4]  J. Tropp On the conditioning of random subdictionaries , 2008 .

[5]  David Gross,et al.  Recovering Low-Rank Matrices From Few Coefficients in Any Basis , 2009, IEEE Transactions on Information Theory.

[6]  Jean-Philippe Thiran,et al.  Spread Spectrum Magnetic Resonance Imaging , 2012, IEEE Transactions on Medical Imaging.

[7]  H. Rauhut Compressive Sensing and Structured Random Matrices , 2009 .

[8]  Justin K. Romberg,et al.  Restricted Isometries for Partial Random Circulant Matrices , 2010, ArXiv.

[9]  M. Rudelson Random Vectors in the Isotropic Position , 1996, math/9608208.

[10]  R. DeVore,et al.  Compressed sensing and best k-term approximation , 2008 .

[11]  E. Candès The restricted isometry property and its implications for compressed sensing , 2008 .

[12]  Elsa D. Angelini,et al.  Compressed Sensing with off-axis frequency-shifting holography , 2010, Optics letters.

[13]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[14]  Marie Frei,et al.  Decoupling From Dependence To Independence , 2016 .

[15]  Yonina C. Eldar,et al.  Block-Sparse Signals: Uncertainty Relations and Efficient Recovery , 2009, IEEE Transactions on Signal Processing.

[16]  Joel A. Tropp,et al.  User-Friendly Tail Bounds for Sums of Random Matrices , 2010, Found. Comput. Math..

[17]  Pierre Weiss,et al.  An Algorithm for Variable Density Sampling with Block-Constrained Acquisition , 2014, SIAM J. Imaging Sci..

[18]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[19]  Ben Adcock,et al.  Generalized Sampling and Infinite-Dimensional Compressed Sensing , 2016, Found. Comput. Math..

[20]  P. Vandergheynst,et al.  Compressed sensing imaging techniques for radio interferometry , 2008, 0812.4933.

[21]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[22]  E. Candès,et al.  Sparsity and incoherence in compressive sampling , 2006, math/0611957.

[23]  Urbashi Mitra,et al.  Mission design for compressive sensing with mobile robots , 2011, 2011 IEEE International Conference on Robotics and Automation.

[24]  Massimo Fornasier,et al.  Theoretical Foundations and Numerical Methods for Sparse Recovery , 2010, Radon Series on Computational and Applied Mathematics.

[25]  Felix Krahmer,et al.  A Partial Derandomization of PhaseLift Using Spherical Designs , 2013, Journal of Fourier Analysis and Applications.

[26]  Ben Adcock,et al.  BREAKING THE COHERENCE BARRIER: A NEW THEORY FOR COMPRESSED SENSING , 2013, Forum of Mathematics, Sigma.

[27]  Rachel Ward,et al.  Stable and Robust Sampling Strategies for Compressive Imaging , 2012, IEEE Transactions on Image Processing.

[28]  Jean-Luc Starck,et al.  Compressed Sensing in Astronomy , 2008, IEEE Journal of Selected Topics in Signal Processing.

[29]  Pierre Weiss,et al.  Variable Density Sampling with Continuous Trajectories , 2014, SIAM J. Imaging Sci..

[30]  A. Buchholz Operator Khintchine inequality in non-commutative probability , 2001 .

[31]  Ben Adcock,et al.  The quest for optimal sampling: Computationally efficient, structure-exploiting measurements for compressed sensing , 2014, ArXiv.

[32]  Holger Rauhut,et al.  A Mathematical Introduction to Compressive Sensing , 2013, Applied and Numerical Harmonic Analysis.

[33]  Xiaoming Huo,et al.  Uncertainty principles and ideal atomic decomposition , 2001, IEEE Trans. Inf. Theory.

[34]  Dennis Goeckel,et al.  Performance Bounds for Grouped Incoherent Measurements in Compressive Sensing , 2015, IEEE Transactions on Signal Processing.

[35]  M. Ledoux,et al.  Small deviations for beta ensembles , 2009, 0912.5040.

[36]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[37]  M. Lustig,et al.  Compressed Sensing MRI , 2008, IEEE Signal Processing Magazine.

[38]  J. Romberg,et al.  Restricted Isometries for Partial Random Circulant Matrices , 2010, arXiv.org.

[39]  Pierre Vandergheynst,et al.  Universal and efficient compressed sensing by spread spectrum and application to realistic Fourier imaging techniques , 2011, EURASIP J. Adv. Signal Process..

[40]  S. Mallat A wavelet tour of signal processing , 1998 .

[41]  Pierre Weiss,et al.  Compressed sensing with structured sparsity and structured acquisition , 2015, Applied and Computational Harmonic Analysis.

[42]  J. Hogg Magnetic resonance imaging. , 1994, Journal of the Royal Naval Medical Service.

[43]  M. Talagrand,et al.  Probability in Banach Spaces: Isoperimetry and Processes , 1991 .

[44]  Lu Gan Block Compressed Sensing of Natural Images , 2007, 2007 15th International Conference on Digital Signal Processing.

[45]  Thomas L. Szabo,et al.  Diagnostic Ultrasound Imaging: Inside Out , 2004 .

[46]  M. Rudelson,et al.  On sparse reconstruction from Fourier and Gaussian measurements , 2008 .

[47]  AdcockBen,et al.  Generalized Sampling and Infinite-Dimensional Compressed Sensing , 2016 .

[48]  Gábor Lugosi,et al.  Concentration Inequalities - A Nonasymptotic Theory of Independence , 2013, Concentration Inequalities.