Performance of the Delsarte-Goethals Frame on Clustered Sparse Vectors

The Delsarte-Goethals frame (DGF) has been proposed for deterministic compressive sensing of sparse and compressible signals. Results in compressive sensing theory show that the DGF enables successful recovery of an overwhelming majority of sufficiently sparse signals. However, these results do not give a characterization of the sparse vectors for which the recovery procedure fails. In this paper, we present a formal analysis of the DGF that highlights the presence of clustered sparse vectors within its null space. This in turn implies that sparse recovery performance is diminished for sparse vectors that have their nonzero entries clustered together. Such clustered structure is present in compressive imaging applications, where commonly-used raster scannings of 2-D discrete wavelet transform representations yield clustered sparse representations for natural images. Prior work leverages this structure by proposing specially tailored sparse recovery algorithms that partition the recovery of the input vector into known clustered and unclustered portions. Alternatively, we propose new randomized and deterministic raster scannings for clustered coefficient vectors that improve recovery performance. Experimental results verify the aforementioned analysis and confirm the predicted improvements for both noiseless and noisy measurement regimes.

[1]  Ting Sun,et al.  Single-pixel imaging via compressive sampling , 2008, IEEE Signal Process. Mag..

[2]  A. Robert Calderbank,et al.  Why Gabor frames? Two fundamental measures of coherence and their role in model selection , 2010, Journal of Communications and Networks.

[3]  Laurent Jacques,et al.  CMOS compressed imaging by Random Convolution , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[4]  David V. Anderson,et al.  Compressive Sensing on a CMOS Separable-Transform Image Sensor , 2010, Proceedings of the IEEE.

[5]  Trac D. Tran,et al.  Fast and Efficient Compressive Sensing Using Structurally Random Matrices , 2011, IEEE Transactions on Signal Processing.

[6]  Volkan Cevher,et al.  Model-Based Compressive Sensing , 2008, IEEE Transactions on Information Theory.

[7]  Prasun Mahanti,et al.  Efficient Deterministic Compressed Sensing for Images with Chirps and Reed-Muller Codes , 2011, SIAM J. Imaging Sci..

[8]  Prasun Mahanti,et al.  Stability of Efficient Deterministic Compressed Sensing for Images with Chirps and Reed-Muller Sequences , 2013 .

[9]  Mike E. Davies,et al.  Iterative Hard Thresholding for Compressed Sensing , 2008, ArXiv.

[10]  E. Candes,et al.  11-magic : Recovery of sparse signals via convex programming , 2005 .

[11]  Yonina C. Eldar,et al.  Structured Compressed Sensing: From Theory to Applications , 2011, IEEE Transactions on Signal Processing.

[12]  A. Robert Calderbank,et al.  Reed Muller Sensing Matrices and the LASSO , 2010, ArXiv.

[13]  Waheed U. Bajwa,et al.  Multiuser detection in asynchronous on-off random access channels using lasso , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[14]  Sina Jafarpour,et al.  NEW WAVELET COEFFICIENT RASTER SCANNINGS FOR COMPRESSIVE IMAGING , 2011 .

[15]  J. Tropp Norms of Random Submatrices and Sparse Approximation , 2008 .

[16]  Marco F. Duarte Fast Reconstruction from Random Incoherent Projections , 2005 .

[17]  Yonina C. Eldar,et al.  Robust Recovery of Signals From a Structured Union of Subspaces , 2008, IEEE Transactions on Information Theory.

[18]  Marco F. Duarte,et al.  Compressive sensing recovery of spike trains using a structured sparsity model , 2009 .

[19]  A. Robert Calderbank,et al.  The value of redundant measurement in compressed sensing , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[20]  E. Candès,et al.  Near-ideal model selection by ℓ1 minimization , 2008, 0801.0345.

[21]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[22]  J. Tropp On the conditioning of random subdictionaries , 2008 .

[23]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[24]  A. Robert Calderbank,et al.  Construction of a Large Class of Deterministic Sensing Matrices That Satisfy a Statistical Isometry Property , 2009, IEEE Journal of Selected Topics in Signal Processing.

[25]  Trac D. Tran,et al.  Fast compressive imaging using scrambled block Hadamard ensemble , 2008, 2008 16th European Signal Processing Conference.

[26]  Paul Hasler,et al.  Compressive Sensing on a CMOS Separable-Transform Image Sensor , 2010, Proc. IEEE.

[27]  E.J. Candes Compressive Sampling , 2022 .

[28]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..