The Restricted Isometry Property for block diagonal matrices

In compressive sensing (CS), the Restricted Isometry Property (RIP) is a powerful condition on measurement operators which ensures robust recovery of sparse vectors is possible from noisy, undersampled measurements via computationally tractable algorithms. Early papers in CS showed that Gaussian random matrices satisfy the RIP with high probability, but such matrices are usually undesirable in practical applications due to storage limitations, computational considerations, or the mismatch of such matrices with certain measurement architectures. To alleviate some or all of these difficulties, recent research efforts have focused on structured random matrices. In this paper, we study block diagonal measurement matrices where each block on the main diagonal is itself a Gaussian random matrix. The main result of this paper shows that such matrices can indeed satisfy the RIP but that the requisite number of measurements depends on the coherence of the basis in which the signals are sparse. In the best case—for signals that are sparse in the frequency domain—these matrices perform nearly as well as dense Gaussian random matrices despite having many fewer nonzero entries.

[1]  E.J. Candes Compressive Sampling , 2022 .

[2]  Ronald A. DeVore,et al.  Deterministic constructions of compressed sensing matrices , 2007, J. Complex..

[3]  M. Rudelson,et al.  On sparse reconstruction from Fourier and Gaussian measurements , 2008 .

[4]  W. Bajwa,et al.  A restricted isometry property for structurally-subsampled unitary matrices , 2009, 2009 47th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[5]  H. Rauhut Compressive Sensing and Structured Random Matrices , 2009 .

[6]  Michael B. Wakin,et al.  Concentration of measure for block diagonal matrices with repeated blocks , 2010, 2010 44th Annual Conference on Information Sciences and Systems (CISS).

[7]  Richard G. Baraniuk,et al.  Signal Processing With Compressive Measurements , 2010, IEEE Journal of Selected Topics in Signal Processing.

[8]  Michael B. Wakin,et al.  Concentration of measure for block diagonal measurement matrices , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[9]  Massimo Fornasier,et al.  Compressive Sensing and Structured Random Matrices , 2010 .

[10]  M. Wakin,et al.  Concentration of Measure for Block Diagonal Matrices with Applications to Compressive Sensing , 2010 .

[11]  Massimo Fornasier,et al.  Theoretical Foundations and Numerical Methods for Sparse Recovery , 2010, Radon Series on Computational and Applied Mathematics.

[12]  Justin K. Romberg,et al.  Beyond Nyquist: Efficient Sampling of Sparse Bandlimited Signals , 2009, IEEE Transactions on Information Theory.

[13]  Robert D. Nowak,et al.  Toeplitz Compressed Sensing Matrices With Applications to Sparse Channel Estimation , 2010, IEEE Transactions on Information Theory.

[14]  Rachel Ward,et al.  New and Improved Johnson-Lindenstrauss Embeddings via the Restricted Isometry Property , 2010, SIAM J. Math. Anal..

[15]  Michael B. Wakin,et al.  Stable manifold embeddings with operators satisfying the Restricted Isometry Property , 2011, 2011 45th Annual Conference on Information Sciences and Systems.

[16]  Michael B. Wakin,et al.  Concentration of Measure for Block Diagonal Matrices With Applications to Compressive Signal Processing , 2011, IEEE Transactions on Signal Processing.

[17]  Roman Vershynin,et al.  Introduction to the non-asymptotic analysis of random matrices , 2010, Compressed Sensing.

[18]  Holger Rauhut,et al.  Compressive Sensing with structured random matrices , 2012 .

[19]  J. Romberg,et al.  Restricted Isometries for Partial Random Circulant Matrices , 2010, arXiv.org.