Concentration of measure for block diagonal matrices with repeated blocks

The theoretical analysis of randomized compressive operators often relies on the existence of a concentration of measure inequality for the operator of interest. Though commonly studied for unstructured, dense matrices, matrices with more structure are often of interest because they model constraints on the sensing system or allow more efficient system implementations. In this paper we derive a concentration of measure bound for block diagonal matrices where the nonzero entries along the main diagonal are a single repeated block of i.i.d. Gaussian random variables. Our main result states that the concentration exponent, in the best case, scales as that for a fully dense matrix. We also identify the role that the signal diversity plays in distinguishing the best and worst cases. Finally, we illustrate these phenomena with a series of experiments.

[1]  R. Vershynin ON LARGE RANDOM ALMOST EUCLIDEAN BASES , 2000 .

[2]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[3]  M. Ledoux The concentration of measure phenomenon , 2001 .

[4]  V. V. Buldygin,et al.  Sub-Gaussian random variables , 1980 .

[5]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[6]  Justin Romberg,et al.  A uniform uncertainty principle for Gaussian circulant matrices , 2009, 2009 16th International Conference on Digital Signal Processing.

[7]  Michael B. Wakin,et al.  Concentration of measure for block diagonal measurement matrices , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[8]  Robert D. Nowak,et al.  Toeplitz Compressed Sensing Matrices With Applications to Sparse Channel Estimation , 2010, IEEE Transactions on Information Theory.

[9]  R. DeVore,et al.  Instance-optimality in probability with an ℓ1-minimization decoder , 2009 .

[10]  E.J. Candes Compressive Sampling , 2022 .

[11]  R. DeVore,et al.  A Simple Proof of the Restricted Isometry Property for Random Matrices , 2008 .

[12]  Piotr Indyk,et al.  Approximate nearest neighbors: towards removing the curse of dimensionality , 1998, STOC '98.