Generalized nested sampling for compression and exact recovery of symmetric Toeplitz matrices

This paper considers the problem of estimating the symmetric and Toeplitz covariance matrix of compressive samples of wide sense stationary random vectors. A new structured deterministic sampling method known as the "Generalized Nested Sampling" is introduced which enables compressive quadratic sampling of symmetric Toeplitz matrices., by fully exploiting the inherent redundancy in the Toeplitz matrix. For a Toeplitz matrix of size N ×N, this sampling scheme can attain a compression factor of O(√N) even without assuming sparsity and/or low rank, and allows exact recovery of the original Toeplitz matrix. When the matrix is sparse, a new hybrid sampling approach is proposed which efficiently combines Generalized Nested Sampling and Random Sampling to attain even greater compression rates, which, under suitable conditions can be as large as O(√N), using a novel observation formulated in this paper.

[1]  Nikos D. Sidiropoulos,et al.  Almost-sure identifiability of multidimensional harmonic retrieval , 2001, IEEE Trans. Signal Process..

[2]  Charles R. Johnson,et al.  Topics in Matrix Analysis , 1991 .

[3]  P. P. Vaidyanathan,et al.  Nested Arrays: A Novel Approach to Array Processing With Enhanced Degrees of Freedom , 2010, IEEE Transactions on Signal Processing.

[4]  I. S. Gál On the Representation of 1, 2, . . . , N by Differences , 2004 .

[5]  Parikshit Shah,et al.  Sketching Sparse Matrices , 2013, ArXiv.

[6]  Geert Leus,et al.  Compressive covariance sampling , 2013, 2013 Information Theory and Applications Workshop (ITA).

[7]  Holger Rauhut,et al.  A Mathematical Introduction to Compressive Sensing , 2013, Applied and Numerical Harmonic Analysis.

[8]  慧 廣瀬 A Mathematical Introduction to Compressive Sensing , 2015 .

[9]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[10]  V. Mehrmann,et al.  Sparse solutions to underdetermined Kronecker product systems , 2009 .

[11]  D. Luenberger,et al.  Estimation of structured covariance matrices , 1982, Proceedings of the IEEE.

[12]  Richard G. Baraniuk,et al.  Kronecker Compressive Sensing , 2012, IEEE Transactions on Image Processing.

[13]  Holger Rauhut,et al.  An Invitation to Compressive Sensing , 2013 .

[14]  Andrea J. Goldsmith,et al.  Exact and Stable Covariance Estimation From Quadratic Sampling via Convex Programming , 2013, IEEE Transactions on Information Theory.

[15]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[16]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[17]  Brian M. Sadler,et al.  Cyclic Feature Detection With Sub-Nyquist Sampling for Wideband Spectrum Sensing , 2012, IEEE Journal of Selected Topics in Signal Processing.