Finite sample analysis of covariance compression using structured samplers

This paper considers the problem of compressively sampling wide sense stationary random vectors with low rank Toeplitz structured covariance matrix. Using the celebrated Caratheodory's theorem, Toeplitz structured covariance matrix recovery can be cast as line spectrum estimation problem. In this paper, we utilize this connection to establish theoretical guarantees under which low rank Toeplitz covariance matrices can be compressively sketched and reconstructed from a finite number of compressed samples. Using a newly proposed structured sampler, namely the Generalized Nested Sampler (GNS), we show that stable estimation of original N × N Toeplitz covariance matrix of rank r can be obtained from a compressed sketch of size O(√r) × O(√r) using an atomic norm minimization framework.

[1]  P. P. Vaidyanathan,et al.  Nested Arrays: A Novel Approach to Array Processing With Enhanced Degrees of Freedom , 2010, IEEE Transactions on Signal Processing.

[2]  U. Grenander,et al.  Toeplitz Forms And Their Applications , 1958 .

[3]  F. Bunea,et al.  On the sample covariance matrix estimator of reduced effective rank population matrices, with applications to fPCA , 2012, 1212.5321.

[4]  Emmanuel J. Candès,et al.  Towards a Mathematical Theory of Super‐resolution , 2012, ArXiv.

[5]  Yonina C. Eldar,et al.  Sub-Nyquist Sampling for Power Spectrum Sensing in Cognitive Radios: A Unified Approach , 2013, IEEE Transactions on Signal Processing.

[6]  I. S. Gál On the Representation of 1, 2, . . . , N by Differences , 2004 .

[7]  Geert Leus,et al.  Recovering second-order statistics from compressive measurements , 2011, 2011 4th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[8]  Andrea J. Goldsmith,et al.  Exact and Stable Covariance Estimation From Quadratic Sampling via Convex Programming , 2013, IEEE Transactions on Information Theory.

[9]  Huaiyu Zhu On Information and Sufficiency , 1997 .

[10]  Geert Leus,et al.  Compression Limits for Random Vectors with Linearly Parameterized Second-Order Statistics , 2013, IEEE Transactions on Information Theory.

[11]  Yuejie Chi,et al.  Off-the-Grid Line Spectrum Denoising and Estimation With Multiple Measurement Vectors , 2014, IEEE Transactions on Signal Processing.

[12]  Parikshit Shah,et al.  Compressed Sensing Off the Grid , 2012, IEEE Transactions on Information Theory.

[13]  Geert Leus,et al.  Compressive Wideband Power Spectrum Estimation , 2012, IEEE Transactions on Signal Processing.

[14]  Björn E. Ottersten,et al.  Structured covariance matrix estimation: a parametric approach , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[15]  Emmanuel J. Candès,et al.  Super-Resolution from Noisy Data , 2012, Journal of Fourier Analysis and Applications.

[16]  P. P. Vaidyanathan,et al.  Theory of Sparse Coprime Sensing in Multiple Dimensions , 2011, IEEE Transactions on Signal Processing.

[17]  Piya Pal,et al.  Gridless Line Spectrum Estimation and Low-Rank Toeplitz Matrix Compression Using Structured Samplers: A Regularization-Free Approach , 2017, IEEE Transactions on Signal Processing.

[18]  Geert Leus,et al.  Compressive covariance sampling , 2013, 2013 Information Theory and Applications Workshop (ITA).

[19]  Gongguo Tang,et al.  Near minimax line spectral estimation , 2013, 2013 47th Annual Conference on Information Sciences and Systems (CISS).

[20]  Gongguo Tang,et al.  Atomic Norm Denoising With Applications to Line Spectral Estimation , 2012, IEEE Transactions on Signal Processing.

[21]  Jian Li,et al.  Computationally efficient maximum-likelihood estimation of structured covariance matrices , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[22]  Geert Leus,et al.  Compressive Covariance Sensing: Structure-based compressive sensing beyond sparsity , 2016, IEEE Signal Processing Magazine.

[23]  Piya Pal,et al.  Generalized nested sampling for compression and exact recovery of symmetric Toeplitz matrices , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[24]  Piya Pal,et al.  Generalized Nested Sampling for Compressing Low Rank Toeplitz Matrices , 2015, IEEE Signal Processing Letters.

[25]  Phillipp Meister,et al.  Statistical Signal Processing Detection Estimation And Time Series Analysis , 2016 .