Rate-distortion trade-offs in acquisition of signal parameters

We consider problems where one wishes to represent a parameter associated with a signal source - subject to a certain rate and distortion - based on the observation of a number of realizations of the source signal. By reducing these indirect vector quantization problems to a standard vector quantization one, we provide a bound to the fundamental interplay between the rate and distortion in the large-rate setting. We specialize this characterization to two particular quantization scenarios: i) the representation of the mean of a multivariate Gaussian source; and ii) the representation of the eigen-spectrum of a multivariate Gaussian source. Numerical results compare our quantization approach to an approach where one recovers the parameters from the representation of the source signals itself: in addition to revealing that the characterization is sharp in the large-rate setting, the results also show that our approach offers considerable gains.

[1]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[2]  Yonina C. Eldar,et al.  Sub-Nyquist Sampling for Power Spectrum Sensing in Cognitive Radios: A Unified Approach , 2013, IEEE Transactions on Signal Processing.

[3]  Yonina C. Eldar,et al.  From Theory to Practice: Sub-Nyquist Sampling of Sparse Wideband Analog Signals , 2009, IEEE Journal of Selected Topics in Signal Processing.

[4]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[5]  Yonina C. Eldar,et al.  Sub-Nyquist Sampling: Bridging Theory and Practice , 2011, ArXiv.

[6]  Robert M. Gray,et al.  A unified approach for encoding clean and noisy sources by means of waveform and autoregressive model vector quantization , 1988, IEEE Trans. Inf. Theory.

[7]  David J. Sakrison,et al.  Source encoding in the presence of random disturbance (Corresp.) , 1967, IEEE Trans. Inf. Theory.

[8]  Yonina C. Eldar,et al.  Distortion Rate Function of Sub-Nyquist Sampled Gaussian Sources , 2016, IEEE Trans. Inf. Theory.

[9]  R. DeVore,et al.  A Simple Proof of the Restricted Isometry Property for Random Matrices , 2008 .

[10]  Jack K. Wolf,et al.  Transmission of noisy information to a noisy receiver with minimum distortion , 1970, IEEE Trans. Inf. Theory.

[11]  Olgica Milenkovic,et al.  Quantized Compressive Sensing , 2009, 0901.0749.

[12]  T. Blumensath,et al.  Theory and Applications , 2011 .

[13]  Yonina C. Eldar,et al.  Sub-Nyquist Cyclostationary Detection for Cognitive Radio , 2016, IEEE Transactions on Signal Processing.

[14]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[15]  Yonina C. Eldar,et al.  Sub-Nyquist Sampling , 2011, IEEE Signal Processing Magazine.

[16]  Robert M. Gray,et al.  Asymptotic Performance of Vector Quantizers with a Perceptual Distortion Measure , 1997, IEEE Trans. Inf. Theory.

[17]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[18]  Yonina C. Eldar,et al.  CaSCADE: Compressed Carrier and DOA Estimation , 2016, IEEE Transactions on Signal Processing.

[19]  Geert Leus,et al.  Compressive Covariance Sensing: Structure-based compressive sensing beyond sparsity , 2016, IEEE Signal Processing Magazine.

[20]  Yonina C. Eldar Sampling Theory: Beyond Bandlimited Systems , 2015 .