Joint Source-Channel Vector Quantization for Compressed Sensing

We study joint source-channel coding (JSCC) of compressed sensing (CS) measurements using vector quantizer (VQ). We develop a framework for realizing optimum JSCC schemes that enable encoding and transmitting CS measurements of a sparse source over discrete memoryless channels, and decoding the sparse source signal. For this purpose, the optimal design of encoder-decoder pair of a VQ is considered, where the optimality is addressed by minimizing end-to-end mean square error (MSE). We derive a theoretical lower bound on the MSE performance and propose a practical encoder-decoder design through an iterative algorithm. The resulting coding scheme is referred to as channel-optimized VQ for CS, coined COVQ-CS. In order to address the encoding complexity issue of the COVQ-CS, we propose to use a structured quantizer, namely low-complexity multistage VQ (MSVQ). We derive new encoding and decoding conditions for the MSVQ and then propose a practical encoder-decoder design algorithm referred to as channel-optimized MSVQ for CS, coined COMSVQ-CS. Through simulation studies, we compare the proposed schemes vis-à-vis relevant quantizers.

[1]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[2]  Georgios B. Giannakis,et al.  Optimal transmitter eigen-beamforming and space-time block coding based on channel correlations , 2003, IEEE Transactions on Information Theory.

[3]  Aleksandar Dogandzic,et al.  Sparse Signal Reconstruction via ECME Hard Thresholding , 2012, IEEE Transactions on Signal Processing.

[4]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[5]  Michael Elad,et al.  A Plurality of Sparse Representations Is Better Than the Sparsest One Alone , 2009, IEEE Transactions on Information Theory.

[6]  Lawrence Carin,et al.  Bayesian Compressive Sensing , 2008, IEEE Transactions on Signal Processing.

[7]  Laurent Jacques,et al.  Dequantizing Compressed Sensing: When Oversampling and Non-Gaussian Constraints Combine , 2009, IEEE Transactions on Information Theory.

[8]  Vivek K. Goyal,et al.  Optimal quantization of random measurements in compressed sensing , 2009, 2009 IEEE International Symposium on Information Theory.

[9]  Ming Yan,et al.  Robust 1-bit Compressive Sensing Using Adaptive Outlier Pursuit , 2012, IEEE Transactions on Signal Processing.

[10]  Georgios B. Giannakis,et al.  Optimal transmitter eigen-beamforming and space-time block coding based on channel correlations , 2002, 2002 IEEE International Conference on Communications. Conference Proceedings. ICC 2002 (Cat. No.02CH37333).

[11]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[12]  Thomas M. Cover,et al.  Elements of information theory (2. ed.) , 2006 .

[13]  Richard G. Baraniuk,et al.  Regime Change: Bit-Depth Versus Measurement-Rate in Compressive Sensing , 2011, IEEE Transactions on Signal Processing.

[14]  Nariman Farvardin,et al.  On the performance and complexity of channel-optimized vector quantizers , 1991, IEEE Trans. Inf. Theory.

[15]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[16]  Mikael Skoglund,et al.  Performance bounds for vector quantized compressive sensing , 2012, 2012 International Symposium on Information Theory and its Applications.

[17]  Erik G. Larsson,et al.  Linear Regression With a Sparse Parameter Vector , 2007, IEEE Transactions on Signal Processing.

[18]  Olgica Milenkovic,et al.  Information Theoretical and Algorithmic Approaches to Quantized Compressive Sensing , 2011, IEEE Transactions on Communications.

[19]  Mikael Skoglund,et al.  Analysis-by-Synthesis Quantization for Compressed Sensing Measurements , 2013, IEEE Transactions on Signal Processing.

[20]  Richard G. Baraniuk,et al.  Democracy in Action: Quantization, Saturation, and Compressive Sensing , 2011 .

[21]  Martin Vetterli,et al.  Rate Distortion Behavior of Sparse Sources , 2012, IEEE Transactions on Information Theory.

[22]  Rayan Saab,et al.  Sigma delta quantization for compressed sensing , 2010, 2010 44th Annual Conference on Information Sciences and Systems (CISS).

[23]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[24]  Sundeep Rangan,et al.  Message-Passing De-Quantization With Applications to Compressed Sensing , 2012, IEEE Transactions on Signal Processing.

[25]  Mikael Skoglund,et al.  Channel-optimized vector quantizer design for compressed sensing measurements , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[26]  Stephen P. Boyd,et al.  Compressed Sensing With Quantized Measurements , 2010, IEEE Signal Processing Letters.

[27]  Laurent Jacques,et al.  Robust 1-Bit Compressive Sensing via Binary Stable Embeddings of Sparse Vectors , 2011, IEEE Transactions on Information Theory.

[28]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[29]  Sundeep Rangan,et al.  Optimal quantization for compressive sensing under message passing reconstruction , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[30]  Yaniv Plan,et al.  Robust 1-bit Compressed Sensing and Sparse Logistic Regression: A Convex Programming Approach , 2012, IEEE Transactions on Information Theory.

[31]  V.K. Goyal,et al.  Compressive Sampling and Lossy Compression , 2008, IEEE Signal Processing Magazine.

[32]  Richard G. Baraniuk,et al.  1-Bit compressive sensing , 2008, 2008 42nd Annual Conference on Information Sciences and Systems.

[33]  Michael Elad,et al.  On MAP and MMSE estimators for the co-sparse analysis model , 2014, Digit. Signal Process..

[34]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[35]  Michael Elad,et al.  Closed-Form MMSE Estimation for Signal Denoising Under Sparse Representation Modeling Over a Unitary Dictionary , 2010, IEEE Transactions on Signal Processing.

[36]  Saburo Tazaki,et al.  Asymptotic performance of block quantizers with difference distortion measures , 1980, IEEE Trans. Inf. Theory.

[37]  Xiaoming Huo,et al.  Uncertainty principles and ideal atomic decomposition , 2001, IEEE Trans. Inf. Theory.

[38]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[39]  Ruby J Pai Nonadaptive lossy encoding of sparse signals , 2006 .

[40]  Nariman Farvardin,et al.  A study of vector quantization for noisy channels , 1990, IEEE Trans. Inf. Theory.

[41]  Nam C. Phamdo,et al.  A unified approach to tree-structured and multistage vector quantization for noisy channels , 1993, IEEE Trans. Inf. Theory.