Lossy compression of distributed sparse sources: A practical scheme

A new lossy compression scheme for distributed and sparse sources under a low complexity encoding constraint is proposed. This architecture is able to exploit both intra- and inter-signal correlations typical of signals monitored, for example, by a wireless sensor network. In order to meet the low complexity constraint, the encoding stage is performed by a lossy distributed compressed sensing (CS) algorithm. The novelty of the scheme consists in the combination of lossy distributed source coding (DSC) and CS. More precisely, we propose a joint CS reconstruction filter, which exploits the knowledge of the side information to improve the quality of both the dequantization and the CS reconstruction steps. The joint use of CS and DSC allows to achieve large bit-rate savings for the same quality with respect to the non-distributed CS scheme, e.g. up to 1.2 bps in the cases considered in this paper. Compared to the DSC scheme (without CS), we observe a gain increasing with the rate for the same mean square error.

[1]  Martin Vetterli,et al.  Rate Distortion Behavior of Sparse Sources , 2012, IEEE Transactions on Information Theory.

[2]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[3]  Zixiang Xiong,et al.  Distributed source coding for sensor networks , 2004, IEEE Signal Processing Magazine.

[4]  Kannan Ramchandran,et al.  Distributed source coding using syndromes (DISCUS): design and construction , 2003, IEEE Trans. Inf. Theory.

[5]  Michel Kieffer,et al.  Practical distributed source coding with impulse-noise degraded side information at the decoder , 2008, 2008 16th European Signal Processing Conference.

[6]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[7]  Bernd Girod,et al.  Rate-adaptive codes for distributed source coding , 2006, Signal Process..

[8]  Richard G. Baraniuk,et al.  Distributed Compressive Sensing , 2009, ArXiv.

[9]  Zixiang Xiong,et al.  Compression of binary sources with side information at the decoder using LDPC codes , 2002, IEEE Communications Letters.

[10]  Sundeep Rangan,et al.  On the Rate-Distortion Performance of Compressed Sensing , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[11]  Samuel Cheng,et al.  Sparse signal recovery with side information , 2009, 2009 17th European Signal Processing Conference.

[12]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[13]  V.K. Goyal,et al.  Compressive Sampling and Lossy Compression , 2008, IEEE Signal Processing Magazine.

[14]  R. A. McDonald,et al.  Noiseless Coding of Correlated Information Sources , 1973 .