On Side-Informed Coding of Noisy Sensor Observations

In this paper, we consider the problem of side-informed coding in applications where the data available at the encoder consists of indirect noisy observations of the signal desired at the decoder. In these scenarios, under Gaussian statistics we show that for a mean-squared distortion metric, the side-informed encoding problem can be decomposed into a "side-informed" minimum mean-squared error (MMSE) estimation followed by side-informed coding of the MMSE estimate, without incurring any rate-distortion penally. By recursively exploiting this decomposition, we develop a sequential framework for side-informed coding in multi-sensor networks, where each sensor observes linear noise-corrupted measurements. We construct a practical realization of this encoder using a Karhunen-Loeve transform with 1 -D scalar coset codes. Simulations demonstrate that simple code constructions based on the estimate-then-code partitioned structure provide improvements over their counterparts that perform the encoding directly without a pre-processing estimation step.

[1]  Shlomo Shamai,et al.  Nested linear/Lattice codes for structured multiterminal binning , 2002, IEEE Trans. Inf. Theory.

[2]  David J. Sakrison,et al.  Source encoding in the presence of random disturbance (Corresp.) , 1967, IEEE Trans. Inf. Theory.

[3]  T. Berger,et al.  The quadratic Gaussian CEO problem , 1995, Proceedings of 1995 IEEE International Symposium on Information Theory.

[4]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[5]  Yasutada Oohama,et al.  The Rate-Distortion Function for the Quadratic Gaussian CEO Problem , 1998, IEEE Trans. Inf. Theory.

[6]  Vivek K. Goyal,et al.  Theoretical foundations of transform coding , 2001, IEEE Signal Process. Mag..

[7]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[8]  K. Ramchandran,et al.  Distributed source coding using syndromes (DISCUS): design and construction , 1999, Proceedings DCC'99 Data Compression Conference (Cat. No. PR00096).

[9]  Simon Haykin,et al.  Adaptive Filter Theory 4th Edition , 2002 .

[10]  Anna Scaglione,et al.  Precoding and Decoding Paradigms for Distributed Vector Data Compression , 2007, IEEE Transactions on Signal Processing.

[11]  Zixiang Xiong,et al.  Distributed source coding for sensor networks , 2004, IEEE Signal Processing Magazine.