Distributed Source Coding of Correlated Gaussian Remote Sources

We consider the distributed source coding system for L correlated memoryless Gaussian remote sources specified with L correlated Gaussian random variables Xi, i=1,2,...,L. We deal with the case where each of L distributed encoders cannot directly observe the source Xi but its noisy version Yi=Xi+Ni. Here, Ni, i=1,2,..., L are independent additive L Gaussian noises also independent of Xi , i=1,2,..., L. On this coding system, the determination problem of the rate distortion region remains open in general. In this paper, we derive explicit outer and inner bounds of the rate distortion region. We further find an explicit sufficient condition for those two bounds to match. We also study the sum rate part of the rate distortion region when the correlation has some symmetrical property. We derive an explicit upper bound of the sum rate part from the inner bounds of the rate distortion region. On a lower bound, we derive a new explicit bound by making full use of the symmetrical property of the correlation. We further derive an explicit necessary and sufficient condition for the lower bound to coincide with the upper bound.

[1]  Pramod Viswanath,et al.  Rate Region of the Quadratic Gaussian Two-Terminal Source-Coding Problem , 2005, ArXiv.

[2]  Sergio Verdú,et al.  A simple proof of the entropy-power inequality , 2006, IEEE Transactions on Information Theory.

[3]  Toby Berger,et al.  Multiterminal source encoding with one distortion criterion , 1989, IEEE Trans. Inf. Theory.

[4]  Toby Berger,et al.  An upper bound on the rate distortion function for source coding with partial side information at the decoder , 1979, IEEE Trans. Inf. Theory.

[5]  Yasutada Oohama Distributed Source Coding of Correlated Gaussian Remote Sources , 2012, IEEE Trans. Inf. Theory.

[6]  Yasutada Oohama Gaussian multiterminal source coding , 1997, IEEE Trans. Inf. Theory.

[7]  Robert M. Gray,et al.  Encoding of correlated observations , 1987, IEEE Trans. Inf. Theory.

[8]  Zhen Zhang,et al.  On the CEO problem , 1994, Proceedings of 1994 IEEE International Symposium on Information Theory.

[9]  Toby Berger,et al.  Rate-distortion for correlated sources with partially separated encoders , 1982, IEEE Trans. Inf. Theory.

[10]  Y. Oohama Distributed source coding of correlated Gaussian observations , 2008, 2008 International Symposium on Information Theory and Its Applications.

[11]  Yasutada Oohama,et al.  The Rate-Distortion Function for the Quadratic Gaussian CEO Problem , 1998, IEEE Trans. Inf. Theory.

[12]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[13]  Yasutada Oohama,et al.  Rate-distortion theory for Gaussian multiterminal source coding systems with several side informations at the decoder , 2005, IEEE Transactions on Information Theory.

[14]  Thomas M. Cover,et al.  A Proof of the Data Compression Theorem of Slepian and Wolf for Ergodic Sources , 1971 .

[15]  Hirosuke Yamamoto,et al.  Wyner-Ziv theory for a general function of the correlated sources , 1982, IEEE Trans. Inf. Theory.

[16]  Zixiang Xiong,et al.  The generalized quadratic Gaussian CEO problem: New cases with tight rate region and applications , 2010, 2010 IEEE International Symposium on Information Theory.

[17]  Yasutada Oohama On the rate distortion region of Gaussian multiterminal source coding , 2010, 2010 International Symposium On Information Theory & Its Applications.

[18]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[19]  Jun Chen,et al.  On the vector Gaussian CEO problem , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[20]  Jun Chen,et al.  On the minimum sum rate of Gaussian multiterminal source coding: New proofs , 2009, 2009 IEEE International Symposium on Information Theory.

[21]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[22]  Amir Dembo,et al.  Bounds on the extreme eigenvalues of positive-definite Toeplitz matrices , 1988, IEEE Trans. Inf. Theory.

[23]  Gregory J. Pottie,et al.  Fidelity and Resource Sensitive Data Gathering , 2004 .

[24]  Yasutada Oohama Distributed source coding of correlated memoryless Gaussian observations , 2010, 2010 IEEE International Symposium on Information Theory.

[25]  Toby Berger,et al.  The quadratic Gaussian CEO problem , 1997, IEEE Trans. Inf. Theory.

[26]  Pramod Viswanath,et al.  Rate Region of the Quadratic Gaussian Two-Encoder Source-Coding Problem , 2005, IEEE Transactions on Information Theory.

[27]  Yasutada Oohama,et al.  Separate Source Coding of Correlated Gaussian Remote Sources , 2006 .

[28]  Hirosuke Yamamoto,et al.  Source Coding Theory for Multiterminal Communication Systems with a Remote Source , 1980 .