Distributed Compression of Linear Functions: Partial Sum-Rate Tightness and Gap to Optimal Sum-Rate

We consider the problem of distributed compression of the difference Z = Y1 - cY2 of two jointly Gaussian sources Y1 and Y2 under an MSE distortion constraint D on Z. The rate region for this problem is unknown if the correlation coefficient ρ and the weighting factor c satisfy cρ > 0. Inspired by Ahlswede and Han's scheme for the problem of distributed compression of the modulo-2 sum of two binary sources, we first propose a hybrid random-structured coding scheme that is capable of saving the sum-rate over both the random quantize-and-bin (QB) coding scheme and Krithivasan and Pradhan's structured lattice coding scheme. The main idea is to use a random coding component in the first layer to adjust the source correlation so that the structured coding component in the second layer can be more efficient with the outputs from the first layer as decoder side information. We then provide a new sum-rate lower bound for the problem in hand by connecting it to the Gaussian two-terminal source coding problem with covariance matrix distortion constraint. Our lower bound not only improves existing bounds in many cases, but also allows us to prove sum-rate tightness of the QB scheme when c is either relatively small or large and D is larger than some threshold. Furthermore, our lower bound enables us to show that our new hybrid scheme performs within two b/s from the optimal sum-rate for all values of ρ, c, and D.

[1]  Pramod Viswanath,et al.  Rate Region of the Quadratic Gaussian Two-Encoder Source-Coding Problem , 2005, IEEE Transactions on Information Theory.

[2]  Toby Berger,et al.  The quadratic Gaussian CEO problem , 1997, IEEE Trans. Inf. Theory.

[3]  Jun Chen,et al.  On the Sum Rate of Gaussian Multiterminal Source Coding: New Proofs and Results , 2010, IEEE Transactions on Information Theory.

[4]  Zixiang Xiong,et al.  Distributed compression of linear functions: Partial sum-rate tightness and gap to optimal sum-rate , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[5]  Zixiang Xiong,et al.  On the Generalized Gaussian CEO Problem , 2012, IEEE Transactions on Information Theory.

[6]  Zixiang Xiong,et al.  A New Sufficient Condition for Sum-Rate Tightness in Quadratic Gaussian Multiterminal Source Coding , 2013, IEEE Transactions on Information Theory.

[7]  Rudolf Ahlswede,et al.  On source coding with side information via a multiple-access channel and related problems in multi-user information theory , 1983, IEEE Trans. Inf. Theory.

[8]  Yasutada Oohama Gaussian multiterminal source coding , 1997, IEEE Trans. Inf. Theory.

[9]  Zixiang Xiong,et al.  An improved lattice-based scheme for lossy distributed compression of linear functions , 2011, 2011 Information Theory and Applications Workshop.

[10]  Uri Erez,et al.  Achieving 1/2 log (1+SNR) on the AWGN channel with lattice encoding and decoding , 2004, IEEE Transactions on Information Theory.

[11]  Meir Feder,et al.  On lattice quantization noise , 1996, IEEE Trans. Inf. Theory.

[12]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[13]  S. Sandeep Pradhan,et al.  Lattices for Distributed Source Coding: Jointly Gaussian Sources and Reconstruction of a Linear Function , 2007, IEEE Transactions on Information Theory.

[14]  Vinod M. Prabhakaran,et al.  Rate region of the quadratic Gaussian CEO problem , 2004, International Symposium onInformation Theory, 2004. ISIT 2004. Proceedings..

[15]  János Körner,et al.  How to encode the modulo-two sum of binary sources (Corresp.) , 1979, IEEE Trans. Inf. Theory.

[16]  Aaron B. Wagner On Distributed Compression of Linear Functions , 2011, IEEE Transactions on Information Theory.

[17]  Shlomo Shamai,et al.  Nested linear/Lattice codes for structured multiterminal binning , 2002, IEEE Trans. Inf. Theory.

[18]  Jun Chen,et al.  On the vector Gaussian CEO problem , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[19]  S. Sandeep Pradhan,et al.  Distributed Source Coding Using Abelian Group Codes: A New Achievable Rate-Distortion Region , 2011, IEEE Transactions on Information Theory.

[20]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[21]  David Tse,et al.  Interference neutralization in distributed lossy source coding , 2010, 2010 IEEE International Symposium on Information Theory.

[22]  Yasutada Oohama,et al.  Rate-distortion theory for Gaussian multiterminal source coding systems with several side informations at the decoder , 2005, IEEE Transactions on Information Theory.