The Three-Terminal Interactive Lossy Source Coding Problem

In this paper, we explore the three-node multi-terminal lossy source coding problem, which seems to offer a formidable mathematical complexity. We derive an inner bound to the general rate-distortion region of this problem, which is a natural extension of the seminal work by Kaspi on the interactive two-terminal source coding problem. It is shown that this (rather involved) inner bound contains several rate-distortion regions of some relevant source coding settings. In this way, besides the non-trivial extension of the interactive two terminal problem, our results can be seen as a generalization and hence unification of several previous works in the field. By specializing the inner bound to particular cases, we obtain some novel rate-distortion regions for several multi-terminal lossy source coding problems.

[1]  Toby Berger,et al.  Rate-distortion for correlated sources with partially separated encoders , 1982, IEEE Trans. Inf. Theory.

[2]  Thomas M. Cover,et al.  Elements of information theory (2. ed.) , 2006 .

[3]  Aaron D. Wyner,et al.  The common information of two dependent random variables , 1975, IEEE Trans. Inf. Theory.

[4]  Gou Hosoya,et al.  国際会議参加報告:2014 IEEE International Symposium on Information Theory , 2014 .

[5]  Amiram H. Kaspi,et al.  Two-way source coding with a fidelity criterion , 1985, IEEE Trans. Inf. Theory.

[6]  Alex J. Grant,et al.  Lossy Broadcasting With Complementary Side Information , 2013, IEEE Transactions on Information Theory.

[7]  Abbas El Gamal,et al.  Network Information Theory , 2021, 2021 IEEE 3rd International Conference on Advanced Trends in Information Theory (ATIT).

[8]  Toby Berger,et al.  Rate distortion when side information may be absent , 1985, IEEE Trans. Inf. Theory.

[9]  Pramod Viswanath,et al.  Rate Region of the Quadratic Gaussian Two-Encoder Source-Coding Problem , 2005, IEEE Transactions on Information Theory.

[10]  Michael Gastpar,et al.  The Wyner-Ziv problem with multiple sources , 2004, IEEE Transactions on Information Theory.

[11]  H. Vincent Poor,et al.  Distributed estimation in multi-agent networks , 2012, 2012 IEEE International Symposium on Information Theory Proceedings.

[12]  Alfred O. Hero,et al.  A proof of the Generalized Markov Lemma with countable infinite sources , 2014, 2014 IEEE International Symposium on Information Theory.

[13]  Prakash Ishwar,et al.  Some Results on Distributed Source Coding for Interactive Function Computation , 2011, IEEE Transactions on Information Theory.

[14]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[15]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[16]  Toby Berger,et al.  Multiterminal source encoding with one distortion criterion , 1989, IEEE Trans. Inf. Theory.

[17]  Piyush Gupta,et al.  Interactive Source Coding for Function Computation in Collocated Networks , 2012, IEEE Transactions on Information Theory.

[18]  W. Uhlmann.  Vergleich der hypergeometrischen mit der Binomial-Verteilung , 1966 .

[19]  Yasutada Oohama,et al.  The Rate-Distortion Function for the Quadratic Gaussian CEO Problem , 1998, IEEE Trans. Inf. Theory.

[20]  Thomas M. Cover,et al.  Network Information Theory , 2001 .

[21]  Imre Csiszár,et al.  Information Theory - Coding Theorems for Discrete Memoryless Systems, Second Edition , 2011 .

[22]  Pramod Viswanath,et al.  Rate Region of the Quadratic Gaussian Two-Encoder Source-Coding Problem , 2006, ISIT.

[23]  Jie Chen,et al.  Diffusion LMS Over Multitask Networks , 2014, IEEE Transactions on Signal Processing.

[24]  Haim H. Permuter,et al.  Two-Way Source Coding With a Helper , 2008, IEEE Transactions on Information Theory.

[25]  Alex J. Grant,et al.  Rate Distortion With Side-Information at Many Decoders , 2009, IEEE Transactions on Information Theory.

[26]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[27]  J. Wolfowitz.  The rate distortion function for source coding with side information at the decoder , 1979 .

[28]  Toby Berger,et al.  The CEO problem [multiterminal source coding] , 1996, IEEE Trans. Inf. Theory.

[29]  Aaron B. Wagner,et al.  Distributed Rate-Distortion With Common Components , 2011, IEEE Transactions on Information Theory.

[30]  Prakash Ishwar,et al.  Interaction strictly improves the Wyner-Ziv rate-distortion function , 2010, 2010 IEEE International Symposium on Information Theory.