Two-Way Source Coding With a Helper

Consider the two-way rate-distortion problem in which a helper sends a common limited-rate message to both users based on side information at its disposal. We characterize the region of achievable rates and distortions when the Markov relation (Helper)-(User 1)-(User 2) holds. The main insight of the result is that in order to achieve the optimal rate, the helper may use a binning scheme, as in Wyner-Ziv, where the side information at the decoder is the ¿further¿ user, namely, User 2. We derive these regions explicitly for the Gaussian sources with square error distortion, analyze a tradeoff between the rate from the helper and the rate from the source, and examine a special case where the helper has the freedom to send different messages, at different rates, to the encoder and the decoder. The converse proofs use a technique for verifying Markov relations via undirected graphs.

[1]  Patrick P. Bergmans,et al.  A simple converse for broadcast channels with additive white Gaussian noise (Corresp.) , 1974, IEEE Trans. Inf. Theory.

[2]  Yossef Steinberg.  Coding for Channels with Rate-Limited Side Information at the Decoder , 2006, ITW.

[3]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[4]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[5]  Haim H. Permuter,et al.  Rate-Distortion with a Limited-Rate Helper to the Encoder and Decoder , 2008, ArXiv.

[6]  Aaron D. Wyner,et al.  On source coding with side information at the decoder , 1975, IEEE Trans. Inf. Theory.

[7]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[8]  J. Wolfowitz.  The rate distortion function for source coding with side information at the decoder , 1979 .

[9]  Yasutada Oohama,et al.  Rate-distortion theory for Gaussian multiterminal source coding systems with several side informations at the decoder , 2005, IEEE Transactions on Information Theory.

[10]  Aaron D. Wyner,et al.  A theorem on the entropy of certain binary sequences and applications-II , 1973, IEEE Trans. Inf. Theory.

[11]  Imre Csiszár,et al.  Information Theory - Coding Theorems for Discrete Memoryless Systems, Second Edition , 2011 .

[12]  Rudolf Ahlswede,et al.  Source coding with side information and a converse for degraded broadcast channels , 1975, IEEE Trans. Inf. Theory.

[13]  Neri Merhav,et al.  Two-way successively refined joint source-channel coding , 2006, IEEE Transactions on Information Theory.

[14]  Bernd Girod,et al.  Distributed Video Coding , 2005, Proceedings of the IEEE.

[15]  Etienne Perron,et al.  Cooperative Source Coding with Encoder Breakdown , 2007, 2007 IEEE International Symposium on Information Theory.

[16]  Toby Berger,et al.  Multiterminal source encoding with one distortion criterion , 1989, IEEE Trans. Inf. Theory.

[17]  Toby Berger,et al.  Rate-distortion for correlated sources with partially separated encoders , 1982, IEEE Trans. Inf. Theory.

[18]  Pramod Viswanath,et al.  Rate Region of the Quadratic Gaussian Two-Encoder Source-Coding Problem , 2005, IEEE Transactions on Information Theory.

[19]  Yossef Steinberg.  Coding for Channels With Rate-Limited Side Information at the Decoder, With Applications , 2006, IEEE Transactions on Information Theory.

[20]  Amiram H. Kaspi,et al.  Two-way source coding with a fidelity criterion , 1985, IEEE Trans. Inf. Theory.

[21]  L. Williams,et al.  Contents , 2020, Ophthalmology (Rochester, Minn.).

[22]  Gerhard Kramer.  Capacity results for the discrete memoryless network , 2003, IEEE Trans. Inf. Theory.

[23]  Yasutada Oohama.  Gaussian multiterminal source coding , 1997, IEEE Trans. Inf. Theory.

[24]  J. Pearl.  Causality: Models, Reasoning and Inference , 2000 .

[25]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.