Lossy communication of correlated sources over multiple access channels

A new approach to joint source-channel coding is presented in the context of communicating correlated sources over multiple access channels. Similar to the separation architecture, the joint source-channel coding system architecture in this approach is modular, whereby the source encoding and channel decoding operations are decoupled. However, unlike the separation architecture, the same codeword is used for both source coding and channel coding, which allows the resulting coding scheme to achieve the performance of the best known schemes despite its simplicity. In particular, it recovers as special cases previous results on lossless communication of correlated sources over multiple access channels by Cover, El Gamal, and Salehi, distributed lossy source coding by Berger and Tung, and lossy communication of the bivariate Gaussian source over the Gaussian multiple access channel by Lapidoth and Tinguely. The proof of achievability involves a new technique for analyzing the probability of decoding error when the message index depends on the codebook itself. Applications of the new joint source-channel coding system architecture in other settings are also discussed.

[1]  Masoud Salehi,et al.  Multiple access channels with arbitrarily correlated sources , 1980, IEEE Trans. Inf. Theory.

[2]  Suhas N. Diggavi,et al.  The achievable distortion region of bivariate Gaussian source on Gaussian broadcast channel , 2010, 2010 IEEE International Symposium on Information Theory.

[3]  Aaron B. Wagner,et al.  Distributed Rate-Distortion With Common Components , 2011, IEEE Transactions on Information Theory.

[4]  C. Shannon Coding Theorems for a Discrete Source With a Fidelity Criterion-Claude , 2009 .

[5]  Robert M. Gray,et al.  Source coding for a simple network , 1974 .

[6]  Giuseppe Longo,et al.  The information theory approach to communications , 1977 .

[7]  Te Sun Han,et al.  A new achievable rate region for the interference channel , 1981, IEEE Trans. Inf. Theory.

[8]  H. Witsenhausen ON SEQUENCES OF PAIRS OF DEPENDENT RANDOM VARIABLES , 1975 .

[9]  Katalin Marton,et al.  A coding theorem for the discrete memoryless broadcast channel , 1979, IEEE Trans. Inf. Theory.

[10]  Toby Berger,et al.  Rate-distortion for correlated sources with partially separated encoders , 1982, IEEE Trans. Inf. Theory.

[11]  D. Slepian,et al.  A coding theorem for multiple access channels with correlated sources , 1973 .

[12]  Aaron D. Wyner,et al.  Coding Theorems for a Discrete Source With a Fidelity CriterionInstitute of Radio Engineers, International Convention Record, vol. 7, 1959. , 1993 .

[13]  Abbas El Gamal,et al.  Lecture Notes on Network Information Theory , 2010, ArXiv.

[14]  Amos Lapidoth,et al.  Sending a bivariate Gaussian over a Gaussian MAC , 2010, IEEE Trans. Inf. Theory.

[15]  Sui Tung,et al.  Multiterminal source coding (Ph.D. Thesis abstr.) , 1978, IEEE Trans. Inf. Theory.