Duality and the Value of Cooperation in Distributive Source and Channel Coding Problems ∗

This paper investigates the condition for duality between the achievable rate regions of the indirect distributive source coding problem and the broadcast channel. It has been shown previously that crucial to the existence of duality are two simultaneous Markov conditions that the joint distribution must satisfy. In this paper, we illustrate that the Markov conditions are satisfied if and only if distributive coding achieves the same sum rate as centralized coding under the same joint distribution. Thus, duality is closely related to the value of cooperation. Duality exists if and only if cooperation does not help. Several classes of channels in which duality exists are illustrated as examples. They include a generalization of a previous result on Gaussian multi-terminal source coding and a novel discrete memoryless broadcast channel for which Marton’s achievable rate region is optimal at the sum rate point.

[1]  Pramod Viswanath Sum Rate of Multiterminal Gaussian Source Coding , 2003 .

[2]  Andrea J. Goldsmith,et al.  Duality, achievable rates, and sum-rate capacity of Gaussian MIMO broadcast channels , 2003, IEEE Trans. Inf. Theory.

[3]  David Tse,et al.  Sum capacity of the vector Gaussian broadcast channel and uplink-downlink duality , 2003, IEEE Trans. Inf. Theory.

[4]  Abbas El Gamal,et al.  On the capacity of computer memory with defects , 1983, IEEE Trans. Inf. Theory.

[5]  R. A. McDonald,et al.  Noiseless Coding of Correlated Information Sources , 1973 .

[6]  Yasutada Oohama,et al.  The Rate-Distortion Function for the Quadratic Gaussian CEO Problem , 1998, IEEE Trans. Inf. Theory.

[7]  Thomas M. Cover,et al.  Comments on Broadcast Channels , 1998, IEEE Trans. Inf. Theory.

[8]  T. Berger,et al.  The quadratic Gaussian CEO problem , 1995, Proceedings of 1995 IEEE International Symposium on Information Theory.

[9]  Kannan Ramchandran,et al.  Duality between source coding and channel coding and its extension to the side information case , 2003, IEEE Trans. Inf. Theory.

[10]  Sui Tung,et al.  Multiterminal source coding (Ph.D. Thesis abstr.) , 1978, IEEE Trans. Inf. Theory.

[11]  Wei Yu,et al.  Sum capacity of Gaussian vector broadcast channels , 2004, IEEE Transactions on Information Theory.

[12]  Toby Berger,et al.  Multiterminal Source Coding with High Resolution , 1999, IEEE Trans. Inf. Theory.

[13]  Wei Yu The Structure of Least-Favorable Noise in Gaussian Vector Broadcast Channels , 2003, Advances in Network Information Theory.

[14]  Giuseppe Longo,et al.  The information theory approach to communications , 1977 .

[15]  Y. Oohama Gaussian multiterminal source coding , 1995, Proceedings of 1995 IEEE International Symposium on Information Theory.

[16]  Mung Chiang,et al.  Duality between channel capacity and rate distortion with two-sided state information , 2002, IEEE Trans. Inf. Theory.

[17]  Zhen Zhang,et al.  On the CEO problem , 1994, Proceedings of 1994 IEEE International Symposium on Information Theory.