On the Generalized Gaussian CEO Problem

This paper considers a distributed source coding (DSC) problem where L encoders observe noisy linear combinations of K correlated remote Gaussian sources, and separately transmit the compressed observations to the decoder to reconstruct the remote sources subject to a sum-distortion constraint. This DSC problem is referred to as the generalized Gaussian CEO problem since it can be viewed as a generalization of the quadratic Gaussian CEO problem where the number of remote source K=1. First, we provide a new outer region obtained using the entropy power inequality and an equivalent argument (in the sense of having the same rate-distortion region and Berger-Tung inner region) among a certain class of generalized Gaussian CEO problems. We then give two sufficient conditions for our new outer region to match the inner region achieved by Berger-Tung schemes, where the second matching condition implies that in the low-distortion regime, the Berger-Tung inner rate region is always tight, while in the high-distortion regime, the same region is tight if a certain condition holds. The sum-rate part of the outer region is also studied and shown to meet the Berger-Tung sum-rate upper bound under a certain condition, which is obtained using the Karush-Kuhn-Tucker conditions of the underlying convex semidefinite optimization problem, and is in general weaker than the aforesaid two for rate region tightness.

[1]  Axthonv G. Oettinger,et al.  IEEE Transactions on Information Theory , 1998 .

[2]  Gregory J. Pottie,et al.  Fidelity and Resource Sensitive Data Gathering , 2004 .

[3]  Pramod Viswanath,et al.  Rate Region of the Quadratic Gaussian Two-Terminal Source-Coding Problem , 2005, ArXiv.

[4]  Alston S. Householder,et al.  Unitary Triangularization of a Nonsymmetric Matrix , 1958, JACM.

[5]  Zixiang Xiong,et al.  The Sum-Rate Bound for a New Class of Quadratic Gaussian Multiterminal Source Coding Problems , 2009, IEEE Transactions on Information Theory.

[6]  Zixiang Xiong,et al.  On general distributed source coding of correlated Gaussian remote sources , 2010, 2010 IEEE Information Theory Workshop on Information Theory (ITW 2010, Cairo).

[7]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[8]  Yasutada Oohama Distributed Source Coding of Correlated Gaussian Remote Sources , 2012, IEEE Trans. Inf. Theory.

[9]  Toby Berger,et al.  The quadratic Gaussian CEO problem , 1997, IEEE Trans. Inf. Theory.

[10]  H. Luetkepohl The Handbook of Matrices , 1996 .

[11]  Toby Berger,et al.  The CEO problem [multiterminal source coding] , 1996, IEEE Trans. Inf. Theory.

[12]  Yasutada Oohama,et al.  Rate-distortion theory for Gaussian multiterminal source coding systems with several side informations at the decoder , 2005, IEEE Transactions on Information Theory.

[13]  Yasutada Oohama,et al.  Distributed Source Coding of Correlated Gaussian Sources , 2010, ArXiv.

[14]  Katta G. Murty,et al.  Nonlinear Programming Theory and Algorithms , 2007, Technometrics.

[15]  Giuseppe Longo,et al.  The information theory approach to communications , 1977 .

[16]  Zixiang Xiong,et al.  The generalized quadratic Gaussian CEO problem: New cases with tight rate region and applications , 2010, 2010 IEEE International Symposium on Information Theory.

[17]  Zhen Zhang,et al.  On the CEO problem , 1994, Proceedings of 1994 IEEE International Symposium on Information Theory.

[18]  Vinod M. Prabhakaran,et al.  Rate region of the quadratic Gaussian CEO problem , 2004, International Symposium onInformation Theory, 2004. ISIT 2004. Proceedings..

[19]  Pramod Viswanath,et al.  Rate Region of the Quadratic Gaussian Two-Encoder Source-Coding Problem , 2005, IEEE Transactions on Information Theory.

[20]  Mato Baotic,et al.  Multi-Parametric Toolbox (MPT) , 2004, HSCC.

[21]  Jun Chen,et al.  On the Sum Rate of Gaussian Multiterminal Source Coding: New Proofs and Results , 2010, IEEE Transactions on Information Theory.

[22]  Yasutada Oohama,et al.  The Rate-Distortion Function for the Quadratic Gaussian CEO Problem , 1998, IEEE Trans. Inf. Theory.