On the quadratic AWGN CEO problem and non-gaussian sources

In the CEO problem, introduced by Berger et al, IEEE Trans. Info. Theory, 1996, a CEO is interested in a source that cannot be observed directly. M agents observe independently noisy versions of the source and, without collaborating, must encode these across noiseless rate-constrained channels to the CEO. The quadratic AWGN CEO problem refers to the class of CEO problems for which the agents view the source through additive white Gaussian noise, and the distortion is squared error. This paper discusses two upper bounds to the CEO sum-rate distortion function for this class of problems. The first follows from elementary arguments. It permits two conclusions. First, the worst case is when the underlying source is Gaussian (for fixed variance). Second, there are source distributions that lead to a significantly better behavior. The second upper bound follows from a new bound on the rate loss between the CEO and the remote rate-distortion function. For certain source distributions and certain ranges of distortion, this bound is better than the first

[1]  M. Gastpar,et al.  Rate Loss in the CEO Problem , 2005 .

[2]  Toby Berger,et al.  The CEO problem [multiterminal source coding] , 1996, IEEE Trans. Inf. Theory.

[3]  Ram Zamir,et al.  The rate loss in the Wyner-Ziv problem , 1996, IEEE Trans. Inf. Theory.

[4]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[5]  Toby Berger,et al.  Rate distortion theory : a mathematical basis for data compression , 1971 .

[6]  Shlomo Shamai,et al.  Mutual information and minimum mean-square error in Gaussian channels , 2004, IEEE Transactions on Information Theory.

[7]  Giuseppe Longo,et al.  The information theory approach to communications , 1977 .

[8]  Kenneth Rose,et al.  A mapping approach to rate-distortion computation and analysis , 1994, IEEE Trans. Inf. Theory.

[9]  Toby Berger,et al.  An upper bound on the sum-rate distortion function and its corresponding rate allocation schemes for the CEO problem , 2004, IEEE Journal on Selected Areas in Communications.

[10]  Y. Oohama Multiterminal source coding for correlated memoryless Gaussian sources with several side information at the decoder , 1999, Proceedings of the 1999 IEEE Information Theory and Communications Workshop (Cat. No. 99EX253).

[11]  Toby Berger,et al.  The quadratic Gaussian CEO problem , 1997, IEEE Trans. Inf. Theory.