Sequential coding of correlated sources

We study a generalization of the successive refinement coding problem called the sequential coding of correlated sources. In successive refinement source coding one first describes the given source using a few bits of information, and then subsequently improves the description of the same source when more information is supplied. Sequential coding differs from successive refinement in that the second-stage encoding involves describing a correlated source as opposed to improving the description of the same source. We introduce the notion of a coupled fidelity criterion to quantify perceived distortion in certain applications of sequential coding. We characterize the achievable rate region for this source coding problem and show that the rate region reduces to the successive refinement rate region when the two sources are the same. Then we consider the specific case of a pair of correlated Gaussian sources as an example. We give an explicit characterization that reveals an interesting generalization of a property of successive refinement of a single Gaussian source.

[1]  Raymond W. Yeung,et al.  Multilevel diversity coding with distortion , 1995, IEEE Trans. Inf. Theory.

[2]  Robert J. Safranek,et al.  Signal compression based on models of human perception , 1993, Proc. IEEE.

[3]  Toby Berger,et al.  The CEO problem [multiterminal source coding] , 1996, IEEE Trans. Inf. Theory.

[4]  R. Gray,et al.  A new class of lower bounds to information rates of stationary sources via conditional rate-distortion functions , 1973, IEEE Trans. Inf. Theory.

[5]  Yasutada Oohama Gaussian multiterminal source coding , 1997, IEEE Trans. Inf. Theory.

[6]  Yasutada Oohama,et al.  The Rate-Distortion Function for the Quadratic Gaussian CEO Problem , 1998, IEEE Trans. Inf. Theory.

[7]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[8]  Bixio Rimoldi,et al.  Successive refinement of information: characterization of the achievable rates , 1994, IEEE Trans. Inf. Theory.

[9]  A. J. Goldman 3 . Resolution and Separation Theorems for Polyhedral Convex Sets , 1957 .

[10]  Raymond W. Yeung,et al.  Symmetrical multilevel diversity coding , 1997, IEEE Trans. Inf. Theory.

[11]  Toby Berger,et al.  Rate distortion theory : a mathematical basis for data compression , 1971 .

[12]  William Equitz,et al.  Successive refinement of information , 1991, IEEE Trans. Inf. Theory.

[13]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.