On Hierarchical Joint Source-Channel Coding With Causal Side Information at the Decoders

Consider a process, {Xi, Yi, Zi}- infin i=1, producing independent copies of a triplet of jointly distributed random variables (RVs). The {Xi} part of the process - the source, is observed at the encoder, and is supposed to be reproduced at two decoders, decoder 1 and decoder 2 , where the {Zi} and the {Yi} parts of the process are observed, respectively in a causal manner. The communication between the encoder and the decoders is carried out across two memoryless channels in two successive communication stages. In the first stage, the compressed transmission is available to both decoders, but only decoder 1 reconstructs the source (according to the received data-stream and its causal side information {Zi}0. In the second stage, the second decoder reconstructs the source according to {Y i} and the transmissions of the encoder in both stages. It is desired to find the necessary and sufficient conditions on communication between the encoder and decoders, so that the distortions incurred (in each round) will not exceed given thresholds. We first derive a single-letter characterization of achievable rates for a pure source-coding problem with successive refinement and causal side information at the decoders. Then, for a joint source-channel coding setting, we prove a separation theorem, asserting that in the limit of long blocks, no optimality is lost by first applying lossy successive-refinement source coding, regardless of the channels, and then applying good channel codes to each one of the resulting bitstreams, regardless of the source

[1]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[2]  Neri Merhav,et al.  On hierarchical joint source-channel coding with degraded side information , 2006, IEEE Transactions on Information Theory.

[3]  Toby Berger,et al.  Rate distortion when side information may be absent , 1985, IEEE Trans. Inf. Theory.

[4]  Neri Merhav,et al.  On successive refinement for the Wyner-Ziv problem , 2004, IEEE Transactions on Information Theory.

[5]  Suhas N. Diggavi,et al.  On Multistage Successive Refinement for Wyner–Ziv Source Coding With Degraded Side Informations , 2007, IEEE Transactions on Information Theory.

[6]  Neri Merhav,et al.  On hierarchical joint source-channel coding , 2004, International Symposium onInformation Theory, 2004. ISIT 2004. Proceedings..

[7]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[8]  Suhas N. Diggavi,et al.  Multistage successive refinement for Wyner-Ziv source coding with degraded side informations , 2006, 2006 IEEE International Symposium on Information Theory.

[9]  Neri Merhav,et al.  On Successive Refinement With Causal Side Information at the Decoders , 2008, IEEE Transactions on Information Theory.

[10]  Bixio Rimoldi,et al.  Successive refinement of information: characterization of the achievable rates , 1994, IEEE Trans. Inf. Theory.

[11]  Tsachy Weissman,et al.  Source Coding with Limited Side Information Lookahead at the Decoder , 2006, 2006 IEEE International Symposium on Information Theory.