The zero-delay Wyner-Ziv problem

We consider the zero-delay version of the Wyner-Ziv problem. The zero-delay constraint translates into causal (sequential) encoder and decoder pairs as well as the use of instantaneous codes. We show that optimal performance is attained by time sharing at most two scalar encoder-decoder pairs, that use zero-error side information codes. Side information lookahead is shown to be useless in this setting. We show that the restriction to causal encoding functions is the one that causes the performance degradation, compared to unrestricted systems, and not the sequential decoders or instantaneous codes.

[1]  Noga Alon,et al.  Source coding and graph entropies , 1996, IEEE Trans. Inf. Theory.

[2]  Tsachy Weissman,et al.  Source Coding With Limited-Look-Ahead Side Information at the Decoder , 2006, IEEE Transactions on Information Theory.

[3]  Neri Merhav,et al.  Zero-Delay and Causal Single-User and Multi-User Lossy Source Coding with Decoder Side Information , 2014, IEEE Transactions on Information Theory.

[4]  Kenneth Rose,et al.  Zero-error source coding with maximum distortion criterion , 2002, Proceedings DCC 2002. Data Compression Conference.

[5]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[6]  Michelle Effros,et al.  Quantization as Histogram Segmentation: Optimal Scalar Quantizer Design in Network Systems , 2008, IEEE Transactions on Information Theory.

[7]  David L. Neuhoff,et al.  Causal source codes , 1982, IEEE Trans. Inf. Theory.

[8]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[9]  Kenneth Rose,et al.  On zero-error source coding with decoder side information , 2003, IEEE Trans. Inf. Theory.

[10]  H. S. WITSENHAUSEN,et al.  The zero-error side information problem and chromatic numbers (Corresp.) , 1976, IEEE Trans. Inf. Theory.

[11]  Tetsunao Matsuta,et al.  国際会議開催報告:2013 IEEE International Symposium on Information Theory , 2013 .

[12]  Tsachy Weissman,et al.  Source Coding with Limited Side Information Lookahead at the Decoder , 2006, 2006 IEEE International Symposium on Information Theory.

[13]  Tsachy Weissman,et al.  On causal source codes with side information , 2005, IEEE Transactions on Information Theory.

[14]  N. THOMAS GAARDER,et al.  On optimal finite-state digital transmission systems , 1982, IEEE Trans. Inf. Theory.