Structure Theorems for Real-Time Variable Rate Coding With and Without Side Information

The output of a discrete Markov source is to be encoded instantaneously by a variable-rate encoder and decoded by a finite-state decoder. Our performance measure is a linear combination of the distortion and the instantaneous rate. Structure theorems, pertaining to the encoder and next-state functions, are derived for every given finite-state decoder, which can have access to side information.

[1]  Demosthenis Teneketzis,et al.  On the Structure of Optimal Real-Time Encoders and Decoders in Noisy Communication , 2006, IEEE Transactions on Information Theory.

[2]  Tsachy Weissman,et al.  On real time coding with limited lookahead , 2011, 2011 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[3]  Todd P. Coleman,et al.  Information-Theoretic Viewpoints on Optimal Causal Coding-Decoding Problems , 2011, ArXiv.

[4]  N. THOMAS GAARDER,et al.  On optimal finite-state digital transmission systems , 1982, IEEE Trans. Inf. Theory.

[5]  Tamer Basar,et al.  Causal coding of markov sources with continuous alphabets , 2008 .

[6]  David L. Neuhoff,et al.  Causal source codes , 1982, IEEE Trans. Inf. Theory.

[7]  H. Witsenhausen.  On the structure of real-time source coders , 1979, The Bell System Technical Journal.

[8]  I. Gihman,et al.  Controlled Stochastic Processes , 1979 .

[9]  Neri Merhav,et al.  Source coding exponents for zero-delay coding with finite memory , 2003, IEEE Trans. Inf. Theory.

[10]  Tsachy Weissman,et al.  On causal source codes with side information , 2005, IEEE Transactions on Information Theory.

[11]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[12]  Noga Alon,et al.  Source coding and graph entropies , 1996, IEEE Trans. Inf. Theory.

[13]  Neri Merhav,et al.  On the Wyner-Ziv problem for individual sequences , 2006, IEEE Transactions on Information Theory.

[14]  Demosthenis Teneketzis,et al.  Optimal Design of Sequential Real-Time Communication Systems , 2009, IEEE Transactions on Information Theory.

[15]  Jean C. Walrand,et al.  Optimal causal coding - decoding problems , 1983, IEEE Trans. Inf. Theory.

[16]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.