Nonanticipative transmission for sources and channels with memory

In this paper we analyze nonanticipative (delayless) transmission of source symbols with memory over channels with memory (with and without feedback). We employ duality of {source, channel} pairs with respect to {distortion function, transmission cost} pairs to show achievability of nonanticipative transmission in terms of excess distortion probability. We apply the method to the Binary Markov source with Hamming distortion function and the Binary Unit Memory channel with transmission cost, with the joint-design operating optimally and in real-time, with and without feedback encoding and decoding.

[1]  Photios Stavrou,et al.  Applications of information Nonanticipative Rate Distortion Function , 2014, 2014 IEEE International Symposium on Information Theory.

[2]  Christos K. Kourtellaris,et al.  Nonanticipative Duality of Sources and Channels with Memory and Feedback , 2015 .

[3]  Aaron D. Wyner,et al.  Coding Theorems for a Discrete Source With a Fidelity CriterionInstitute of Radio Engineers, International Convention Record, vol. 7, 1959. , 1993 .

[4]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[5]  Photios Stavrou,et al.  Information Nonanticipative Rate Distortion Function and Its Applications , 2014, ArXiv.

[6]  Toby Berger,et al.  Rate distortion theory : a mathematical basis for data compression , 1971 .

[7]  Lesley Gourlay,et al.  To Code or Not To Code , 1998 .

[8]  Optimal Hoeffding bounds for discrete reversible Markov chains , 2004, math/0405296.

[9]  Sergio Verdú,et al.  To code or not to code: Revisited , 2012, 2012 IEEE Information Theory Workshop.

[10]  Christos K. Kourtellaris,et al.  Nonanticipative information theory , 2014 .

[11]  Christos K. Kourtellaris,et al.  Capacity of Binary State Symmetric Channel with and without feedback and transmission cost , 2015, 2015 IEEE Information Theory Workshop (ITW).

[12]  J. Massey.  CAUSALITY, FEEDBACK AND DIRECTED INFORMATION , 1990 .

[13]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[14]  Photios Stavrou,et al.  Variational equalities of directed information and applications , 2013, 2013 IEEE International Symposium on Information Theory.