Exact Moderate Deviation Asymptotics in Streaming Data Transmission

In this paper, a streaming transmission setup is considered, where an encoder observes a new message in the beginning of each block and a decoder sequentially decodes each message after a delay of <inline-formula> <tex-math notation="LaTeX">$T$ </tex-math></inline-formula> blocks. In this streaming setup, the fundamental interplay between the coding rate, the error probability, and the blocklength in the moderate deviations regime is studied. For output symmetric channels, the moderate deviations constant is shown to improve over the block coding or non-streaming setup by exactly a factor of <inline-formula> <tex-math notation="LaTeX">$T$ </tex-math></inline-formula> for a certain range of moderate deviations scalings. For the converse proof, a more powerful decoder, to which some extra information is fedforward is assumed. The error probability is bounded first for an auxiliary channel and this result is translated back to the original channel by using a newly developed change-of-measure lemma, where the speed of decay of the remainder term in the exponent is carefully characterized. For the achievability proof, a known coding technique that involves a joint encoding and decoding of fresh and past messages is applied with some manipulations in the error analysis.

[1]  Aaron B. Wagner,et al.  Moderate deviation analysis of channel coding: Discrete memoryless case , 2010, 2010 IEEE International Symposium on Information Theory.

[2]  Vincent Y. F. Tan,et al.  Streaming data transmission in the moderate deviations and central limit regimes , 2015, 2016 IEEE International Symposium on Information Theory (ISIT).

[3]  Vincent Y. F. Tan,et al.  Exact moderate deviation asymptotics in streaming data transmission , 2017, ISIT.

[4]  Mehul Motani,et al.  Second-Order and Moderate Deviations Asymptotics for Successive Refinement , 2016, IEEE Transactions on Information Theory.

[5]  H. Vincent Poor,et al.  Channel Coding Rate in the Finite Blocklength Regime , 2010, IEEE Transactions on Information Theory.

[6]  Anant Sahai Why Do Block Length and Delay Behave Differently if Feedback Is Present? , 2008, IEEE Transactions on Information Theory.

[7]  S. Verdú,et al.  Channel dispersion and moderate deviations limits for memoryless channels , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[8]  Imre Csiszár,et al.  Information Theory - Coding Theorems for Discrete Memoryless Systems, Second Edition , 2011 .

[9]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[10]  N. Sloane,et al.  Lower Bounds to Error Probability for Coding on Discrete Memoryless Channels. I , 1993 .

[11]  Anant Sahai,et al.  Lossless Coding for Distributed Streaming Sources , 2006, IEEE Transactions on Information Theory.

[12]  Stark C. Draper,et al.  The Streaming-DMT of Fading Channels , 2013, IEEE Transactions on Information Theory.

[13]  Vincent Y. F. Tan,et al.  Asymptotic expansions for the AWGN channel with feedback under a peak power constraint , 2015, 2015 IEEE International Symposium on Information Theory (ISIT).

[14]  Donald E. Knuth,et al.  Big Omicron and big Omega and big Theta , 1976, SIGA.

[15]  Elwyn R. Berlekamp,et al.  Lower Bounds to Error Probability for Coding on Discrete Memoryless Channels. II , 1967, Inf. Control..

[16]  Robert G. Gallager,et al.  A simple derivation of the coding theorem and some applications , 1965, IEEE Trans. Inf. Theory.

[17]  H. Vincent Poor,et al.  Feedback in the Non-Asymptotic Regime , 2011, IEEE Transactions on Information Theory.

[18]  D. A. Bell,et al.  Information Theory and Reliable Communication , 1969 .

[19]  Stark C. Draper,et al.  Truncated tree codes for streaming data: Infinite-memory reliability using finite memory , 2011, 2011 8th International Symposium on Wireless Communication Systems.

[20]  Aaron B. Wagner,et al.  Moderate Deviations in Channel Coding , 2012, IEEE Transactions on Information Theory.

[21]  Leonard J. Schulman Coding for interactive communication , 1996, IEEE Trans. Inf. Theory.

[22]  Anant Sahai,et al.  Anytime information theory , 2001 .

[23]  J. Nicholas Laneman,et al.  A Second-Order Achievable Rate Region for Gaussian Multi-Access Channels via a Central Limit Theorem for Functions , 2015, IEEE Transactions on Information Theory.

[24]  Babak Hassibi,et al.  Linear error correcting codes with anytime reliability , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[25]  Amir Dembo,et al.  Large Deviations Techniques and Applications , 1998 .