Achievable moderate deviations asymptotics for streaming Slepian-Wolf coding

Motivated by streaming multi-view video coding, we consider the problem of blockwise streaming compression of a pair of correlated sources, which we term streaming Slepian-Wolf coding. We study the moderate deviations regime in which the rate pairs of a sequence of codes converges, along a straight line, to various points on the boundary of the Slepian-Wolf region at a speed slower than the inverse square root of the blocklength n, while the error probability decays subexponentially fast in n. Our main result focuses on directions of approaches to corner points of the Slepian-Wolf region. It states that for each correlated source and all corner points, there exists a non-empty subset of directions of approaches such that the moderate deviations constant (the constant of proportionality for the subexponential decay of the error probability) is enhanced (over the non-streaming case) by at least a factor of T, the block delay of decoding symbol pairs. Further, we specialize our main result to the setting of lossless streaming source coding.

[1]  Aaron B. Wagner,et al.  Moderate deviation analysis of channel coding: Discrete memoryless case , 2010, 2010 IEEE International Symposium on Information Theory.

[2]  Thomas M. Cover,et al.  A Proof of the Data Compression Theorem of Slepian and Wolf for Ergodic Sources , 1971 .

[3]  Hiroki Koga,et al.  Information-Spectrum Methods in Information Theory , 2002 .

[4]  Mehul Motani,et al.  Achievable Moderate Deviations Asymptotics for Streaming Compression of Correlated Sources , 2016, IEEE Transactions on Information Theory.

[5]  Cheng Chang,et al.  Streaming source coding with delay , 2007 .

[6]  Sergio Verdú,et al.  Optimal Lossless Data Compression: Non-Asymptotics and Asymptotics , 2014, IEEE Transactions on Information Theory.

[7]  Nan Zhang,et al.  Delay exponent of variable-length random binning for point-to-point transmission , 2014, 2014 IEEE Information Theory Workshop (ITW 2014).

[8]  Anant Sahai,et al.  Sequential decoding for lossless streaming source coding with side information , 2007, ArXiv.

[9]  Wen Gao,et al.  Wyner–Ziv-Based Multiview Video Coding , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Vincent Yan Fu Tan,et al.  Moderate deviations for joint source-channel coding of systems with Markovian memory , 2014, 2014 IEEE International Symposium on Information Theory.

[11]  H. Vincent Poor,et al.  Channel coding: non-asymptotic fundamental limits , 2010 .

[12]  Ramji Venkataramanan,et al.  Source Coding With Feed-Forward: Rate-Distortion Theorems and Error Exponents for a General Source , 2007, IEEE Transactions on Information Theory.

[13]  Vincent Y. F. Tan,et al.  Moderate-deviations of lossy source coding for discrete and Gaussian sources , 2011, 2012 IEEE International Symposium on Information Theory Proceedings.

[14]  Anant Sahai,et al.  Lossless Coding for Distributed Streaming Sources , 2006, IEEE Transactions on Information Theory.

[15]  Yao Wang,et al.  Multiview video sequence analysis, compression, and virtual viewpoint synthesis , 2000, IEEE Trans. Circuits Syst. Video Technol..

[16]  Ioannis Kontoyiannis,et al.  Lossless compression with moderate error probability , 2013, 2013 IEEE International Symposium on Information Theory.

[17]  Jun Chen,et al.  On the Redundancy of Slepian–Wolf Coding , 2009, IEEE Transactions on Information Theory.

[18]  R. A. McDonald,et al.  Noiseless Coding of Correlated Information Sources , 1973 .

[19]  Masahito Hayashi,et al.  Secure multiplex coding with dependent and non-uniform multiple messages , 2012, 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[20]  Anant Sahai,et al.  The price of ignorance: The impact of side-information on delay for lossless source-coding , 2007, ArXiv.

[21]  Aaron B. Wagner,et al.  Moderate Deviations in Channel Coding , 2012, IEEE Transactions on Information Theory.

[22]  Harikrishna Palaiyanur,et al.  The impact of causality on information-theoretic source and channel coding problems , 2011 .

[23]  Abbas El Gamal,et al.  Network Information Theory , 2021, 2021 IEEE 3rd International Conference on Advanced Trends in Information Theory (ATIT).

[24]  Anant Sahai,et al.  The error exponent with delay for lossless source coding , 2006, 2006 IEEE Information Theory Workshop - ITW '06 Punta del Este.

[25]  B. Girod,et al.  Multiview Video Compression , 2007, IEEE Signal Processing Magazine.

[26]  S. Verdú,et al.  Channel dispersion and moderate deviations limits for memoryless channels , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[27]  Jun Chen,et al.  On the Redundancy-Error Tradeoff in Slepian-Wolf Coding and Channel Coding , 2007, 2007 IEEE International Symposium on Information Theory.

[28]  Anant Sahai Why Do Block Length and Delay Behave Differently if Feedback Is Present? , 2008, IEEE Transactions on Information Theory.