Improved Finite Blocklength Converses for Slepian–Wolf Coding via Linear Programming

A new finite blocklength converse for the Slepian–Wolf coding problem, which significantly improves on the best-known converse due to Miyake and Kanaya, is presented. To obtain this converse, an extension of the linear programming (LP)-based framework for finite blocklength point-to-point coding problems is employed. However, a direct application of this framework demands a complicated analysis for the Slepian–Wolf problem. An analytically simpler approach is presented, wherein LP-based finite blocklength converses for this problem are synthesized from point-to-point lossless source coding problems with perfect side-information at the decoder. New finite blocklength converses for these point-to-point problems are derived by employing the LP-based framework, and the new converse for Slepian–Wolf coding is obtained by an appropriate combination of these converses.

[1]  Vincent Yan Fu Tan,et al.  Asymptotic Estimates in Information Theory with Non-Vanishing Error Probabilities , 2014, Found. Trends Commun. Inf. Theory.

[2]  Sergio Verdú,et al.  Lossy Joint Source-Channel Coding in the Finite Blocklength Regime , 2012, IEEE Transactions on Information Theory.

[3]  Ankur A. Kulkarni,et al.  Linear programming based finite blocklength converses for some network-like problems , 2017, 2017 IEEE Information Theory Workshop (ITW).

[4]  Sergio Verdú,et al.  Fixed-Length Lossy Compression in the Finite Blocklength Regime , 2011, IEEE Transactions on Information Theory.

[5]  Todd P. Coleman,et al.  An Optimizer's Approach to Stochastic Control Problems With Nonclassical Information Structures , 2013, IEEE Transactions on Automatic Control.

[6]  Hiroki Koga,et al.  Information-Spectrum Methods in Information Theory , 2002 .

[7]  Adrià Tauste Campo,et al.  Bayesian $M$ -Ary Hypothesis Testing: The Meta-Converse and Verdú-Han Bounds Are Tight , 2014, IEEE Transactions on Information Theory.

[8]  C. Villani Optimal Transport: Old and New , 2008 .

[9]  Ankur A. Kulkarni,et al.  Linear Programming-Based Converses for Finite Blocklength Lossy Joint Source-Channel Coding , 2016, IEEE Transactions on Information Theory.

[10]  H. Vincent Poor,et al.  Channel Coding Rate in the Finite Blocklength Regime , 2010, IEEE Transactions on Information Theory.

[11]  F. Kanaya,et al.  Coding Theorems on Correlated General Sources , 1995 .

[12]  Gérard Cornuéjols,et al.  Integer programming , 2014, Math. Program..

[13]  L. Palzer,et al.  A converse for lossy source coding in the finite blocklength regime , 2016 .