Linear Programming Based Finite Blocklength Converses in Information Theory

A linear programming based framework is presented to derive finite blocklength converses for coding problems in information theory which is also extendable to network settings. In the point-to-point setting, the LP based framework recovers and in fact improves on almost all well-known finite blocklength converses for lossy joint source-channel coding, lossy source coding and channel coding. Moreover, the LP based framework is shown to be asymptotically tight for the averaged and compound channels under the maximum probability of error criterion. Further, for multiterminal Slepian- Wolf source coding problem, a systematic approach to synthesize new converses from considering point-to-point lossless source coding (with side-information at decoder) sub-problems is introduced. The method derives new finite blocklength converse for Slepian- Wolf coding which significantly improves on the converse of Miyake and Kanaya.

[1]  Victoria Kostina,et al.  Data Compression With Low Distortion and Finite Blocklength , 2017, IEEE Transactions on Information Theory.

[2]  Sergio Verdú,et al.  Fixed-Length Lossy Compression in the Finite Blocklength Regime , 2011, IEEE Transactions on Information Theory.

[3]  Mehul Motani,et al.  Second-Order and Moderate Deviations Asymptotics for Successive Refinement , 2016, IEEE Transactions on Information Theory.

[4]  Ankur A. Kulkarni,et al.  Linear Programming-Based Converses for Finite Blocklength Lossy Joint Source-Channel Coding , 2016, IEEE Transactions on Information Theory.

[5]  Sergio Verdu,et al.  Lossy Joint Source-Channel Coding in the Finite Blocklength Regime , 2013, IEEE Trans. Inf. Theory.

[6]  Ankur A. Kulkarni,et al.  Linear programming based finite blocklength converses for some network-like problems , 2017, 2017 IEEE Information Theory Workshop (ITW).

[7]  A~nsw~dr The Weak Capacity of Averaged Channels , 1967 .

[8]  G. Nemhauser,et al.  Integer Programming , 2020 .

[9]  F. Kanaya,et al.  Coding Theorems on Correlated General Sources , 1995 .

[10]  Ankur A. Kulkarni,et al.  A linear programming based channel coding strong converse for the BSC and BEC , 2017, 2017 Twenty-third National Conference on Communications (NCC).

[11]  Ankur A. Kulkarni,et al.  Improved Finite Blocklength Converses for Slepian–Wolf Coding via Linear Programming , 2018, IEEE Transactions on Information Theory.

[12]  Todd P. Coleman,et al.  An Optimizer's Approach to Stochastic Control Problems With Nonclassical Information Structures , 2013, IEEE Transactions on Automatic Control.

[13]  William Matthews,et al.  A Linear Program for the Finite Block Length Converse of Polyanskiy–Poor–Verdú Via Nonsignaling Codes , 2011, IEEE Transactions on Information Theory.

[14]  L. Palzer,et al.  A converse for lossy source coding in the finite blocklength regime , 2016 .

[15]  H. Vincent Poor,et al.  Channel Coding Rate in the Finite Blocklength Regime , 2010, IEEE Transactions on Information Theory.

[16]  Sergio Verdú,et al.  Lossy Joint Source-Channel Coding in the Finite Blocklength Regime , 2012, IEEE Transactions on Information Theory.