Boosting output distributions in finite blocklength channel coding converse bounds

Point-to-point channel coding is studied in the finite blocklength regime. Many existing converse bounds involve an optimization over a distribution on the channel output. This paper provides a method for generating good, if not optimal, output distributions. In particular, given any candidate output distribution, a “boosting” procedure is given that constructs a new distribution which improves the converse bound derived from the divergence spectrum. For discrete memoryless channels, it is shown that using the i.i.d. capacity-achieving output distribution as an initial guess in this procedure results in an output distribution that is good enough to derive the third-order coding rate for most channels. The finite blocklengths bounds are then applied to the Z channel.

[1]  V. Strassen,et al.  Asymptotic Estimates in Shannon ’ s Information Theory , 2009 .

[2]  Yury Polyanskiy,et al.  Saddle Point in the Minimax Converse for Channel Coding , 2013, IEEE Transactions on Information Theory.

[3]  Roderick Wong,et al.  Asymptotic approximations of integrals , 1989, Classics in applied mathematics.

[4]  Aaron B. Wagner,et al.  The third-order term in the normal approximation for singular channels , 2013, 2014 IEEE International Symposium on Information Theory.

[5]  H. Vincent Poor,et al.  Channel Coding Rate in the Finite Blocklength Regime , 2010, IEEE Transactions on Information Theory.

[6]  Vincent Yan Fu Tan,et al.  A Tight Upper Bound for the Third-Order Asymptotics for Most Discrete Memoryless Channels , 2012, IEEE Transactions on Information Theory.

[7]  Imre Csiszár,et al.  Information Theory - Coding Theorems for Discrete Memoryless Systems, Second Edition , 2011 .