Finite-Blocklength Performance of Sequential Transmission over BSC with Noiseless Feedback

In this paper, we consider the problem of sequential transmission over the binary symmetric channel (BSC) with full, noiseless feedback. Naghshvar et al. proposed a one-phase encoding scheme, for which we refer to as the small-enough difference (SED) encoder, which can achieve capacity and Burnashev’s optimal error exponent for symmetric binary-input channels. They also provided a non-asymptotic upper bound on the average blocklength, which implies an achievability bound on rates. However, their achievability bound is loose compared to the simulated performance of SED encoder, and even lies beneath Polyanskiy’s achievability bound of a system limited to stop feedback. This paper significantly tightens the achievability bound by using a Markovian analysis that leverages both the submartingale and Markov properties of the transmitted message. Our new non-asymptotic lower bound on achievable rate lies above Polyanskiy’s bound and is close to the actual performance of the SED encoder over the BSC.

[1]  H. Vincent Poor,et al.  Channel Coding Rate in the Finite Blocklength Regime , 2010, IEEE Transactions on Information Theory.

[2]  R. Gallager Stochastic Processes , 2014 .

[3]  Michael Horstein,et al.  Sequential transmission using noiseless feedback , 1963, IEEE Trans. Inf. Theory.

[4]  David Williams,et al.  Probability with Martingales , 1991, Cambridge mathematical textbooks.

[5]  Emre Telatar,et al.  A feedback strategy for binary symmetric channels , 2002, Proceedings IEEE International Symposium on Information Theory,.

[6]  Abbas El Gamal,et al.  An efficient feedback coding scheme with low error probability for discrete memoryless channels , 2013, 2014 IEEE International Symposium on Information Theory.

[7]  Richard D. Wesel,et al.  Variable-Length Convolutional Coding for Short Blocklengths With Decision Feedback , 2014, IEEE Transactions on Communications.

[8]  Emre Telatar,et al.  Variable length coding over an unknown channel , 2006, IEEE Transactions on Information Theory.

[9]  J. Pieter M. Schalkwijk A class of simple and optimal strategies for block coding on the binary symmetric channel with noiseless feedback , 1971, IEEE Trans. Inf. Theory.

[10]  J. Pieter M. Schalkwijk,et al.  On the error probability for a class of binary recursive feedback strategies , 1973, IEEE Trans. Inf. Theory.

[11]  Tara Javidi,et al.  Extrinsic Jensen–Shannon Divergence: Applications to Variable-Length Coding , 2013, IEEE Transactions on Information Theory.

[12]  H. Vincent Poor,et al.  Feedback in the Non-Asymptotic Regime , 2011, IEEE Transactions on Information Theory.

[13]  Thomas M. Cover,et al.  Elements of information theory (2. ed.) , 2006 .

[14]  Tara Javidi,et al.  Optimal reliability over a class of binary-input channels with feedback , 2012, 2012 IEEE Information Theory Workshop.

[15]  Claude E. Shannon,et al.  The zero error capacity of a noisy channel , 1956, IRE Trans. Inf. Theory.

[16]  Meir Feder,et al.  Optimal Feedback Communication Via Posterior Matching , 2009, IEEE Transactions on Information Theory.