The importance of tie-breaking in finite-blocklength bounds

Upper bounds on the error probability in channel coding are considered, improving the RCU bound by taking into account events, where the likelihood of the correct codeword is tied with that of some competitors. This bound is compared to various previous results, both qualitatively and quantitatively; it is shown to be the tightest bound with respect to previous bounds with the same computational complexity. With respect to maximal error probability of linear codes, it is observed that when the channel is additive, the derivation of bounds, as well as the assumptions on the admissible encoder and decoder, simplify considerably.

[1]  H. Vincent Poor,et al.  Channel Coding Rate in the Finite Blocklength Regime , 2010, IEEE Transactions on Information Theory.

[2]  Amiel Feinstein,et al.  A new basic theorem of information theory , 1954, Trans. IRE Prof. Group Inf. Theory.

[3]  Robert G. Gallager,et al.  Low-density parity-check codes , 1962, IRE Trans. Inf. Theory.

[4]  Albert Guillén i Fàbregas,et al.  Random-coding bounds for threshold decoders: Error exponent and saddlepoint approximation , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[5]  Gérald E. Séguin Linear ensembles of codes (Corresp.) , 1979, IEEE Trans. Inf. Theory.

[6]  Michael Gastpar,et al.  Compute-and-Forward: Harnessing Interference Through Structured Codes , 2009, IEEE Transactions on Information Theory.

[7]  R. Dobrushin Asymptotic Optimality of Group and Systematic Codes for Some Channels , 1963 .

[8]  Gregory Poltyrev,et al.  Bounds on the decoding error probability of binary linear codes via their spectra , 1994, IEEE Trans. Inf. Theory.