BSC Thresholds for Code Ensembles Based on “Typical Pairs” Decoding

In this paper, we develop a method for closely estimating noise threshold values for ensembles of binary linear codes on the binary symmetric channel. Our method, based on the “typical pairs” decoding algorithm pioneered by Shannon, completely decouples the channel from the code ensemble. In this, it resembles the classical union bound, but unlike the union bound, our method is powerful enough to prove Shannon’s theorem for the ensemble of random linear codes. We apply our method to find numerical thresholds for the ensembles of low-density parity-check codes, and “repeat-accumulate” codes.

[1]  Robert G. Gallager,et al.  Low-density parity-check codes , 1962, IRE Trans. Inf. Theory.

[2]  W. W. Peterson,et al.  Error-Correcting Codes. , 1962 .

[3]  Robert J. McEliece,et al.  The Theory of Information and Coding , 1979 .

[4]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[5]  Laurent Decreusefond,et al.  On the error-correcting capabilities of cycle codes of graphs , 1994, Proceedings of 1994 IEEE International Symposium on Information Theory.

[6]  Niclas Wiberg,et al.  Codes and Decoding on General Graphs , 1996 .

[7]  Scott A. Vanstone,et al.  Graphical codes revisited , 1997, IEEE Trans. Inf. Theory.

[8]  Dariush Divsalar,et al.  Coding theorems for 'turbo-like' codes , 1998 .

[9]  David J. C. MacKay,et al.  Good Error-Correcting Codes Based on Very Sparse Matrices , 1997, IEEE Trans. Inf. Theory.

[10]  Rüdiger L. Urbanke,et al.  The capacity of low-density parity-check codes under message-passing decoding , 2001, IEEE Trans. Inf. Theory.