Local-Optimality Guarantees Based on Paths for Optimal Decoding

This paper presents a unified analysis framework that captures recent advances in the study of local-optimality characterizations for codes on graphs. These local-optimality characterizations are based on combinatorial structures embedded in the Tanner graph of the code. Local optimality implies both unique maximum likelihood optimality and unique linear programming (LP) decoding optimality. Also, an iterative message-passing decoding algorithm is guaranteed to find the unique locally optimal codeword if one exists. We demonstrate an instance of this proof technique by considering a definition of local optimality that is based on the simplest combinatorial structures in Tanner graphs, namely, paths of length $h$. We apply the technique of local optimality to binary Tanner codes (including any low-density parity-check code, and in particular any irregular repeat-accumulate code with both even and odd repetition factors). Inverse polynomial bounds in the code length are proved on the word error probability ...

[1]  Guy Even,et al.  Improved bounds on the word error probability of RA(2) codes with linear-programming-based decoding , 2005, IEEE Transactions on Information Theory.

[2]  Guy Even,et al.  On Decoding Irregular Tanner Codes With Local-Optimality Guarantees , 2011, IEEE Transactions on Information Theory.

[3]  Vitaly Skachek,et al.  Correcting a Fraction of Errors in Nonbinary Expander Codes With Linear Programming , 2009, IEEE Transactions on Information Theory.

[4]  P. Vontobel,et al.  Characterizations of pseudo-codewords of (low-density) parity-check codes , 2007 .

[5]  Martin J. Wainwright,et al.  Using linear programming to Decode Binary linear codes , 2005, IEEE Transactions on Information Theory.

[6]  Robert G. Gallager,et al.  Low-density parity-check codes , 1962, IRE Trans. Inf. Theory.

[7]  Elwyn R. Berlekamp,et al.  On the inherent intractability of certain coding problems (Corresp.) , 1978, IEEE Trans. Inf. Theory.

[8]  Martin J. Wainwright,et al.  LP Decoding Corrects a Constant Fraction of Errors , 2004, IEEE Transactions on Information Theory.

[9]  Guy Even,et al.  LP Decoding of Regular LDPC Codes in Memoryless Channels , 2010, IEEE Transactions on Information Theory.

[10]  Alexandros G. Dimakis,et al.  Probabilistic Analysis of Linear Programming Decoding , 2007, IEEE Transactions on Information Theory.

[11]  Ali N. Akansu,et al.  Density evolution for low-density parity-check codes under Max-Log-MAP decoding , 2001 .

[12]  Pascal O. Vontobel,et al.  Counting in Graph Covers: A Combinatorial Characterization of the Bethe Entropy Function , 2010, IEEE Transactions on Information Theory.

[13]  Jon Feldman,et al.  Decoding error-correcting codes via linear programming , 2003 .

[14]  Sanjeev Arora,et al.  Message-Passing Algorithms and Improved LP Decoding , 2012, IEEE Trans. Inf. Theory.

[15]  Jon Feldman,et al.  LP decoding achieves capacity , 2005, SODA '05.

[16]  P. Vontobel,et al.  Graph-Cover Decoding and Finite-Length Analysis of Message-Passing Iterative Decoding of LDPC Codes , 2005, ArXiv.

[17]  Jon Feldman,et al.  Decoding turbo-like codes via linear programming , 2002, The 43rd Annual IEEE Symposium on Foundations of Computer Science, 2002. Proceedings..

[18]  Shimon Even,et al.  Graph Algorithms , 1979 .

[20]  Ralf Koetter,et al.  On the Block Error Probability of LP Decoding of LDPC Codes , 2006, ArXiv.

[21]  Pascal O. Vontobel,et al.  A factor-graph-based random walk, and its relevance for LP decoding analysis and Bethe entropy characterization , 2010, 2010 Information Theory and Applications Workshop (ITA).

[22]  Niclas Wiberg,et al.  Codes and Decoding on General Graphs , 1996 .

[23]  P. A. P. Moran,et al.  An introduction to probability theory , 1968 .

[24]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .