LDPC Codes Achieve List Decoding Capacity

We show that Gallager's ensemble of Low-Density Parity Check (LDPC) codes achieves list-decoding capacity with high probability. These are the first graph-based codes shown to have this property. This result opens up a potential avenue towards truly linear-time list-decodable codes that achieve list-decoding capacity. Our result on list decoding follows from a much more general result: any local property satisfied with high probability by a random linear code is also satisfied with high probability by a random LDPC code from Gallager's distribution. Local properties are properties characterized by the exclusion of small sets of codewords, and include list-decoding, list-recovery and average-radius list-decoding. In order to prove our results on LDPC codes, we establish sharp thresholds for when local properties are satisfied by a random linear code. More precisely, we show that for any local property $\mathcal{P}$, there is some $R^{\ast}$ so that random linear codes of rate slightly less than $R^{\ast}$ satisfy $\mathcal{P}$ with high probability, while random linear codes of rate slightly more than $R^{\ast}$ with high probability do not. We also give a characterization of the threshold rate $R^{\ast}$. This is an extended abstract. The full version is available at https://arxiv.org/abs/1909.06430

[1]  Venkatesan Guruswami,et al.  Bounds for List-Decoding and List-Recovery of Random Linear Codes , 2020, IEEE Transactions on Information Theory.

[2]  Bhargav P. Narayanan,et al.  Thresholds versus fractional expectation-thresholds , 2019, Annals of Mathematics.

[3]  Shubhangi Saraf,et al.  On List Recovery of High-Rate Tensor Codes , 2019, IEEE Transactions on Information Theory.

[4]  Amnon Ta-Shma,et al.  List Decoding with Double Samplers , 2018, Electron. Colloquium Comput. Complex..

[5]  Nathan Linial,et al.  On the weight distribution of random binary linear codes , 2018, Random Struct. Algorithms.

[6]  Shubhangi Saraf,et al.  Improved Decoding of Folded Reed-Solomon and Multiplicity Codes , 2018, 2018 IEEE 59th Annual Symposium on Foundations of Computer Science (FOCS).

[7]  Mary Wootters,et al.  Improved List-Decodability of Random Linear Binary Codes , 2018, IEEE Transactions on Information Theory.

[8]  Mary Wootters,et al.  Local List Recovery of High-Rate Tensor Codes & Applications , 2017, 2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS).

[9]  A. Rudra,et al.  Average-radius list-recovery of random linear codes: it really ties the room together , 2017, ArXiv.

[10]  Brett Hemenway,et al.  Linear-Time List Recovery of High-Rate Expander Codes , 2015, ICALP.

[11]  Ryan O'Donnell,et al.  Analysis of Boolean Functions , 2014, ArXiv.

[12]  Venkatesan Guruswami,et al.  Explicit subspace designs , 2013, 2013 IEEE 54th Annual Symposium on Foundations of Computer Science.

[13]  Atri Rudra,et al.  Every list-decodable code for high noise has abundant near-optimal rate puncturings , 2013, STOC.

[14]  Venkatesan Guruswami,et al.  List decoding reed-solomon, algebraic-geometric, and gabidulin subcodes up to the singleton bound , 2013, STOC '13.

[15]  Venkatesan Guruswami,et al.  Linear-Algebraic List Decoding for Variants of Reed–Solomon Codes , 2013, IEEE Transactions on Information Theory.

[16]  Mary Wootters,et al.  On the list decodability of random linear codes with large error rates , 2013, STOC '13.

[17]  Venkatesan Guruswami,et al.  Restricted Isometry of Fourier Matrices and List Decodability of Random Linear Codes , 2012, SIAM J. Comput..

[18]  Venkatesan Guruswami,et al.  Folded codes from function field towers and improved optimal rate list decoding , 2012, STOC '12.

[19]  Rüdiger L. Urbanke,et al.  Spatially coupled ensembles universally achieve capacity under belief propagation , 2012, 2012 IEEE International Symposium on Information Theory Proceedings.

[20]  Shachar Lovett,et al.  Subspace evasive sets , 2011, STOC '12.

[21]  Venkatesan Guruswami,et al.  On the List-Decodability of Random Linear Codes , 2010, IEEE Transactions on Information Theory.

[22]  Michael I. Jordan,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008, Found. Trends Mach. Learn..

[23]  V. Guruswami Iterative Decoding of Low-Density Parity Check Codes , 2006, Bull. EATCS.

[24]  Venkatesan Guruswami,et al.  Explicit Codes Achieving List Decoding Capacity: Error-Correction With Optimal Redundancy , 2005, IEEE Transactions on Information Theory.

[25]  I. Csiszár,et al.  Information Theory and Statistics: A Tutorial , 2004, Found. Trends Commun. Inf. Theory.

[26]  Christian Schlegel,et al.  Low-Density Parity-Check Codes , 2004 .

[27]  Venkatesan Guruswami,et al.  Combinatorial bounds for list decoding , 2002, IEEE Trans. Inf. Theory.

[28]  Venkatesan Guruswami,et al.  List decoding from erasures: bounds and code constructions , 2001, IEEE Trans. Inf. Theory.

[29]  Gilles Zémor,et al.  On expander codes , 2001, IEEE Trans. Inf. Theory.

[30]  Noga Alon,et al.  Linear time erasure codes with nearly optimal recovery , 1995, Proceedings of IEEE 36th Annual Foundations of Computer Science.

[31]  Vladimir M. Blinovsky,et al.  List decoding , 1992, Discret. Math..

[32]  H. Niederreiter,et al.  Introduction to finite fields and their applications: List of Symbols , 1986 .

[33]  Béla Bollobás,et al.  Random Graphs, Second Edition , 2001, Cambridge Studies in Advanced Mathematics.

[34]  Robert Michael Tanner,et al.  A recursive approach to low complexity codes , 1981, IEEE Trans. Inf. Theory.

[35]  Benjamin Rossman,et al.  Thresholds in the Lattice of Subspaces of (Fq)n , 2019, ArXiv.

[36]  Swastik Kopparty,et al.  List-Decoding Multiplicity Codes , 2012, Theory Comput..

[37]  Peter Elias,et al.  List decoding for noisy channels , 1957 .