Bounds for List-Decoding and List-Recovery of Random Linear Codes

A family of error-correcting codes is list-decodable from error fraction $p$ if, for every code in the family, the number of codewords in any Hamming ball of fractional radius $p$ is less than some integer $L$ that is independent of the code length. It is said to be list-recoverable for input list size $\ell$ if for every sufficiently large subset of codewords (of size $L$ or more), there is a coordinate where the codewords take more than $\ell$ values. The parameter $L$ is said to be the "list size" in either case. The capacity, i.e., the largest possible rate for these notions as the list size $L \to \infty$, is known to be $1-h_q(p)$ for list-decoding, and $1-\log_q \ell$ for list-recovery, where $q$ is the alphabet size of the code family. In this work, we study the list size of random linear codes for both list-decoding and list-recovery as the rate approaches capacity. We show the following claims hold with high probability over the choice of the code (below, $\epsilon > 0$ is the gap to capacity). (1) A random linear code of rate $1 - \log_q(\ell) - \epsilon$ requires list size $L \ge \ell^{\Omega(1/\epsilon)}$ for list-recovery from input list size $\ell$. This is surprisingly in contrast to completely random codes, where $L = O(\ell/\epsilon)$ suffices w.h.p. (2) A random linear code of rate $1 - h_q(p) - \epsilon$ requires list size $L \ge \lfloor h_q(p)/\epsilon+0.99 \rfloor$ for list-decoding from error fraction $p$, when $\epsilon$ is sufficiently small. (3) A random binary linear code of rate $1 - h_2(p) - \epsilon$ is list-decodable from average error fraction $p$ with list size with $L \leq \lfloor h_2(p)/\epsilon \rfloor + 2$. The second and third results together precisely pin down the list sizes for binary random linear codes for both list-decoding and average-radius list-decoding to three possible values.

[1]  Peter Elias,et al.  List decoding for noisy channels , 1957 .

[2]  Peter Elias,et al.  Error-correcting codes for list decoding , 1991, IEEE Trans. Inf. Theory.

[3]  Venkatesan Guruswami,et al.  Near-optimal linear-time codes for unique decoding and new list-decodable codes over smaller alphabets , 2002, STOC '02.

[4]  Noga Alon,et al.  The concentration of the chromatic number of random graphs , 1997, Comb..

[5]  Venkatesan Guruswami,et al.  Concatenated codes can achieve list-decoding capacity , 2008, SODA '08.

[6]  Venkatesan Guruswami,et al.  On the List-Decodability of Random Linear Codes , 2011, IEEE Trans. Inf. Theory.

[7]  Venkatesan Guruswami,et al.  A Lower Bound on List Size for List Decoding , 2005, IEEE Trans. Inf. Theory.

[8]  David Zuckerman,et al.  Nearly Optimal Pseudorandomness From Hardness , 2020, 2020 IEEE 61st Annual Symposium on Foundations of Computer Science (FOCS).

[9]  Venkatesan Guruswami,et al.  Efficiently decodable codes meeting Gilbert-Varshamov bound for low rates , 2004, SODA '04.

[10]  Eran Omri,et al.  Parallel Hashing via List Recoverability , 2015, CRYPTO.

[11]  Vijaya Ramachandran,et al.  The diameter of sparse random graphs , 2007, Random Struct. Algorithms.

[12]  Venkatesan Guruswami,et al.  Combinatorial Limitations of Average-Radius List-Decoding , 2012, IEEE Transactions on Information Theory.

[13]  Mary Wootters,et al.  On the list decodability of random linear codes with large error rates , 2013, STOC '13.

[14]  Brett Hemenway,et al.  Local List Recovery of High-Rate Tensor Codes & Applications , 2017, 2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS).

[15]  Atri Rudra,et al.  ℓ2/ℓ2-Foreach Sparse Recovery with Low Risk , 2013, ICALP.

[16]  Venkatesan Guruswami,et al.  Folded codes from function field towers and improved optimal rate list decoding , 2012, STOC '12.

[17]  Tomasz Luczak A note on the sharp concentration of the chromatic number of random graphs , 1991, Comb..

[18]  Venkatesan Guruswami,et al.  List decoding from erasures: bounds and code constructions , 2001, IEEE Trans. Inf. Theory.

[19]  Atri Rudra,et al.  Efficiently Decodable Error-Correcting List Disjunct Matrices and Applications - (Extended Abstract) , 2011, ICALP.

[20]  Atri Rudra,et al.  Average-radius list-recoverability of random linear codes , 2018, SODA.

[21]  Shubhangi Saraf,et al.  Improved Decoding of Folded Reed-Solomon and Multiplicity Codes , 2018, 2018 IEEE 59th Annual Symposium on Foundations of Computer Science (FOCS).

[22]  Mary Wootters,et al.  Improved List-Decodability of Random Linear Binary Codes , 2018, IEEE Transactions on Information Theory.

[23]  Venkatesan Guruswami,et al.  Expander-based constructions of efficiently decodable codes , 2001, Proceedings 2001 IEEE International Conference on Cluster Computing.

[24]  Venkatesan Guruswami,et al.  Limits to List Decoding Reed-Solomon Codes , 2006, IEEE Trans. Inf. Theory.

[25]  Jaikumar Radhakrishnan,et al.  Subspace Polynomials and Limits to List Decoding of Reed–Solomon Codes , 2010, IEEE Transactions on Information Theory.

[26]  Vladimir M. Blinovsky,et al.  Code bounds for multiple packings over a nonbinary finite alphabet , 2005, Probl. Inf. Transm..

[27]  Atri Rudra,et al.  Every list-decodable code for high noise has abundant near-optimal rate puncturings , 2013, STOC.

[28]  Shachar Lovett,et al.  Subspace Evasive Sets , 2011, Electron. Colloquium Comput. Complex..

[29]  B. Bollobás,et al.  Cliques in random graphs , 1976, Mathematical Proceedings of the Cambridge Philosophical Society.

[30]  Brett Hemenway,et al.  Linear-Time List Recovery of High-Rate Expander Codes , 2015, ICALP.

[31]  Venkatesan Guruswami,et al.  Linear time encodable and list decodable codes , 2003, STOC '03.

[32]  Atri Rudra,et al.  Efficiently decodable non-adaptive group testing , 2010, SODA '10.

[33]  Venkatesan Guruswami,et al.  Combinatorial bounds for list decoding , 2002, IEEE Trans. Inf. Theory.

[34]  Venkatesan Guruswami,et al.  List decoding reed-solomon, algebraic-geometric, and gabidulin subcodes up to the singleton bound , 2013, STOC '13.

[35]  Venkatesan Guruswami,et al.  Restricted Isometry of Fourier Matrices and List Decodability of Random Linear Codes , 2012, SIAM J. Comput..

[36]  Atri Rudra,et al.  It'll Probably Work Out: Improved List-Decoding Through Random Operations , 2014, Electron. Colloquium Comput. Complex..

[37]  Assaf Naor,et al.  The two possible values of the chromatic number of a random graph , 2004, STOC '04.

[38]  Venkatesan Guruswami,et al.  Explicit subspace designs , 2013, 2013 IEEE 54th Annual Symposium on Foundations of Computer Science.

[39]  Robert G. Gallager,et al.  Low-density parity-check codes , 1962, IRE Trans. Inf. Theory.

[40]  Shubhangi Saraf,et al.  On List Recovery of High-Rate Tensor Codes , 2019, IEEE Transactions on Information Theory.

[41]  Jonathan Mosheiff,et al.  LDPC Codes Achieve List Decoding Capacity , 2019, 2020 IEEE 61st Annual Symposium on Foundations of Computer Science (FOCS).