Limits to List Decoding of Random Codes

It has been known since [Zyablov and Pinsker, 1982] that a random q-ary code of rate 1 - H<sub>q</sub>(ρ) - ε (where 0 <; ρ <; 1 - 1/q, ε >; 0 is small enough and -H<sub>q</sub>(·) is the g-ary entropy function) with high probability is a (ρ, 1/ε) -list decodable code (that is, every Hamming ball of radius at most pn has at most 1/ε codewords in it). In this paper, the "converse" result is proven. In particular, it is proven that for every 0 <; ρ <; 1 - 1/q, a random code of rate 1 - H<sub>q</sub>(ρ) - ε, with high probability, is not a (ρ, L)-list decodable code for any L ≤ c/ε, where c is some constant that depends only on ρ and q. A similar lower bound is also shown for random linear codes. Previously, such a tight lower bound on the list size was only known for the case when ρ ≥ 1 - 1/q O(√ε) for small enough ε >; 0 [Blinovsky, 1986, 2005, 2008; Guruswami and Vadhan, 2005]. A lower bound is known for all constant 0<;ρ<;1 - 1/q independent of ε, though the lower bound is asymptotically weaker than our bound [Blinovsky, 1986, 2005, 2008]. These results, however, are not subsumed by ours as these other results hold for arbitrary codes of rate 1 - H<sub>q</sub>(ρ) - ε.

[1]  Claude E. Shannon,et al.  A mathematical theory of communication , 1948, MOCO.

[2]  Venkatesan Guruswami,et al.  A Lower Bound on List Size for List Decoding , 2005, IEEE Trans. Inf. Theory.

[3]  Venkatesan Guruswami,et al.  List decoding of error correcting codes , 2001 .

[4]  Richard W. Hamming,et al.  Error detecting and error correcting codes , 1950 .

[5]  A. Rudra,et al.  List decoding and property testing of error-correcting codes , 2007 .

[6]  Peter Elias,et al.  List decoding for noisy channels , 1957 .

[7]  Vladimir M. Blinovsky,et al.  List decoding , 1992, Discret. Math..

[8]  Vladimir M. Blinovsky,et al.  Code bounds for multiple packings over a nonbinary finite alphabet , 2005, Probl. Inf. Transm..

[9]  Madhu Sudan List decoding: algorithms and applications , 2000, SIGA.

[10]  Venkatesan Guruswami,et al.  Algorithmic Results in List Decoding , 2006, Found. Trends Theor. Comput. Sci..

[11]  Venkatesan Guruswami,et al.  On the List-Decodability of Random Linear Codes , 2010, IEEE Transactions on Information Theory.

[12]  Vladimir M. Blinovsky,et al.  On the convexity of one coding-theory function , 2008, Probl. Inf. Transm..

[13]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[14]  Atri Rudra,et al.  Limits to List Decoding of Random Codes , 2009, IEEE Transactions on Information Theory.

[15]  E. Gilbert A comparison of signalling alphabets , 1952 .

[16]  O. Antoine,et al.  Theory of Error-correcting Codes , 2022 .