High-Rate Locally Correctable and Locally Testable Codes with Sub-Polynomial Query Complexity

Locally correctable codes (LCCs) and locally testable codes (LTCs) are error-correcting codes that admit local algorithms for correction and detection of errors. Those algorithms are local in the sense that they only query a small number of entries of the corrupted codeword. The fundamental question about LCCs and LTCs is to determine the optimal tradeoff among their rate, distance, and query complexity. In this work, we construct the first LCCs and LTCs with constant rate, constant relative distance, and sub-polynomial query complexity. Specifically, we show that there exist LCCs and LTCs with block length n, constant rate (which can even be taken arbitrarily close to 1), and constant relative distance, whose query complexity is exp(Õ(√log n)) (for LCCs) and (log n)O(log log n) (for LTCs). In addition to having small query complexity, our codes also achieve better tradeoffs between the rate and the relative distance than were previously known to be achievable by LCCs or LTCs. Specifically, over large (but constant size) alphabet, our codes approach the Singleton bound, that is, they have almost the best-possible relationship between their rate and distance. Over the binary alphabet, our codes meet the Zyablov bound. Such tradeoffs between the rate and the relative distance were previously not known for any o(n) query complexity. Our results on LCCs also immediately give locally decodable codes with the same parameters.

[1]  Carsten Lund,et al.  Proof verification and the intractability of approximation problems , 1992, FOCS 1992.

[2]  Atri Rudra,et al.  On the Robust Testability of Product of Codes , 2005, Electron. Colloquium Comput. Complex..

[3]  Prasad Raghavendra,et al.  A Note on Yekhanin's Locally Decodable Codes , 2007, Electron. Colloquium Comput. Complex..

[4]  Michael Viderman Strong LTCs with Inverse Poly-Log Rate and Constant Soundness , 2013, 2013 IEEE 54th Annual Symposium on Foundations of Computer Science.

[5]  Venkatesan Guruswami,et al.  Near-optimal linear-time codes for unique decoding and new list-decodable codes over smaller alphabets , 2002, STOC '02.

[6]  Or Meir Combinatorial Construction of Locally Testable Codes , 2009, SIAM J. Comput..

[7]  Rafail Ostrovsky,et al.  Local correctability of expander codes , 2013, Inf. Comput..

[8]  Ronald de Wolf,et al.  Improved Lower Bounds for Locally Decodable Codes and Private Information Retrieval , 2004, ICALP.

[9]  Avi Wigderson,et al.  Entropy waves, the zig-zag graph product, and new constant-degree expanders and extractors , 2000, Proceedings 41st Annual Symposium on Foundations of Computer Science.

[10]  Irit Dinur,et al.  The PCP theorem by gap amplification , 2006, STOC.

[11]  Noga Alon,et al.  Explicit construction of linear sized tolerant networks , 1988, Discret. Math..

[12]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[13]  Sanjeev Arora,et al.  Probabilistic checking of proofs: a new characterization of NP , 1998, JACM.

[14]  Klim Efremenko,et al.  3-Query Locally Decodable Codes of Subexponential Length , 2008 .

[15]  Eli Ben-Sasson,et al.  Robust locally testable codes and products of codes , 2004, Random Struct. Algorithms.

[16]  David P. Woodruff New Lower Bounds for General Locally Decodable Codes , 2007, Electron. Colloquium Comput. Complex..

[17]  Noga Alon,et al.  Construction of asymptotically good low-rate error-correcting codes through pseudo-random graphs , 1992, IEEE Trans. Inf. Theory.

[18]  Ronitt Rubinfeld,et al.  Robust Characterizations of Polynomials with Applications to Program Testing , 1996, SIAM J. Comput..

[19]  N. Alon,et al.  il , , lsoperimetric Inequalities for Graphs , and Superconcentrators , 1985 .

[20]  J. Dodziuk Difference equations, isoperimetric inequality and transience of certain random walks , 1984 .

[21]  Noga Alon,et al.  lambda1, Isoperimetric inequalities for graphs, and superconcentrators , 1985, J. Comb. Theory, Ser. B.

[22]  Madhu Sudan,et al.  Some improvements to total degree tests , 1995, Proceedings Third Israel Symposium on the Theory of Computing and Systems.

[23]  Or Meir,et al.  High-rate locally-correctable and locally-testable codes with sub-polynomial query complexity , 2016, STOC.

[24]  Manuel Blum,et al.  Self-testing/correcting with applications to numerical problems , 1990, STOC '90.

[25]  Oded Goldreich,et al.  Locally testable codes and PCPs of almost-linear length , 2006, JACM.

[26]  Luca Trevisan,et al.  List-decoding using the XOR lemma , 2003, 44th Annual IEEE Symposium on Foundations of Computer Science, 2003. Proceedings..

[27]  Manuel Blum,et al.  Designing programs that check their work , 1989, STOC '89.

[28]  Jonathan Katz,et al.  On the efficiency of local decoding procedures for error-correcting codes , 2000, STOC '00.

[29]  Eyal Kushilevitz,et al.  Private information retrieval , 1998, JACM.

[30]  Michael Viderman,et al.  Strong LTCs with Inverse Polylogarithmic Rate and Soundness , 2013, 2013 IEEE Conference on Computational Complexity.

[31]  Swastik Kopparty List-Decoding Multiplicity Codes , 2012, Theory Comput..

[32]  Eli Ben-Sasson,et al.  Tensor Products of Weakly Smooth Codes are Robust , 2008, Theory Comput..

[33]  E. Gilbert A comparison of signalling alphabets , 1952 .

[34]  Carsten Lund,et al.  Proof verification and the hardness of approximation problems , 1998, JACM.

[35]  G. David Forney,et al.  Generalized minimum distance decoding , 1966, IEEE Trans. Inf. Theory.

[36]  Noga Alon,et al.  Linear time erasure codes with nearly optimal recovery , 1995, Proceedings of IEEE 36th Annual Foundations of Computer Science.

[37]  Sergey Yekhanin,et al.  Towards 3-query locally decodable codes of subexponential length , 2008, JACM.

[38]  Yehuda Lindell Introduction to Coding Theory Lecture Notes , 2009 .

[39]  Venkatesan Guruswami,et al.  Linear-time encodable/decodable codes with near-optimal rate , 2005, IEEE Transactions on Information Theory.

[40]  Avi Wigderson,et al.  Robust local testability of tensor products of LDPC codes ? , 2006 .

[41]  Or Meir,et al.  Locally Correctable and Testable Codes Approaching the Singleton Bound , 2014, Electron. Colloquium Comput. Complex..

[42]  Or Meir,et al.  High-rate Locally-testable Codes with Quasi-polylogarithmic Query Complexity , 2015, Electron. Colloquium Comput. Complex..

[43]  Leonid A. Levin,et al.  Checking computations in polylogarithmic time , 1991, STOC '91.

[44]  Noam Nisan,et al.  BPP has subexponential time simulations unlessEXPTIME has publishable proofs , 1991, [1991] Proceedings of the Sixth Annual Structure in Complexity Theory Conference.

[45]  Michael Viderman A Combination of Testability and Decodability by Tensor Products , 2012, APPROX-RANDOM.

[46]  Eli Ben-Sasson,et al.  Short PCPs with Polylog Query Complexity , 2008, SIAM J. Comput..

[47]  Eli Ben-Sasson,et al.  Towards lower bounds on locally testable codes via density arguments , 2011, 2011 IEEE 26th Annual Conference on Computational Complexity.

[48]  Or Meir,et al.  The tensor product of two good codes is not necessarily robustly testable , 2012, Inf. Process. Lett..

[49]  Or Meir,et al.  On the rectangle method in proofs of robustness of tensor products , 2012, Inf. Process. Lett..

[50]  Alan Guo,et al.  New affine-invariant codes from lifting , 2012, ITCS '13.

[51]  N. Linial,et al.  Expander Graphs and their Applications , 2006 .

[52]  Irit Dinur,et al.  Dense Locally Testable Codes Cannot Have Constant Rate and Distance , 2010, APPROX-RANDOM.

[53]  Noga Alon,et al.  A linear time erasure-resilient code with nearly optimal recovery , 1996, IEEE Trans. Inf. Theory.

[54]  Zvi Galil,et al.  Explicit Constructions of Linear-Sized Superconcentrators , 1981, J. Comput. Syst. Sci..

[55]  Omer Reingold,et al.  Undirected connectivity in log-space , 2008, JACM.

[56]  Richard C. Singleton,et al.  Maximum distance q -nary codes , 1964, IEEE Trans. Inf. Theory.

[57]  Richard J. Lipton,et al.  Efficient Checking of Computations , 1990, STACS.

[58]  F. Moore,et al.  Polynomial Codes Over Certain Finite Fields , 2017 .

[59]  Paul Valiant,et al.  The Tensor Product of Two Codes Is Not Necessarily Robustly Testable , 2005, APPROX-RANDOM.

[60]  Richard W. Hamming,et al.  Error detecting and error correcting codes , 1950 .

[61]  Venkatesan Guruswami,et al.  Explicit Codes Achieving List Decoding Capacity: Error-Correction With Optimal Redundancy , 2005, IEEE Transactions on Information Theory.

[62]  Eli Ben-Sasson,et al.  Composition of semi-LTCs by two-wise tensor products , 2009, computational complexity.

[63]  Oded Goldreich,et al.  Bravely, Moderately: A Common Theme in Four Recent Works , 2011, Studies in Complexity and Cryptography.

[64]  Sergey Yekhanin,et al.  Locally Decodable Codes From Nice Subsets of Finite Fields and Prime Factors of Mersenne Numbers , 2007, 2008 23rd Annual IEEE Conference on Computational Complexity.

[65]  Shubhangi Saraf,et al.  High-rate codes with sublinear-time decoding , 2014, Electron. Colloquium Comput. Complex..

[66]  Shubhangi Saraf,et al.  Locally Decodable Codes , 2016, Encyclopedia of Algorithms.

[67]  Swastik Kopparty Some remarks on multiplicity codes , 2013, Discrete Geometry and Algebraic Combinatorics.

[68]  Luca Trevisan,et al.  Pseudorandom generators without the XOR Lemma , 1999, Electron. Colloquium Comput. Complex..

[69]  Brett Hemenway,et al.  Linear-Time List Recovery of High-Rate Expander Codes , 2015, ICALP.