Symmetric LDPC codes and local testing

Coding theoretic and complexity theoretic considerations naturally lead to the question of generating symmetric, sparse, redundant linear systems. This paper provides new way of constructions with better parameters and new lower bounds. Low Density Parity Check (LDPC) codes are linear codes defined by short constraints (a property essential for local testing of a code). Some of the best (theoretically and practically) used codes are LDPC. Symmetric codes are those in which all coordinates "look the same", namely there is some transitive group acting on the coordinates which preserves the code. Some of the most commonly used locally testable codes (especially in PCPs and other proof systems), including all "low-degree" codes, are symmetric. Requiring that a symmetric binary code of length n has large (linear or near-linear) distance seems to suggest a "conflict" between 1/rate and density (constraint length). In known constructions, if one is constant then the other is almost worst possible - n/poly(log n). Our main positive result simultaneously achieves symmetric low density, constant rate codes generated by a single constraint. We present an explicit construction of a symmetric and transitive binary code of length n, near-linear distance n/(log log n)2, of constant rate and with constraints of length (log n)4. The construction is in the spirit of Tanner codes, namely the codewords are indexed by the edges of a sparse regular expander graph. The main novelty is in our construction of a transitive (non Abelian!) group acting on these edges which preserves the code. Our construction is one instantiation of a framework we call Cayley Codes developed here, that may be viewed as extending zig-zag product to symmetric codes. Our main negative result is that the parameters obtained above cannot be significantly improved, as long as the acting group is solvable (like the one we use). More specifically, we show that in constant rate and linear distance codes (aka "good" codes) invariant under solvable groups, the density (length of generating constraints) cannot go down to a constant, and is bounded below by log(ω(l)) n if the group has a derived series of length l This negative result precludes natural local tests with constantly many queries for such solvable "good" codes.

[1]  Madhu Sudan,et al.  Succinct Representation of Codes with Applications to Testing , 2009, SIAM J. Discret. Math..

[2]  A. Lubotzky,et al.  RAMANUJAN COMPLEXES OF TYPE Ad , 2007 .

[3]  Luca Trevisan,et al.  Pseudorandom generators without the XOR Lemma , 1999, Electron. Colloquium Comput. Complex..

[4]  Marc Lackenby,et al.  Large groups, property (τ) and the homology growth of subgroups , 2009, Mathematical Proceedings of the Cambridge Philosophical Society.

[5]  Irit Dinur,et al.  The PCP theorem by gap amplification , 2006, STOC.

[6]  Daniel A. Spielman,et al.  Improved low-density parity-check codes using irregular graphs and belief propagation , 1998, Proceedings. 1998 IEEE International Symposium on Information Theory (Cat. No.98CH36252).

[7]  Robert Michael Tanner,et al.  A recursive approach to low complexity codes , 1981, IEEE Trans. Inf. Theory.

[8]  Carsten Lund,et al.  Non-deterministic exponential time has two-prover interactive protocols , 2005, computational complexity.

[9]  Eli Ben-Sasson,et al.  Randomness-efficient low degree tests and short PCPs via epsilon-biased sets , 2003, STOC '03.

[10]  Avi Wigderson,et al.  Randomness conductors and constant-degree lossless expanders , 2002, STOC '02.

[11]  Benjamin Weiss,et al.  Groups and Expanders , 1992, Expanding Graphs.

[12]  Wolfgang M. Schmidt,et al.  Bounds for exponential sums , 1984 .

[13]  Marc Lackenby Covering spaces of 3-orbifolds , 2005 .

[14]  Klaus Jansen,et al.  Approximation, Randomization, and Combinatorial Optimization. Algorithms and Techniques , 2006, Lecture Notes in Computer Science.

[15]  Omer Reingold,et al.  Randomness Conductors and Constant-Degree Expansion Beyond the Degree / 2 Barrier , 2001 .

[16]  Simon Litsyn,et al.  Almost orthogonal linear codes are locally testable , 2005, 46th Annual IEEE Symposium on Foundations of Computer Science (FOCS'05).

[17]  D. Spielman,et al.  Expander codes , 1996 .

[18]  GoldreichOded,et al.  Locally testable codes and PCPs of almost-linear length , 2006 .

[19]  A. Weil Sur les courbes algébriques et les variétés qui s'en déduisent , 1948 .

[20]  O. Antoine,et al.  Theory of Error-correcting Codes , 2022 .

[21]  Madhu Sudan,et al.  Algebraic property testing: the role of invariance , 2008, Electron. Colloquium Comput. Complex..

[22]  Derek Allan Holton,et al.  The Petersen graph , 1993, Australian mathematical society lecture series.

[23]  Or Meir Combinatorial Construction of Locally Testable Codes , 2009, SIAM J. Comput..

[24]  Moni Naor,et al.  Small-bias probability spaces: efficient constructions and applications , 1990, STOC '90.

[25]  Ronitt Rubinfeld,et al.  Robust Characterizations of Polynomials with Applications to Program Testing , 1996, SIAM J. Comput..

[26]  Avi Wigderson,et al.  Expanders In Group Algebras , 2004, Comb..

[27]  Noga Alon,et al.  Testing Low-Degree Polynomials over GF(2( , 2003, RANDOM-APPROX.

[28]  Alexander Lubotzky,et al.  Explicit constructions of Ramanujan complexes of type , 2005, Eur. J. Comb..

[29]  Tali Kaufman,et al.  Edge transitive ramanujan graphs and symmetric LDPC good codes , 2012, STOC '12.

[30]  Eli Ben-Sasson,et al.  Simple PCPs with poly-log rate and query complexity , 2005, STOC '05.

[31]  Rüdiger L. Urbanke,et al.  The capacity of low-density parity-check codes under message-passing decoding , 2001, IEEE Trans. Inf. Theory.

[32]  Eli Ben-Sasson,et al.  Some 3CNF properties are hard to test , 2003, STOC '03.

[33]  Madhu Sudan,et al.  Improved Low-Degree Testing and its Applications , 1997, STOC '97.

[34]  S. Berman Semisimple cyclic and Abelian codes. II , 1967 .

[35]  Robert J. McEliece On the symmetry of good nonlinear codes , 1970, IEEE Trans. Inf. Theory.

[36]  A. Lubotzky,et al.  Explicit constructions of Ramanujan complexes of type Ãd , 2005, Eur. J. Comb..

[37]  E. Ben-Sasson,et al.  CNF Properties are Hard to Test , 2002 .

[38]  Manuel Blum,et al.  Self-testing/correcting with applications to numerical problems , 1990, STOC '90.

[39]  Noga Alon,et al.  Semi-direct product in groups and zig-zag product in graphs: connections and applications , 2001, Proceedings 2001 IEEE International Conference on Cluster Computing.

[40]  Or Meir,et al.  Combinatorial construction of locally testable codes , 2008, SIAM J. Comput..

[41]  Avi Wigderson,et al.  A new family of Cayley expanders (?) , 2004, STOC '04.

[42]  Robert G. Gallager,et al.  Low-density parity-check codes , 1962, IRE Trans. Inf. Theory.

[43]  A. Wigderson,et al.  ENTROPY WAVES, THE ZIG-ZAG GRAPH PRODUCT, AND NEW CONSTANT-DEGREE , 2004, math/0406038.

[44]  Noga Alon,et al.  Testing Reed-Muller codes , 2005, IEEE Transactions on Information Theory.

[45]  László Babai,et al.  Locally testable cyclic codes , 2003, 44th Annual IEEE Symposium on Foundations of Computer Science, 2003. Proceedings..