Dense Testers: Almost Linear Time and Locally Explicit Constructions

We develop a new notion called $(1-\epsilon)$-tester for a set $M$ of functions $f:A\to C$. A $(1-\epsilon)$-tester for $M$ maps each element $a\in A$ to a finite number of elements $B_a=\{b_1,\ldots,b_t\}\subset B$ in a smaller sub-domain $B\subset A$ where for every $f\in M$ if $f(a)\not=0$ then $f(b)\not=0$ for at least $(1-\epsilon)$ fraction of the elements $b$ of $B_a$. I.e., if $f(a)\not=0$ then $\Pr_{b\in B_a}[f(b)\not=0]\ge 1-\epsilon$. The {\it size} of the $(1-\epsilon)$-tester is $\max_{a\in A}|B_a|$ and the goal is to minimize this size, construct $B_a$ in deterministic almost linear time and access and compute each map in poly-log time. We use tools from elementary algebra and algebraic function fields to build $(1-\epsilon)$-testers of small size in deterministic almost linear time. We also show that our constructions are locally explicit, i.e., one can find any entry in the construction in time poly-log in the size of the construction and the field size. We also prove lower bounds that show that the sizes of our testers and the densities are almost optimal. Testers were used in [Bshouty, Testers and its application, ITCS 2014] to construct almost optimal perfect hash families, universal sets, cover-free families, separating hash functions, black box identity testing and hitting sets. The dense testers in this paper shows that such constructions can be done in almost linear time, are locally explicit and can be made to be dense.

[1]  Igor E. Shparlinski Finite Fields: Theory and Computation , 1999 .

[2]  Kenneth W. Shum,et al.  A low-complexity algorithm for the construction of algebraic-geometric codes better than the Gilbert-Varshamov bound , 2001, IEEE Trans. Inf. Theory.

[3]  Yuan Zhou Introduction to Coding Theory , 2010 .

[4]  Henning Stichtenoth,et al.  Topics in Geometry, Coding Theory and Cryptography (Algebra and Applications) , 2006 .

[5]  Robert Bix Topics in Geometry , 1993 .

[6]  K. Conrad,et al.  Finite Fields , 2018, Series and Products in the Development of Mathematics.

[7]  Stéphane Ballet,et al.  Curves with Many Points and Multiplication Complexity in Any Extension of Fq , 1999 .

[8]  Venkatesan Guruswami,et al.  Hitting Sets for Low-Degree Polynomials with Optimal Density , 2014, 2014 IEEE 29th Conference on Computational Complexity (CCC).

[9]  Victor Shoup,et al.  New algorithms for finding irreducible polynomials over finite fields , 1988, [Proceedings 1988] 29th Annual Symposium on Foundations of Computer Science.

[10]  Henning Stichtenoth,et al.  Algebraic function fields and codes , 1993, Universitext.

[11]  H. Lenstra Finding isomorphisms between finite fields , 1991 .

[12]  H. Perfect Topics in geometry , 1963 .

[13]  Rudolf Lide,et al.  Finite fields , 1983 .

[14]  Shirley Dex,et al.  JR 旅客販売総合システム(マルス)における運用及び管理について , 1991 .

[15]  H. Niederreiter,et al.  Finite Fields: Encyclopedia of Mathematics and Its Applications. , 1997 .

[16]  Alain Poli A Deterministic Constructin of Normal Bases With Complexity O(n³+n log n log(log n) log q) , 1995, J. Symb. Comput..

[17]  Nader H. Bshouty,et al.  Testers and their applications , 2014, ITCS.

[18]  Nader H. Bshouty Multilinear Complexity is Equivalent to Optimal Tester Size , 2013, Electron. Colloquium Comput. Complex..

[19]  H. Stichtenoth,et al.  On the Asymptotic Behaviour of Some Towers of Function Fields over Finite Fields , 1996 .