Subexponential Size Hitting Sets for Bounded Depth Multilinear Formulas

In this paper, we give subexponential size hitting sets for bounded depth multilinear arithmetic formulas. Using the known relation between black-box PIT and lower bounds, we obtain lower bounds for these models.For depth-3 multilinear formulas, of size exp$${(n^\delta)}$$(nδ), we give a hitting set of size exp$${\left(\tilde{O}\left(n^{2/3 + 2\delta/3}\right) \right)}$$O~n2/3+2δ/3. This implies a lower bound of exp$${(\tilde{\Omega}(n^{1/2}))}$$(Ω~(n1/2)) for depth-3 multilinear formulas, for some explicit polynomial.For depth-4 multilinear formulas, of size exp$${(n^\delta)}$$(nδ), we give a hitting set of size exp$${\left(\tilde{O}\left(n^{2/3 + 4\delta/3}\right) \right)}$$O~n2/3+4δ/3. This implies a lower bound of exp$${(\tilde{\Omega}(n^{1/4}))}$$(Ω~(n1/4)) for depth-4 multilinear formulas, for some explicit polynomial.A regular formula consists of alternating layers of $${+,\times}$$+,× gates, where all gates at layer i have the same fan-in. We give a hitting set of size (roughly) exp$${\left(n^{1- \delta}\right)}$$n1-δ, for regular depth-d multilinear formulas with formal degree at most n and size exp$${(n^\delta)}$$(nδ), where $${\delta = O(1/{\sqrt{5}^d})}$$δ=O(1/5d). This result implies a lower bound of roughly exp$${(\tilde{\Omega}(n^{1/{\sqrt{5}^d}}))}$$(Ω~(n1/5d)) for such formulas.We note that better lower bounds are known for these models, but also that none of these bounds was achieved via construction of a hitting set. Moreover, no lower bound that implies such PIT results, even in the white-box model, is currently known.Our results are combinatorial in nature and rely on reducing the underlying formula, first to a depth-4 formula, and then to a read-once algebraic branching program (from depth-3 formulas, we go straight to read-once algebraic branching programs).

[1]  Amir Shpilka,et al.  Subexponential Size Hitting Sets for Bounded Depth Multilinear Formulas , 2015, Computational Complexity Conference.

[2]  Ilya Volkovich,et al.  Deterministic identity testing of depth-4 multilinear circuits with bounded top fan-in , 2010, STOC '10.

[3]  Ran Raz,et al.  Deterministic polynomial identity testing in non-commutative models , 2004, Proceedings. 19th IEEE Annual Conference on Computational Complexity, 2004..

[4]  Zeev Dvir,et al.  Locally Decodable Codes with Two Queries and Polynomial Identity Testing for Depth 3 Circuits , 2007, SIAM J. Comput..

[5]  Neeraj Kayal,et al.  A super-polynomial lower bound for regular arithmetic formulas , 2014, STOC.

[6]  Ran Raz,et al.  Lower Bounds and Separations for Constant Depth Multilinear Circuits , 2008, Computational Complexity Conference.

[7]  Richard J. Lipton,et al.  A Probabilistic Remark on Algebraic Program Testing , 1978, Inf. Process. Lett..

[8]  Nitin Saxena,et al.  Blackbox Identity Testing for Bounded Top-Fanin Depth-3 Circuits: The Field Doesn't Matter , 2012, SIAM J. Comput..

[9]  Ran Raz,et al.  Deterministic polynomial identity testing in non-commutative models , 2004, Proceedings. 19th IEEE Annual Conference on Computational Complexity, 2004..

[10]  Zeev Dvir,et al.  Hardness-Randomness Tradeoffs for Bounded Depth Arithmetic Circuits , 2009, SIAM J. Comput..

[11]  V. Vinay,et al.  Arithmetic Circuits: A Chasm at Depth Four , 2008, 2008 49th Annual IEEE Symposium on Foundations of Computer Science.

[12]  Neeraj Kayal,et al.  Arithmetic Circuits: A Chasm at Depth Three , 2013, 2013 IEEE 54th Annual Symposium on Foundations of Computer Science.

[13]  Shubhangi Saraf,et al.  Blackbox Polynomial Identity Testing for Depth 3 Circuits , 2009, 2009 50th Annual IEEE Symposium on Foundations of Computer Science.

[14]  Nitin Saxena,et al.  Quasi-polynomial hitting-set for set-depth-Δ formulas , 2012, STOC '13.

[15]  Amir Shpilka,et al.  On identity testing of tensors, low-rank recovery and compressed sensing , 2011, STOC '12.

[16]  Nitin Saxena,et al.  Deterministic Identity Testing for Sum of Read-Once Oblivious Arithmetic Branching Programs , 2014, computational complexity.

[17]  Ran Raz,et al.  A Lower Bound for the Size of Syntactically Multilinear Arithmetic Circuits , 2007, 48th Annual IEEE Symposium on Foundations of Computer Science (FOCS'07).

[18]  Noga Alon,et al.  The Probabilistic Method , 2015, Fundamentals of Ramsey Theory.

[19]  Ilya Volkovich,et al.  On the Relation between Polynomial Identity Testing and Finding Variable Disjoint Factors , 2010, ICALP.

[20]  Noam Nisan,et al.  Lower bounds for non-commutative computation , 1991, STOC '91.

[21]  Nitin Saxena,et al.  Jacobian hits circuits: hitting-sets, lower bounds for depth-D occur-k formulas & depth-3 transcendence degree-k circuits , 2011, STOC '12.

[22]  Noam Nisan,et al.  Lower bounds on arithmetic circuits via partial derivatives , 2005, computational complexity.

[23]  Joos Heintz,et al.  Testing polynomials which are easy to compute (Extended Abstract) , 1980, STOC '80.

[24]  Richard Zippel,et al.  Probabilistic algorithms for sparse polynomials , 1979, EUROSAM.

[25]  Nitin Saxena,et al.  Blackbox identity testing for bounded top fanin depth-3 circuits: the field doesn't matter , 2010, STOC '11.

[26]  Leslie G. Valiant,et al.  Fast Parallel Computation of Polynomials Using Few Processors , 1983, SIAM J. Comput..

[27]  Sébastien Tavenas,et al.  Improved bounds for reduction to depth 4 and depth 3 , 2013, Inf. Comput..

[28]  Manindra Agrawal,et al.  PRIMES is in P , 2004 .

[29]  N. Alon,et al.  The Probabilistic Method: Alon/Probabilistic , 2008 .

[30]  Manindra Agrawal,et al.  Proving Lower Bounds Via Pseudo-random Generators , 2005, FSTTCS.

[31]  Ilya Volkovich,et al.  Black-Box Identity Testing of Depth-4 Multilinear Circuits , 2011, Combinatorica.

[32]  Ilya Volkovich,et al.  Read-once polynomial identity testing , 2008, computational complexity.

[33]  Amir Shpilka,et al.  Black box polynomial identity testing of generalized depth-3 arithmetic circuits with bounded top fan-in , 2011, Comb..

[34]  Zeev Dvir,et al.  Hardness-randomness tradeoffs for bounded depth arithmetic circuits , 2008, SIAM J. Comput..

[35]  Zeev Dvir,et al.  Locally decodable codes with 2 queries and polynomial identity testing for depth 3 circuits , 2005, STOC '05.

[36]  Ran Raz,et al.  Multi-linear formulas for permanent and determinant are of super-polynomial size , 2004, STOC '04.

[37]  Nitin Saxena,et al.  Hitting-Sets for ROABP and Sum of Set-Multilinear Circuits , 2014, SIAM J. Comput..

[38]  Nitin Saxena,et al.  Quasi-polynomial Hitting-set for Set-depth-Delta Formulas , 2012, Electron. Colloquium Comput. Complex..

[39]  Amir Shpilka,et al.  Black box polynomial identity testing of generalized depth-3 arithmetic circuits with bounded top fan-in , 2008, 2008 23rd Annual IEEE Conference on Computational Complexity.

[40]  Amir Shpilka,et al.  Quasipolynomial-Time Identity Testing of Non-commutative and Read-Once Oblivious Algebraic Branching Programs , 2013, 2013 IEEE 54th Annual Symposium on Foundations of Computer Science.

[41]  Jacob T. Schwartz,et al.  Fast Probabilistic Algorithms for Verification of Polynomial Identities , 1980, J. ACM.

[42]  Ilya Volkovich,et al.  Derandomizing Polynomial Identity Testing for Multilinear Constant-Read Formulae , 2011, 2011 IEEE 26th Annual Conference on Computational Complexity.

[43]  Russell Impagliazzo,et al.  Derandomizing Polynomial Identity Tests Means Proving Circuit Lower Bounds , 2003, STOC '03.

[44]  Pascal Koiran,et al.  Arithmetic circuits: The chasm at depth four gets wider , 2010, Theor. Comput. Sci..

[45]  Amir Shpilka,et al.  Explicit Noether Normalization for Simultaneous Conjugation via Polynomial Identity Testing , 2013, APPROX-RANDOM.

[46]  Amir Yehudayoff,et al.  Arithmetic Circuits: A survey of recent results and open questions , 2010, Found. Trends Theor. Comput. Sci..

[47]  Ilya Volkovich,et al.  Improved Polynomial Identity Testing for Read-Once Formulas , 2009, APPROX-RANDOM.

[48]  Ran Raz,et al.  Separation of Multilinear Circuit and Formula Size , 2006, Theory Comput..

[49]  Ankit Gupta Algebraic Geometric Techniques for Depth-4 PIT & Sylvester-Gallai Conjectures for Varieties , 2014, Electron. Colloquium Comput. Complex..

[50]  Ramprasad Saptharishi,et al.  Hitting sets for multilinear read-once algebraic branching programs, in any order , 2014, STOC.

[51]  Neeraj Kayal,et al.  Polynomial Identity Testing for Depth 3 Circuits , 2006, 21st Annual IEEE Conference on Computational Complexity (CCC'06).