Random arithmetic formulas can be reconstructed efficiently

Informally stated, we present here a randomized algorithm that given black-box access to the polynomial f computed by an unknown/hidden arithmetic formula ϕ reconstructs, on the average, an equivalent or smaller formula $${\hat{\phi}}$$ϕ^ in time polynomial in the size of its output $${\hat{\phi}}$$ϕ^.Specifically, we consider arithmetic formulas wherein the underlying tree is a complete binary tree, the leaf nodes are labeled by affine forms (i.e., degree one polynomials) over the input variables and where the internal nodes consist of alternating layers of addition and multiplication gates. We call these alternating normal form (ANF) formulas. If a polynomial f can be computed by an arithmetic formula μ of size s, it can also be computed by an ANF formula ϕ, possibly of slightly larger size sO(1). Our algorithm gets as input black-box access to the output polynomial f (i.e., for any point x in the domain, it can query the black box and obtain f(x) in one step) of a random ANF formula ϕ of size s (wherein the coefficients of the affine forms in the leaf nodes of ϕ are chosen independently and uniformly at random from a large enough subset of the underlying field). With high probability (over the choice of coefficients in the leaf nodes), the algorithm efficiently (i.e., in time sO(1)) computes an ANF formula $${\hat{\phi}}$$ϕ^ of size s computing f. This then is the strongest model of arithmetic computation for which a reconstruction algorithm is presently known, albeit efficient in a distributional sense rather than in the worst case.

[1]  Daniel Lazard,et al.  Solving systems of algebraic equations , 2001, SIGS.

[2]  David Buchfuhrer,et al.  The complexity of Boolean formula minimization , 2008, J. Comput. Syst. Sci..

[3]  Teo Mora,et al.  Local Decomposition Algorithms , 1990, AAECC.

[4]  Grete Hermann,et al.  Die Frage der endlich vielen Schritte in der Theorie der Polynomideale , 1926 .

[5]  Teresa Krick,et al.  Membership problem, Representation problem and the Computation of the Radical for one-dimensional Ideals , 1991 .

[6]  Lance Fortnow,et al.  Efficient Learning Algorithms Yield Circuit Lower Bounds , 2006, COLT.

[7]  Adam R. Klivans,et al.  Learning Arithmetic Circuits via Partial Derivatives , 2003, COLT.

[8]  Andrew Wan,et al.  Mansour's Conjecture is True for Random DNF Formulas , 2010, COLT.

[9]  S. Comput,et al.  POLYNOMIAL-TIME REDUCTIONS FROM MULTIVARIATE TO BI- AND UNIVARIATE INTEGRAL POLYNOMIAL FACTORIZATION* , 1985 .

[10]  Neeraj Kayal,et al.  Affine projections of polynomials , 2011, Electron. Colloquium Comput. Complex..

[11]  David A. Cox,et al.  Ideals, Varieties, and Algorithms: An Introduction to Computational Algebraic Geometry and Commutative Algebra, 3/e (Undergraduate Texts in Mathematics) , 2007 .

[12]  J. Kollár Sharp effective Nullstellensatz , 1988 .

[13]  Daniel Lazard,et al.  Resolution des Systemes d'Equations Algebriques , 1981, Theor. Comput. Sci..

[14]  Erich Kaltofen,et al.  Improved Sparse Multivariate Polynomial Interpolation Algorithms , 1988, ISSAC.

[15]  Erich Kaltofen,et al.  Factorization of Polynomials Given by Straight-Line Programs , 1989, Adv. Comput. Res..

[16]  Eyal Kushilevitz,et al.  Learning functions represented as multiplicity automata , 2000, JACM.

[17]  Neeraj Kayal,et al.  Random Arithmetic Formulas Can Be Reconstructed Efficiently , 2013, Computational Complexity Conference.

[18]  Linda Sellie,et al.  Exact learning of random DNF over the uniform distribution , 2009, STOC '09.

[19]  Richard Zippel,et al.  Interpolating Polynomials from Their Values , 1990, J. Symb. Comput..

[20]  Gerhard Pfister,et al.  Primary Decomposition: Algorithms and Comparisons , 1997, Algorithmic Algebra and Number Theory.

[21]  Joachim von zur Gathen Permanent and determinant , 1987 .

[22]  Stasys Jukna,et al.  Boolean Function Complexity Advances and Frontiers , 2012, Bull. EATCS.

[23]  David A. Cox,et al.  Ideals, Varieties, and Algorithms , 1997 .

[24]  Bjorn Poonen,et al.  Automorphisms mapping a point into a subvariety , 2009, 0902.3571.

[25]  Amir Yehudayoff,et al.  Arithmetic Circuits: A survey of recent results and open questions , 2010, Found. Trends Theor. Comput. Sci..

[26]  Gian-Carlo Rota,et al.  Apolarity and Canonical Forms for Homogeneous Polynomials , 1993, Eur. J. Comb..

[27]  Satyanarayana V. Lokam,et al.  Efficient Reconstruction of Random Multilinear Formulas , 2011, 2011 IEEE 52nd Annual Symposium on Foundations of Computer Science.

[28]  Toniann Pitassi,et al.  Proceedings of the 44th Symposium on Theory of Computing Conference, STOC 2012, New York, NY, USA, May 19 - 22, 2012 , 2012, STOC.

[29]  M. Ben-Or,et al.  A Deterministic Algorithm for Sparse Multivariate Polynominal Interpolation (Extended Abstract) , 1988, Symposium on the Theory of Computing.

[30]  Johan Håstad,et al.  Tensor Rank is NP-Complete , 1989, ICALP.

[31]  T. Mignon,et al.  A quadratic bound for the determinant and permanent problem , 2004 .

[32]  Chee-Keng Yap,et al.  Fundamental problems of algorithmic algebra , 1999 .

[33]  Matthias Aschenbrenner Ideal membership in polynomial rings over the integers , 2003, math/0305172.

[34]  Grete Hermann,et al.  The question of finitely many steps in polynomial ideal theory , 1998, SIGS.

[35]  Neeraj Kayal Affine projections of polynomials: extended abstract , 2012, STOC '12.

[36]  Amir Shpilka,et al.  Reconstruction of Generalized Depth-3 Arithmetic Circuits with Bounded Top Fan-in , 2009, 2009 24th Annual IEEE Conference on Computational Complexity.

[37]  Erich Kaltofen,et al.  Computing with polynomials given by black boxes for their evaluations: greatest common divisors, factorization, separation of numerators and denominators , 1988, [Proceedings 1988] 29th Annual Symposium on Foundations of Computer Science.

[38]  Jin-Yi Cai,et al.  Circuit minimization problem , 2000, STOC '00.

[39]  Juan Sabia,et al.  Effective equidimensional decomposition of affine varieties , 2002 .

[40]  Daniel A. Spielman,et al.  Randomness efficient identity testing of multivariate polynomials , 2001, STOC '01.

[41]  Yishay Mansour,et al.  Learning Boolean Functions via the Fourier Transform , 1994 .

[42]  Joe W. Harris,et al.  Algebraic Geometry: A First Course , 1995 .

[43]  Erich Kaltofen,et al.  Computing with Polynomials Given By Black Boxes for Their Evaluations: Greatest Common Divisors, Factorization, Separation of Numerators and Denominators , 1990, J. Symb. Comput..

[44]  Michael Ben-Or,et al.  A deterministic algorithm for sparse multivariate polynomial interpolation , 1988, STOC '88.

[45]  Thomas W. Dubé A Combinatorial Proof of the Effective Nullstellensatz , 1993, J. Symb. Comput..

[46]  Nader H. Bshouty,et al.  Interpolating Arithmetic Read-Once Formulas in Parallel , 1998, SIAM J. Comput..

[47]  G. Greuel,et al.  A Singular Introduction to Commutative Algebra , 2002 .

[48]  K. Kalorkoti,et al.  A Lower Bound for the Formula Size of Rational Functions , 1982, SIAM J. Comput..

[49]  Michael E. Saks,et al.  Minimizing Disjunctive Normal Form Formulas and AC0 Circuits Given a Truth Table , 2008, SIAM J. Comput..

[50]  David Zuckerman Proceedings of the 30th Conference on Computational Complexity , 2015 .

[51]  Neeraj Kayal,et al.  Approaching the Chasm at Depth Four , 2013, 2013 IEEE Conference on Computational Complexity.

[52]  Vikraman Arvind,et al.  New Results on Noncommutative and Commutative Polynomial Identity Testing , 2008, 2008 23rd Annual IEEE Conference on Computational Complexity.

[53]  Satyanarayana V. Lokam,et al.  Reconstruction of depth-4 multilinear circuits with top fan-in 2 , 2012, STOC '12.

[54]  Amir Shpilka Interpolation of depth-3 arithmetic circuits with two multiplication gates , 2007, STOC '07.

[55]  Heinz Kredel,et al.  Gröbner Bases: A Computational Approach to Commutative Algebra , 1993 .

[56]  Neeraj Kayal,et al.  Efficient algorithms for some special cases of the polynomial equivalence problem , 2011, SODA '11.

[57]  Daniel Lazard,et al.  Thirty years of Polynomial System Solving, and now? , 2009, J. Symb. Comput..

[58]  Nader H. Bshouty,et al.  Size-depth tradeoffs for algebraic formulae , 1991, [1991] Proceedings 32nd Annual Symposium of Foundations of Computer Science.