Lower Bounds for Non-Commutative Skew Circuits

Nisan (STOC 1991) exhibited a polynomial which is computable by linear sized noncommutative circuits but requires exponential sized non-commutative algebraic branching programs. Nisan’s hard polynomial is in fact computable by linear sized skew circuits (skew circuits are circuits where every multiplication gate has the property that all but one of its children is an input variable or a scalar). We prove that any non-commutative skew circuit which computes the square of the polynomial defined by Nisan must have exponential size. As a further step towards proving exponential lower bounds for general non-commutative circuits, we also extend our techniques to prove an exponential lower bound for a class of circuits which is a restriction of general non-commutative circuits and a generalization of non-commutative skew circuits. More precisely, we consider non-commutative circuits of small non-skew depth, which denotes the maximum number of non-skew gates on any path from the output gate to an input gate. We show that for any k < d, there is an explicit polynomial of degree d over n variables that has non-commutative circuits of polynomial size but such that any circuit with non-skew depth k must have size at least n. It is not hard to see that any polynomial of degree d that has polynomial size circuits has a polynomial-sized circuit with non-skew depth d. Hence, our results should be interpreted as proving lower bounds for the class of circuits with non-trivially small non-skew depth. As far as we know, this is the strongest model of non-commutative computation for which we have superpolynomial lower bounds.

[1]  Shachar Lovett,et al.  Correlation bounds for poly-size AC 0 circuits with n 1-o(1) symmetric gates , 2011 .

[2]  Amir Yehudayoff,et al.  Arithmetic Circuits: A survey of recent results and open questions , 2010, Found. Trends Theor. Comput. Sci..

[3]  Laurent Hyafil The power of commutativity , 1977, 18th Annual Symposium on Foundations of Computer Science (sfcs 1977).

[4]  Guillaume Malod,et al.  Characterizing Valiant's algebraic complexity classes , 2008, J. Complex..

[5]  Ran Raz,et al.  Balancing Syntactically Multilinear Arithmetic Circuits , 2008, computational complexity.

[6]  Meena Mahajan,et al.  Non-Commutative Arithmetic Circuits: Depth Reduction and Size Lower Bounds , 1998, Theor. Comput. Sci..

[7]  Alexander Barvinok,et al.  New Permanent Estimators via Non-Commutative Determinants , 2000 .

[8]  J. M. Landsberg,et al.  An Overview of Mathematical Issues Arising in the Geometric Complexity Theory Approach to VP≠VNP , 2009, SIAM J. Comput..

[9]  Richard Beigel When do extra majority gates help? Polylog (N) majority gates are equivalent to one , 2005, computational complexity.

[10]  Ran Raz,et al.  Lower Bounds and Separations for Constant Depth Multilinear Circuits , 2008, Computational Complexity Conference.

[11]  A. Wigderson,et al.  Partial Derivatives in Arithmetic Complexity and Beyond (Foundations and Trends(R) in Theoretical Computer Science) , 2011 .

[12]  Avi Wigderson,et al.  Relationless Completeness and Separations , 2010, 2010 IEEE 25th Annual Conference on Computational Complexity.

[13]  Avi Wigderson,et al.  Non-commutative circuits and the sum-of-squares problem , 2010, STOC '10.

[14]  Kristoffer Arnsfelt Hansen,et al.  Lower Bounds for Circuits with Few Modular and Symmetric Gates , 2005, ICALP.

[15]  Noam Nisan,et al.  Lower bounds on arithmetic circuits via partial derivatives , 2005, computational complexity.

[16]  Meena Mahajan,et al.  Small Space Analogues of Valiant’s Classes and the Limitations of Skew Formulas , 2011, computational complexity.

[17]  Seinosuke Toda,et al.  Classes of Arithmetic Circuits Capturing the Complexity of Computing the Determinant , 1992 .

[18]  Ran Raz,et al.  Multi-linear formulas for permanent and determinant are of super-polynomial size , 2004, STOC '04.

[19]  N. Nisan Lower Bounds for Non-Commutative Computation (Extended Abstract) , 1991, STOC 1991.

[20]  Steve Chien,et al.  Clifford algebras and approximating the permanent , 2002, STOC '02.

[21]  Ran Raz,et al.  A Lower Bound for the Size of Syntactically Multilinear Arithmetic Circuits , 2007, 48th Annual IEEE Symposium on Foundations of Computer Science (FOCS'07).

[22]  Avi Wigderson,et al.  Partial Derivatives in Arithmetic Complexity and Beyond , 2011, Found. Trends Theor. Comput. Sci..

[23]  Jacob T. Schwartz,et al.  Fast Probabilistic Algorithms for Verification of Polynomial Identities , 1980, J. ACM.

[24]  R. Stephenson A and V , 1962, The British journal of ophthalmology.

[25]  Zeev Dvir,et al.  Separating multilinear branching programs and formulas , 2012, STOC '12.