Hardness Amplification for Non-Commutative Arithmetic Circuits

We show that proving mildly super-linear lower bounds on non-commutative arithmetic circuits implies exponential lower bounds on non-commutative circuits. That is, non-commutative circuit complexity is a threshold phenomenon: an apparently weak lower bound actually suffices to show the strongest lower bounds we could desire. This is part of a recent line of inquiry into why arithmetic circuit complexity, despite being a heavily restricted version of Boolean complexity, still cannot prove super-linear lower bounds on general devices. One can view our work as positive news (it suffices to prove weak lower bounds to get strong ones) or negative news (it is as hard to prove weak lower bounds as it is to prove strong ones). We leave it to the reader to determine their own level of optimism.

[1]  V. Vinay,et al.  Arithmetic Circuits: A Chasm at Depth Four , 2008, 2008 49th Annual IEEE Symposium on Foundations of Computer Science.

[2]  Walter Baur,et al.  The Complexity of Partial Derivatives , 1983, Theor. Comput. Sci..

[3]  Vikraman Arvind,et al.  Noncommutative Valiant's Classes , 2015, ACM Trans. Comput. Theory.

[4]  François Le Gall,et al.  Powers of tensors and fast matrix multiplication , 2014, ISSAC.

[5]  Amir Yehudayoff,et al.  Arithmetic Circuits: A survey of recent results and open questions , 2010, Found. Trends Theor. Comput. Sci..

[6]  Pascal Koiran,et al.  Arithmetic circuits: The chasm at depth four gets wider , 2010, Theor. Comput. Sci..

[7]  Avi Wigderson,et al.  Barriers for Rank Methods in Arithmetic Complexity , 2017, Electron. Colloquium Comput. Complex..

[8]  J. van Leeuwen,et al.  Theoretical Computer Science , 2003, Lecture Notes in Computer Science.

[9]  Neeraj Kayal,et al.  Arithmetic Circuits: A Chasm at Depth 3 , 2016, SIAM J. Comput..

[10]  Avi Wigderson,et al.  Non-commutative circuits and the sum-of-squares problem , 2010, Symposium on the Theory of Computing.

[11]  Avi Wigderson,et al.  Relationless Completeness and Separations , 2010, 2010 IEEE 25th Annual Conference on Computational Complexity.

[12]  Kosaku Nagasaka,et al.  Proceedings of the 39th International Symposium on Symbolic and Algebraic Computation , 2014, ISSAC 2014.

[13]  Partha Mukhopadhyay,et al.  Randomized polynomial time identity testing for noncommutative circuits , 2016, STOC.

[14]  Noam Nisan,et al.  Lower bounds for non-commutative computation , 1991, STOC '91.

[15]  Michael E. Saks,et al.  Towards an algebraic natural proofs barrier via polynomial identity testing , 2017, Electron. Colloquium Comput. Complex..

[16]  Vikraman Arvind,et al.  On the hardness of the noncommutative determinant , 2009, STOC '10.

[17]  Amir Shpilka,et al.  Succinct hitting sets and barriers to proving algebraic circuits lower bounds , 2017, STOC.