Barriers for fast matrix multiplication from irreversibility

Determining the asymptotic algebraic complexity of matrix multiplication, succinctly represented by the matrix multiplication exponent ω, is a central problem in algebraic complexity theory. The best upper bounds on ω, leading to the state-of-the-art ω ≤ 2.37.., have been obtained via the laser method of Strassen and its generalization by Coppersmith and Winograd. Recent barrier results show limitations for these and related approaches to improve the upper bound on ω. We introduce a new and more general barrier, providing stronger limitations than in previous work. Concretely, we introduce the notion of "irreversibility" of a tensor and we prove (in some precise sense) that any approach that uses an irreversible tensor in an intermediate step (e.g., as a starting tensor in the laser method) cannot give ω = 2. In quantitative terms, we prove that the best upper bound achievable is lower bounded by two times the irreversibility of the intermediate tensor. The quantum functionals and Strassen support functionals give (so far, the best) lower bounds on irreversibility. We provide lower bounds on the irreversibility of key intermediate tensors, including the small and big Coppersmith-Winograd tensors, that improve limitations shown in previous work. Finally, we discuss barriers on the group-theoretic approach in terms of "monomial" irreversibility.

[1]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[2]  Charles H. Bennett,et al.  Exact and asymptotic measures of multipartite pure-state entanglement , 1999, Physical Review A.

[3]  Matthias Christandl,et al.  Asymptotic entanglement transformation between W and GHZ states , 2013, 1310.3244.

[4]  B. M. Fulk MATH , 1992 .

[5]  Josh Alman,et al.  Limits on All Known (and Some Unknown) Approaches to Matrix Multiplication , 2018, 2018 IEEE 59th Annual Symposium on Foundations of Computer Science (FOCS).

[6]  Don Coppersmith,et al.  Matrix multiplication via arithmetic progressions , 1987, STOC.

[7]  October I Physical Review Letters , 2022 .

[8]  Josh Alman,et al.  Limits on the Universal method for matrix multiplication , 2018, CCC.

[9]  J. M. Landsberg,et al.  Abelian Tensors , 2015, ArXiv.

[10]  V. Strassen Algebra and Complexity , 1994 .

[11]  Matthias Christandl,et al.  Universal points in the asymptotic spectrum of tensors , 2017, STOC.

[12]  V. Strassen The asymptotic spectrum of tensors. , 1988 .

[13]  B. Moor,et al.  Four qubits can be entangled in nine different ways , 2001, quant-ph/0109033.

[14]  A. J. Stothers On the complexity of matrix multiplication , 2010 .

[15]  V. Strassen,et al.  Degeneration and complexity of bilinear maps: Some asymptotic spectra. , 1991 .

[16]  R. Lathe Phd by thesis , 1988, Nature.

[17]  François Le Gall,et al.  Powers of tensors and fast matrix multiplication , 2014, ISSAC.

[18]  Joshua A. Grochow,et al.  On cap sets and the group-theoretic approach to matrix multiplication , 2016, ArXiv.

[19]  G. Pólya,et al.  Series, integral calculus, theory of functions , 1998 .

[20]  V. Strassen Gaussian elimination is not optimal , 1969 .

[21]  Matthias Christandl,et al.  Barriers for rectangular matrix multiplication , 2020, Electron. Colloquium Comput. Complex..

[22]  Runyao Duan,et al.  Obtaining a W state from a Greenberger-Horne-Zeilinger state via stochastic local operations and classical communication with a rate approaching unity. , 2014, Physical review letters.

[23]  Jordan S. Ellenberg,et al.  On large subsets of $F_q^n$ with no three-term arithmetic progression , 2016 .

[24]  Christopher Umans,et al.  A group-theoretic approach to fast matrix multiplication , 2003, 44th Annual IEEE Symposium on Foundations of Computer Science, 2003. Proceedings..

[25]  Andris Ambainis,et al.  Fast Matrix Multiplication: Limitations of the Coppersmith-Winograd Method , 2014, STOC.

[26]  Christopher Umans,et al.  Fast matrix multiplication using coherent configurations , 2012, SODA.

[27]  Volker Strassen,et al.  Algebraic Complexity Theory , 1991, Handbook of Theoretical Computer Science, Volume A: Algorithms and Complexity.

[28]  F. Behrend On Sets of Integers Which Contain No Three Terms in Arithmetical Progression. , 1946, Proceedings of the National Academy of Sciences of the United States of America.

[29]  Kosaku Nagasaka,et al.  Proceedings of the 39th International Symposium on Symbolic and Algebraic Computation , 2014, ISSAC 2014.

[30]  Joshua A. Grochow,et al.  Which groups are amenable to proving exponent two for matrix multiplication? , 2017, ArXiv.

[31]  Josh Alman,et al.  Further Limitations of the Known Approaches for Matrix Multiplication , 2017, ITCS.

[32]  Swastik Kopparty,et al.  Geometric rank of tensors and subrank of matrix multiplication , 2020, Electron. Colloquium Comput. Complex..

[33]  I. G. BONNER CLAPPISON Editor , 1960, The Electric Power Engineering Handbook - Five Volume Set.

[34]  G. Pólya,et al.  Problems and theorems in analysis , 1983 .

[35]  Journal de Mathématiques pures et appliquées , 1892 .

[36]  J. Cirac,et al.  Three qubits can be entangled in two inequivalent ways , 2000, quant-ph/0005115.

[37]  Will Sawin Bounds for Matchings in Nonabelian Groups , 2018, Electron. J. Comb..

[38]  Virginia Vassilevska Williams,et al.  Multiplying matrices faster than coppersmith-winograd , 2012, STOC '12.

[39]  V. Strassen Relative bilinear complexity and matrix multiplication. , 1987 .

[40]  Matthias Christandl,et al.  Asymptotic tensor rank of graph tensors: beyond matrix multiplication , 2016, computational complexity.