The complexity of computing (almost) orthogonal matrices with ε-copies of the Fourier transform

Abstract The complexity of computing the Fourier transform is a longstanding open problem. Very recently, Ailon (2013, 2014, 2015) showed in a collection of papers that, roughly speaking, a speedup of the Fourier transform computation implies numerical ill-condition. The papers also quantify this tradeoff. The main method for proving these results is via a potential function called quasi-entropy, reminiscent of Shannon entropy. The quasi-entropy method opens new doors to understanding the computational complexity of the important Fourier transformation. However, it suffers from various obvious limitations. This paper is motivated by one such limitation, related to the computation of near-orthogonal matrices that have the Fourier transform ‘hidden’ in low-order bits. While partly overcoming this limitation, the paper sheds light on new interesting, open problems on the intersection of computational complexity and group theory. The paper also explains why this research direction, if fruitful, has a chance of solving much bigger questions about the complexity of the Fourier transform.

[1]  Tamás Sarlós,et al.  Improved Approximation Algorithms for Large Matrices via Random Projections , 2006, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06).

[2]  Nir Ailon Tighter Fourier Transform Lower Bounds , 2015, ICALP.

[3]  Christos H. Papadimitriou,et al.  Optimality of the Fast Fourier transform , 1979, JACM.

[4]  Guy Kindler,et al.  Testing juntas [combinatorial property testing] , 2002, The 43rd Annual IEEE Symposium on Foundations of Computer Science, 2002. Proceedings..

[5]  Christos Boutsidis,et al.  Improved Matrix Algorithms via the Subsampled Randomized Hadamard Transform , 2012, SIAM J. Matrix Anal. Appl..

[6]  Nir Ailon,et al.  A Lower Bound for Fourier Transform Computation in a Linear Model Over 2x2 Unitary Gates Using Matrix Entropy , 2013, Chic. J. Theor. Comput. Sci..

[7]  Jacques Morgenstern,et al.  Note on a Lower Bound on the Linear Complexity of the Fast Fourier Transform , 1973, JACM.

[8]  Ryan O'Donnell,et al.  Testing properties of boolean functions , 2012 .

[9]  V. Ralph Algazi,et al.  Unified Matrix Treatment of the Fast Walsh-Hadamard Transform , 1976, IEEE Transactions on Computers.

[10]  Nir Ailon,et al.  Paraunitary Matrices, Entropy, Algebraic Condition Number and Fourier Computation , 2016, Theor. Comput. Sci..

[11]  Martin Fürer Faster integer multiplication , 2007, STOC '07.

[12]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[13]  J. Tukey,et al.  An algorithm for the machine calculation of complex Fourier series , 1965 .

[14]  Sivan Toledo,et al.  Blendenpik: Supercharging LAPACK's Least-Squares Solver , 2010, SIAM J. Sci. Comput..

[15]  Douglas F. Elliott,et al.  Handbook of Digital Signal Processing: Engineering Applications , 1988 .

[16]  Yishay Mansour,et al.  Learning Boolean Functions via the Fourier Transform , 1994 .

[17]  Gene H. Golub,et al.  Matrix computations , 1983 .