Lower Bounds for Linear Decision Trees via an Energy Complexity Argument

A linear decision tree is a binary decision tree in which a classification rule at each internal node is defined by a linear threshold function. In this paper, we consider a linear decision tree T where the weights w1, w2, ...,wn of each linear threshold function satisfy Σi |wi| ≤ w for an integer w, and prove that if T computes an n-variable Boolean function of large unbounded-error communication complexity (such as the Inner-Product function modulo two), then T must have 2Ω(√n)/w leaves. To obtain the lower bound, we utilize a close relationship between the size of linear decision trees and the energy complexity of threshold circuits; the energy of a threshold circuit C is defined to be the maximum number of gates outputting "1," where the maximum is taken over all inputs to C. In addition, we consider threshold circuits of depth ω(1) and bounded energy, and provide two exponential lower bounds on the size (i.e., the number of gates) of such circuits.

[1]  Wolfgang Maass,et al.  On the Computational Power of Threshold Circuits with Sparse Activity , 2006, Neural Computation.

[2]  Jürgen Forster A linear lower bound on the unbounded error probabilistic communication complexity , 2002, J. Comput. Syst. Sci..

[3]  Rudolf Fleischer,et al.  Decision Trees: Old and New Results , 1999, Inf. Comput..

[4]  A. Yao,et al.  An exponential lower bound on the size of algebraic decision trees for Max , 1998, computational complexity.

[5]  Xiao Zhou,et al.  Energy-Efficient Threshold Circuits Computing mod Functions , 2013, Int. J. Found. Comput. Sci..

[6]  Richard J. Lipton,et al.  On the Complexity of Computations under Varying Sets of Primitives , 1975, J. Comput. Syst. Sci..

[7]  László Lovász,et al.  Linear decision trees: volume estimates and topological bounds , 1992, STOC '92.

[8]  Akira Maruoka,et al.  On the Complexity of Depth-2 Circuits with Threshold Gates , 2005, MFCS.

[9]  Eiji Takimoto,et al.  Exponential lower bounds on the size of constant-depth threshold circuits with small energy complexity , 2008, Theor. Comput. Sci..

[10]  Satyanarayana V. Lokam,et al.  Relations Between Communication Complexity, Linear Arrangements, and Computational Complexity , 2001, FSTTCS.

[11]  J. Michael Steele,et al.  Lower Bounds for Algebraic Decision Trees , 1982, J. Algorithms.

[12]  A. Pasquali,et al.  On the Convergence of Nonlinear Simulaneous Displacements , 1969, J. Comput. Syst. Sci..

[13]  Eyal Kushilevitz,et al.  Communication Complexity , 1997, Adv. Comput..

[14]  György Turán,et al.  On Linear Decision Trees Computing Boolean Functions , 1991, ICALP.

[15]  Alexander A. Razborov,et al.  n^Omega(log n) Lower Bounds on the Size of Depth-3 Threshold Circuits with AND Gates at the Bottom , 1993, Information Processing Letters.

[16]  Kristoffer Arnsfelt Hansen,et al.  Exact Threshold Circuits , 2010, 2010 IEEE 25th Annual Conference on Computational Complexity.

[17]  Ingo Wegener,et al.  Optimal Decision Trees and One-Time-Only Branching Programs for Symmetric Boolean Functions , 1984, Inf. Control..

[18]  Jeff Erickson,et al.  Lower bounds for linear satisfiability problems , 1995, SODA '95.

[19]  Pavel Pudlák,et al.  Threshold circuits of bounded depth , 1987, 28th Annual Symposium on Foundations of Computer Science (sfcs 1987).

[20]  Johan Håstad,et al.  On the power of small-depth threshold circuits , 1991, computational complexity.