On uncertainty versus size in branching programs

We propose an information-theoretic approach to proving lower bounds on the size of branching programs. The argument is based on Kraft type inequalities for the average amount of uncertainty about (or entropy of) a given input during the various stages of computation. The uncertainty is measured by the average depth of so-called `splitting trees? for sets of inputs reaching particular nodes of the program.We first demonstrate the approach for read-once branching programs. Then, we introduce a strictly larger class of so-called `balanced? branching programs and, using the suggested approach, prove that some explicit Boolean functions cannot be computed by balanced programs of polynomial size. These lower bounds are new since some explicit functions, which are known to be hard for most previously considered restricted classes of branching programs, can be easily computed by balanced branching programs of polynomial size.

[1]  Michael E. Saks,et al.  Super-linear time-space tradeoff lower bounds for randomized computation , 2000, Proceedings 41st Annual Symposium on Foundations of Computer Science.

[2]  Stasys Jukna,et al.  A Note on Read-k Times Branching Programs , 1994, RAIRO Theor. Informatics Appl..

[3]  Stasys Jukna,et al.  On Branching Programs With Bounded Uncertainty (Extended Abstract) , 1998, ICALP.

[4]  Alexander A. Razborov,et al.  Neither Reading Few Bits Twice Nor Reading Illegally Helps Much , 1998, Discret. Appl. Math..

[5]  Ingo Wegener,et al.  Time-Space Trade-offs for Branching Programs , 1986, J. Comput. Syst. Sci..

[6]  Ronald L. Rivest,et al.  The Design and Analysis of Computer Algorithms , 1990 .

[7]  Alexander A. Razborov,et al.  Lower Bounds for Deterministic and Nondeterministic Branching Programs , 1991, FCT.

[8]  I. Wegener Branching Programs and Binary Deci-sion Diagrams-Theory and Applications , 1987 .

[9]  Stasys Jukna,et al.  Some Notes on the Information Flow in Read-Once Branching Programs , 2000, SOFSEM.

[10]  Miklós Ajtai,et al.  A non-linear time lower bound for Boolean branching programs , 1999, 40th Annual Symposium on Foundations of Computer Science (Cat. No.99CB37039).

[11]  Alfred V. Aho,et al.  The Design and Analysis of Computer Algorithms , 1974 .

[12]  Stanislav Zák A subexponential lower bound for branching programs restricted with regard to some semantic aspects , 1997, Electron. Colloquium Comput. Complex..

[13]  Stasys Jukna,et al.  On Branching Programs With Bounded Uncertainty , 1998, Electron. Colloquium Comput. Complex..