Lower bounds for dynamic connectivity

We prove an Ω(lg Erik n) cell-probe lower bound on maintaining connectivity in dynamic graphs, as well as a more general trade-off between updates and queries. Our bound holds even if the graph is formed by disjoint paths, and thus also applies to trees and plane graphs. The bound is known to be tight for these restricted cases, proving optimality of these data structures (e. g., Sleator and Tarjan's dynamic trees). Our trade-off is known to be tight for trees, and the best two data structures for dynamic connectivity in general graphs are points on our trade-off curve. In this sense these two data structures are optimal, and this tightness serves as strong evidence that our lower bounds are the best possible. From a more theoretical perspective, our result is the first logarithmic cell-probe lower bound for any problem in the natural class of dynamic language membership problems, breaking the long standing record of Ω(lg n / lg lg n). In this sense, our result is the first data-structure lower bound that is "truly" logarithmic, i. e., logarithmic in the problem size counted in bits. Obtaining such a bound is listed as one of three major challenges for future research by Miltersen [13] (the other two challenges remain unsolved). Our techniques form a general framework for proving cell-probe lower bounds on dynamic data structures. We show how our framework also applies to the partial-sums problem to obtain a nearly complete understanding of the problem in cell-probe and algebraic models, solving several previously posed open problems.

[1]  Peter Bro Miltersen Cell probe complexity-a survey , 1999 .

[2]  Andrew Chi-Chih Yao,et al.  Should Tables Be Sorted? , 1981, JACM.

[3]  Robert E. Tarjan,et al.  A data structure for dynamic trees , 1981, STOC '81.

[4]  Peter Bro Miltersen,et al.  Complexity Models for Incremental Computation , 1994, Theor. Comput. Sci..

[5]  Monika Henzinger,et al.  Lower Bounds for Fully Dynamic Connectivity Problems in Graphs , 1995, Algorithmica.

[6]  Peter M. Fenwick,et al.  A new data structure for cumulative frequency tables , 1994, Softw. Pract. Exp..

[7]  Michael L. Fredman,et al.  Optimal Biweighted Binary Trees and the Complexity of Maintaining Partial Sums , 1999, SIAM J. Comput..

[8]  Faith Ellen,et al.  Optimal Bounds for the Predecessor Problem and Related Problems , 2002, J. Comput. Syst. Sci..

[9]  Mikkel Thorup,et al.  Near-optimal fully-dynamic graph connectivity , 2000, STOC '00.

[10]  Michael E. Saks,et al.  The cell probe complexity of dynamic data structures , 1989, STOC '89.

[11]  Erik D. Demaine,et al.  Tight bounds for the partial-sums problem , 2004, SODA '04.

[12]  David Eppstein,et al.  Maintenance of a minimum spanning forest in a dynamic planar graph , 1990, SODA '90.

[13]  C. SIAMJ.,et al.  NEW LOWER BOUND TECHNIQUES FOR DYNAMIC PARTIAL SUMS AND RELATED PROBLEMS , 2003 .

[14]  Mikkel Thorup,et al.  Poly-logarithmic deterministic fully-dynamic algorithms for connectivity, minimum spanning tree, 2-edge, and biconnectivity , 2001, JACM.

[15]  Wing-Kai Hon,et al.  Succinct Data Structures for Searchable Partial Sums , 2003, ISAAC.

[16]  Michael L. Fredman,et al.  The Complexity of Maintaining an Array and Computing Its Partial Sums , 1982, JACM.

[17]  Rajeev Raman,et al.  Succinct Dynamic Data Structures , 2001, WADS.

[18]  Paul F. Dietz Optimal Algorithms for List Indexing and Subset Rank , 1989, WADS.