A measure & conquer approach for the analysis of exact algorithms

For more than 40 years, Branch & Reduce exponential-time backtracking algorithms have been among the most common tools used for finding exact solutions of NP-hard problems. Despite that, the way to analyze such recursive algorithms is still far from producing tight worst-case running time bounds. Motivated by this, we use an approach, that we call “Measure & Conquer””, as an attempt to step beyond such limitations. The approach is based on the careful design of a nonstandard measure of the subproblem size; this measure is then used to lower bound the progress made by the algorithm at each branching step. The idea is that a smarter measure may capture behaviors of the algorithm that a standard measure might not be able to exploit, and hence lead to a significantly better worst-case time analysis. In order to show the potentialities of Measure & Conquer, we consider two well-studied NP-hard problems: minimum dominating set and maximum independent set. For the first problem, we consider the current best algorithm, and prove (thanks to a better measure) a much tighter running time bound for it. For the second problem, we describe a new, simple algorithm, and show that its running time is competitive with the current best time bounds, achieved with far more complicated algorithms (and standard analysis). Our examples show that a good choice of the measure, made in the very first stages of exact algorithms design, can have a tremendous impact on the running time bounds achievable.

[1]  Alexander S. Kulikov,et al.  A new approach to proving upper bounds for MAX-2-SAT , 2006, SODA '06.

[2]  Robert E. Tarjan,et al.  Finding a Maximum Independent Set , 1976, SIAM J. Comput..

[3]  Russell Impagliazzo,et al.  Which Problems Have Strongly Exponential Complexity? , 2001, J. Comput. Syst. Sci..

[4]  Adi Shamir,et al.  A T=O(2n/2), S=O(2n/4) Algorithm for Certain NP-Complete Problems , 1981, SIAM J. Comput..

[5]  David Zuckerman,et al.  Electronic Colloquium on Computational Complexity, Report No. 100 (2005) Linear Degree Extractors and the Inapproximability of MAX CLIQUE and CHROMATIC NUMBER , 2005 .

[6]  M. Held,et al.  A dynamic programming approach to sequencing problems , 1962, ACM National Meeting.

[7]  Donald W. Loveland,et al.  A machine program for theorem-proving , 2011, CACM.

[8]  Yngve Villanger,et al.  Improved Exponential-Time Algorithms for Treewidth and Minimum Fill-In , 2006, LATIN.

[9]  Edward A. Hirsch,et al.  SAT Local Search Algorithms: Worst-Case Study , 2000, Journal of Automated Reasoning.

[10]  John Michael Robson,et al.  Algorithms for Maximum Independent Sets , 1986, J. Algorithms.

[11]  Ewald Speckenmeyer,et al.  Solving satisfiability in less than 2n steps , 1985, Discret. Appl. Math..

[12]  AlekhnovichMichael,et al.  Exponential Lower Bounds for the Running Time of DPLL Algorithms on Satisfiable Formulas , 2005 .

[13]  Ge Xia,et al.  Labeled Search Trees and Amortized Analysis: Improved Upper Bounds for NP-Hard Problems , 2003, Algorithmica.

[14]  Fabrizio Grandoni,et al.  Measure and conquer: a simple O(20.288n) independent set algorithm , 2006, SODA '06.

[15]  Andreas Björklund,et al.  Inclusion--Exclusion Algorithms for Counting Set Partitions , 2006, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06).

[16]  B. M. Fulk MATH , 1992 .

[17]  Saket Saurabh,et al.  Fast Exponential Algorithms for Maximum r-Regular Induced Subgraph Problems , 2006, FSTTCS.

[18]  S. Ramesh,et al.  Foundations of Software Technology and Theoretical Computer Science , 1997, Lecture Notes in Computer Science.

[19]  Richard Beigel,et al.  Finding maximum independent sets in sparse and general graphs , 1999, SODA '99.

[20]  Hans L. Bodlaender,et al.  Design by Measure and Conquer, A Faster Exact Algorithm for Dominating Set , 2008, STACS.

[21]  David Eppstein,et al.  Quasiconvex analysis of multivariate recurrence equations for backtracking algorithms , 2006, TALG.

[22]  P. Hammer,et al.  Pseudo-Boolean functions and stability of graphs , 1984 .

[23]  Fedor V. Fomin,et al.  On the Minimum Feedback Vertex Set Problem: Exact and Enumeration Algorithms , 2008, Algorithmica.

[24]  Bruce A. Reed Paths, Stars and the Number Three , 1996, Comb. Probab. Comput..

[25]  Fedor V. Fomin,et al.  Counting Minimum Weighted Dominating Sets , 2007, COCOON.

[26]  Jörg Rothe,et al.  An Improved Exact Algorithm for the Domatic Number Problem , 2006, 2006 2nd International Conference on Information & Communication Technologies.

[27]  Fabrizio Grandoni,et al.  Combinatorial bounds via measure and conquer: Bounding minimal dominating sets and applications , 2008, TALG.

[28]  Fabrizio Grandoni,et al.  Some New Techniques in Design and Analysis of Exact (Exponential) Algorithms , 2005, Bull. EATCS.

[29]  Oliver Kullmann,et al.  New Methods for 3-SAT Decision and Worst-case Analysis , 1999, Theor. Comput. Sci..

[30]  David Eppstein,et al.  Quasiconvex analysis of backtracking algorithms , 2003, SODA '04.

[31]  Tang Jian,et al.  An O(20.304n) Algorithm for Solving Maximum Independent Set Problem , 1986, IEEE Trans. Computers.

[32]  U. Schöning A probabilistic algorithm for k-SAT and constraint satisfaction problems , 1999, 40th Annual Symposium on Foundations of Computer Science (Cat. No.99CB37039).

[33]  Walter Kern,et al.  An improved deterministic local search algorithm for 3-SAT , 2004, Theor. Comput. Sci..

[34]  J. Håstad Clique is hard to approximate within n 1-C , 1996 .

[35]  Eugene L. Lawler,et al.  A Note on the Complexity of the Chromatic Number Problem , 1976, Inf. Process. Lett..

[36]  Ran Raz,et al.  A sub-constant error-probability low-degree test, and a sub-constant error-probability PCP characterization of NP , 1997, STOC '97.

[37]  Weijia Jia,et al.  Vertex Cover: Further Observations and Further Improvements , 2001, J. Algorithms.

[38]  D. West Introduction to Graph Theory , 1995 .

[39]  Michael E. Saks,et al.  An improved exponential-time algorithm for k-SAT , 2005, JACM.

[40]  Ryan Williams,et al.  A new algorithm for optimal 2-constraint satisfaction and its implications , 2005, Theor. Comput. Sci..

[41]  J. Håstad Clique is hard to approximate withinn1−ε , 1999 .

[42]  Jesper Makholm Byskov Enumerating maximal independent sets with applications to graph colouring , 2004, Oper. Res. Lett..

[43]  Igor Razgon Exact Computation of Maximum Induced Forest , 2006, SWAT.

[44]  Fabrizio Grandoni,et al.  Bounding the Number of Minimal Dominating Sets: A Measure and Conquer Approach , 2005, ISAAC.

[45]  Allan Gottlieb,et al.  A generating function approach to the Traveling Salesman Problem , 1977, ACM Annual Conference.

[46]  Lukasz Kowalik Improved Edge-Coloring with Three Colors , 2006, WG.

[47]  Edward A. Hirsch,et al.  New Worst-Case Upper Bounds for SAT , 2000, Journal of Automated Reasoning.

[48]  Dimitrios M. Thilikos,et al.  On Exact Algorithms for Treewidth , 2006, ESA.

[49]  Weijia Jia,et al.  Vertex Cover: Further Observations and Further Improvements , 1999, J. Algorithms.

[50]  Rolf Niedermeier,et al.  Worst-case upper bounds for MAX-2-SAT with an application to MAX-CUT , 2003, Discret. Appl. Math..

[51]  Peter J. Slater,et al.  Fundamentals of domination in graphs , 1998, Pure and applied mathematics.

[52]  Martin Fürer,et al.  A Faster Algorithm for Finding Maximum Independent Sets in Sparse Graphs , 2006, LATIN.

[53]  Fabrizio Grandoni,et al.  Solving Connected Dominating Set Faster than 2n , 2007, Algorithmica.

[54]  Michael R. Fellows,et al.  Parameterized Complexity , 1998 .

[55]  Jon M. Kleinberg,et al.  A deterministic (2-2/(k+1))n algorithm for k-SAT based on local search , 2002, Theor. Comput. Sci..

[56]  Kathryn Fraughnaugh,et al.  Introduction to graph theory , 1973, Mathematical Gazette.

[57]  Fedor V. Fomin,et al.  Exact algorithms for treewidth and minimum fill-in ∗ † , 2006 .

[58]  Fabrizio Grandoni,et al.  Exact Algorithms for Hard Graph Problems , 2004 .

[59]  David Eppstein,et al.  The Traveling Salesman Problem for Cubic Graphs , 2003, J. Graph Algorithms Appl..

[60]  Kazuo Iwama,et al.  Improved upper bounds for 3-SAT , 2004, SODA '04.

[61]  Uwe Schöning A Probabilistic Algorithm for k-SAT and Constraint Satisfaction Problems , 1999, FOCS.

[62]  Fabrizio Grandoni,et al.  A note on the complexity of minimum dominating set , 2006, J. Discrete Algorithms.

[63]  David Eppstein,et al.  3-Coloring in Time O(1.3289^n) , 2000, J. Algorithms.

[64]  Gerhard J. Woeginger,et al.  Exact Algorithms for NP-Hard Problems: A Survey , 2001, Combinatorial Optimization.

[65]  Igor Razgon,et al.  A Faster Solving of the Maximum Independent Set Problem for Graphs with Maximal Degree 3 , 2006, ACiD.

[66]  Fabrizio Grandoni,et al.  Solving Connected Dominating Set Faster than 2 n , 2006, Algorithmica.

[67]  Dan Suciu,et al.  Journal of the ACM , 2006 .

[68]  Uwe Schöning,et al.  Algorithmics in Exponential Time , 2005, STACS.

[69]  Hilary Putnam,et al.  A Computing Procedure for Quantification Theory , 1960, JACM.

[70]  Russell Impagliazzo,et al.  A lower bound for DLL algorithms for k-SAT (preliminary version) , 2000, SODA '00.

[71]  Gerhard J. Woeginger,et al.  Exact (Exponential) Algorithms for the Dominating Set Problem , 2004, WG.

[72]  Dieter Kratsch,et al.  An exact algorithm for the minimum dominating clique problem , 2007, Theor. Comput. Sci..

[73]  Ellis Horowitz,et al.  Computing Partitions with Applications to the Knapsack Problem , 1974, JACM.

[74]  Dieter Kratsch,et al.  An exact algorithm for the minimum dominating clique problem , 2006, Theor. Comput. Sci..

[75]  David Eppstein Small Maximal Independent Sets and Faster Exact Graph Coloring , 2001, WADS.

[76]  Fabrizio Grandoni,et al.  Measure and Conquer: Domination - A Case Study , 2005, ICALP.

[77]  Russell Impagliazzo,et al.  Which problems have strongly exponential complexity? , 1998, Proceedings 39th Annual Symposium on Foundations of Computer Science (Cat. No.98CB36280).

[78]  Mikko Koivisto,et al.  An O*(2^n ) Algorithm for Graph Coloring and Other Partitioning Problems via Inclusion--Exclusion , 2006, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06).

[79]  Michael Alekhnovich,et al.  Exponential Lower Bounds for the Running Time of DPLL Algorithms on Satisfiable Formulas , 2004, SODA '04.

[80]  Fedor V. Fomin,et al.  Finding a Minimum Feedback Vertex Set in Time O (1.7548n) , 2006, IWPEC.