Descriptive complexity of constraint problems

Constraint problems are a powerful framework in which many common combinatorial problems can be expressed. Examples include graph colouring problems, Boolean satisfaction, graph cut problems, systems of equations, and many more. One typically distinguishes between constraint satisfaction problems (CSPs), which model strictly decision problems, and so-called valued constraint satisfaction problems (VCSPs), which also include optimisation problems. A key open problem in this field is the long-standing dichotomy conjecture by Feder and Vardi. It claims that CSPs only fall into two categories: Those that are NP-complete, and those that are solvable in polynomial time. This stands in contrast to Ladner’s theorem, which, assuming P 6= NP, guarantees the existence of problems that are neither NP-complete, nor in P, making CSPs an exceptional class of problems. While the Feder-Vardi conjecture is proven to be true in a number of special cases, it is still open in the general setting. (Recent claims affirming the conjecture are not considered here, as they have not been peer-reviewed yet.) In this thesis, we approach the complexity of constraint problems from a descriptive complexity perspective. Namely, instead of studying the computational resources necessary to solve certain constraint problems, we consider the expressive power necessary to define these problems in a logic. We obtain several results in this direction. For instance, we show that Schaefer’s dichotomy result for the case of CSPs over the Boolean domain can be framed as a definability result: Either a CSP is definable in fixed-point logic with rank (FPR), or it is NP-hard. Furthermore, we show that a dichotomy exists also in the general case. For VCSPs over arbitrary domains, we show that a VCSP is either definable in fixed-point logic with counting (FPC), or it is not definable in infinitary logic with counting (C). We show that these definability dichotomies also have algorithmic implications. In particular, using our results on the definability of VCSPs, we prove a dichotomy on the number of levels in the Lasserre hierarchy necessary to obtain an exact solution: For a finite-valued VCSP, either it is solved by the first level of the hierarchy, or one needs Ω(n) levels. Finally, we explore how other methods from finite model theory can be useful in the context of constraint problems. We consider pebble games for finite variable logics in this context, and expose new connections between CSPs, pebble games, and homomorphism preservation results.

[1]  Andrei A. Bulatov,et al.  Tractable conservative constraint satisfaction problems , 2003, 18th Annual IEEE Symposium of Logic in Computer Science, 2003. Proceedings..

[2]  Leonid Khachiyan,et al.  On the complexity of approximating the maximal inscribed ellipsoid for a polytope , 1993, Math. Program..

[3]  David Harel,et al.  Structure and Complexity of Relational Queries , 1980, FOCS.

[4]  Martin Grohe,et al.  Fixed-point logics on planar graphs , 1998, Proceedings. Thirteenth Annual IEEE Symposium on Logic in Computer Science (Cat. No.98CB36226).

[5]  Richard E. Ladner,et al.  On the Structure of Polynomial Time Reducibility , 1975, JACM.

[6]  Libor Barto,et al.  THE CONSTRAINT SATISFACTION PROBLEM AND UNIVERSAL ALGEBRA , 2015, The Bulletin of Symbolic Logic.

[7]  T. Rothvoss The Lasserre hierarchy in Approximation algorithms Lecture Notes for the MAPSP 2013 Tutorial Preliminary version , 2013 .

[8]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[9]  Tomás Feder,et al.  The Computational Structure of Monotone Monadic SNP and Constraint Satisfaction: A Study through Datalog and Group Theory , 1999, SIAM J. Comput..

[10]  Martin Grötschel,et al.  The ellipsoid method and its consequences in combinatorial optimization , 1981, Comb..

[11]  Vladimir Kolmogorov,et al.  The complexity of conservative valued CSPs , 2011, JACM.

[12]  Andrei A. Bulatov,et al.  A dichotomy theorem for constraints on a three-element set , 2002, The 43rd Annual IEEE Symposium on Foundations of Computer Science, 2002. Proceedings..

[13]  Víctor Dalmau,et al.  Linear datalog and bounded path duality of relational structures , 2005, Log. Methods Comput. Sci..

[14]  Libor Barto,et al.  The Dichotomy for Conservative Constraint Satisfaction Problems Revisited , 2011, 2011 IEEE 26th Annual Symposium on Logic in Computer Science.

[15]  Libor Barto,et al.  Constraint Satisfaction Problems of Bounded Width , 2009, 2009 50th Annual IEEE Symposium on Foundations of Computer Science.

[16]  Martin Otto,et al.  Inductive Definability with Counting on Finite Structures , 1992, CSL.

[17]  Subhash Khot On the Unique Games Conjecture (Invited Survey) , 2010, Computational Complexity Conference.

[18]  Oleg Verbitsky,et al.  On the speed of constraint propagation and the time complexity of arc consistency testing , 2018, J. Comput. Syst. Sci..

[19]  Stanislav Zivny,et al.  An Algebraic Theory of Complexity for Valued Constraints: Establishing a Galois Connection , 2011, MFCS.

[20]  D. Hobby,et al.  The structure of finite algebras , 1988 .

[21]  Marcin Kozik,et al.  Algebraic Properties of Valued Constraint Satisfaction Problem , 2014, ICALP.

[22]  Neil Immerman,et al.  An optimal lower bound on the number of variables for graph identification , 1992, Comb..

[23]  Jean B. Lasserre,et al.  An Explicit Exact SDP Relaxation for Nonlinear 0-1 Programs , 2001, IPCO.

[24]  Andrei A. Bulatov,et al.  A Dichotomy Theorem for Nonuniform CSPs , 2017, 2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS).

[25]  Christoph Berkholz,et al.  Limitations of Algebraic Approaches to Graph Isomorphism Testing , 2015, ICALP.

[26]  Víctor Dalmau,et al.  Generalized majority-minority operations are tractable , 2005, 20th Annual IEEE Symposium on Logic in Computer Science (LICS' 05).

[27]  Dima Grigoriev,et al.  Complexity of Positivstellensatz proofs for the knapsack , 2002, computational complexity.

[28]  Andrei A. Bulatov,et al.  A Simple Algorithm for Mal'tsev Constraints , 2006, SIAM J. Comput..

[29]  Anuj Dawar,et al.  Affine systems of equations and counting infinitary logic , 2009 .

[30]  Madhur Tulsiani,et al.  Convex Relaxations and Integrality Gaps , 2012 .

[31]  Anuj Dawar,et al.  Logics with Rank Operators , 2009, 2009 24th Annual IEEE Symposium on Logic In Computer Science.

[32]  Stanislav Zivny,et al.  The Complexity of Finite-Valued CSPs , 2016, J. ACM.

[33]  Martin C. Cooper,et al.  The complexity of soft constraint satisfaction , 2006, Artif. Intell..

[34]  Phokion G. Kolaitis,et al.  Logical Definability of NP Optimization Problems , 1994, Inf. Comput..

[35]  Toby Walsh,et al.  Handbook of Constraint Programming , 2006, Handbook of Constraint Programming.

[36]  Pengming Wang,et al.  Definability of semidefinite programming and lasserre lower bounds for CSPs , 2017, 2017 32nd Annual ACM/IEEE Symposium on Logic in Computer Science (LICS).

[37]  L. Lovász,et al.  Geometric Algorithms and Combinatorial Optimization , 1981 .

[38]  Andrei A. Bulatov,et al.  Mal'tsev constraints are tractable , 2002, Electron. Colloquium Comput. Complex..

[39]  Martin Otto,et al.  Bounded Variable Logics and Counting: A Study in Finite Models , 1997, Lecture Notes in Logic.

[40]  Alexander Schrijver,et al.  Cones of Matrices and Set-Functions and 0-1 Optimization , 1991, SIAM J. Optim..

[41]  Martin Grohe,et al.  Definability and Descriptive Complexity on Databases of Bounded Tree-Width , 1999, ICDT.

[42]  Anuj Dawar,et al.  Definability of linear equation systems over groups and rings , 2012, Log. Methods Comput. Sci..

[43]  Hubie Chen A rendezvous of logic, complexity, and algebra , 2006, SIGA.

[44]  Hanif D. Sherali,et al.  A Hierarchy of Relaxations Between the Continuous and Convex Hull Representations for Zero-One Programming Problems , 1990, SIAM J. Discret. Math..

[45]  Pengming Wang,et al.  The pebbling comonad in Finite Model Theory , 2017, 2017 32nd Annual ACM/IEEE Symposium on Logic in Computer Science (LICS).

[46]  Moshe Y. Vardi The complexity of relational query languages (Extended Abstract) , 1982, STOC '82.

[47]  Andrei A. Bulatov,et al.  Conservative constraint satisfaction re-revisited , 2014, J. Comput. Syst. Sci..

[48]  Grant Schoenebeck,et al.  Linear Level Lasserre Lower Bounds for Certain k-CSPs , 2008, 2008 49th Annual IEEE Symposium on Foundations of Computer Science.

[49]  Anuj Dawar,et al.  Maximum Matching and Linear Programming in Fixed-Point Logic with Counting , 2013, 2013 28th Annual ACM/IEEE Symposium on Logic in Computer Science.

[50]  Eugene C. Freuder Synthesizing constraint expressions , 1978, CACM.

[51]  Iannis Tourlakis,et al.  New Lower Bounds for Vertex Cover in the Lovasz-Schrijver Hierarchy , 2006, 21st Annual IEEE Conference on Computational Complexity (CCC'06).

[52]  Benjamin Rossman,et al.  Homomorphism preservation theorems , 2008, JACM.

[53]  Anuj Dawar,et al.  On the Descriptive Complexity of Linear Algebra , 2008, WoLLIC.

[54]  Stanislav Zivny,et al.  The Power of Linear Programming for Valued CSPs , 2012, 2012 IEEE 53rd Annual Symposium on Foundations of Computer Science.

[55]  Neil Immerman,et al.  Relational Queries Computable in Polynomial Time , 1986, Inf. Control..

[56]  Phokion G. Kolaitis,et al.  Conjunctive-Query Containment and Constraint Satisfaction , 2000, J. Comput. Syst. Sci..

[57]  Libor Barto,et al.  Polymorphisms, and How to Use Them , 2017, The Constraint Satisfaction Problem.

[58]  R. McKenzie,et al.  Varieties with few subalgebras of powers , 2009 .

[59]  Zoltán Toroczkai,et al.  Optimization hardness as transient chaos in an analog approach to constraint satisfaction , 2011, ArXiv.

[60]  Thomas J. Schaefer,et al.  The complexity of satisfiability problems , 1978, STOC.

[61]  Stanislav Zivny,et al.  Sherali-Adams Relaxations for Valued CSPs , 2015, ICALP.

[62]  Phokion G. Kolaitis,et al.  A Game-Theoretic Approach to Constraint Satisfaction , 2000, AAAI/IAAI.

[63]  Pengming Wang,et al.  A Definability Dichotomy for Finite Valued CSPs , 2015, CSL.

[64]  Erich Grädel,et al.  RANK LOGIC IS DEAD, LONG LIVE RANK LOGIC! , 2015, The Journal of Symbolic Logic.

[65]  Manuel Bodirsky,et al.  The complexity of temporal constraint satisfaction problems , 2008, STOC.

[66]  Tomás Feder,et al.  Homomorphism closed vs. existential positive , 2003, 18th Annual IEEE Symposium of Logic in Computer Science, 2003. Proceedings..

[67]  Rina Dechter,et al.  Backjump-based backtracking for constraint satisfaction problems , 2002, Artif. Intell..

[68]  Wenceslas Fernandez de la Vega,et al.  Linear programming relaxations of maxcut , 2007, SODA '07.

[69]  Lauri Hella Logical Hierarchies in PTIME , 1996, Inf. Comput..

[70]  Libor Barto,et al.  The collapse of the bounded width hierarchy , 2016, J. Log. Comput..

[71]  Albert Atserias,et al.  Graph Isomorphism, Sherali-Adams Relaxations and Expressibility in Counting Logics , 2011, Electron. Colloquium Comput. Complex..

[72]  Phokion G. Kolaitis,et al.  Fixpoint logic vs. infinitary logic in finite-model theory , 1992, [1992] Proceedings of the Seventh Annual IEEE Symposium on Logic in Computer Science.

[73]  Jaroslav Nesetril,et al.  On the complexity of H-coloring , 1990, J. Comb. Theory, Ser. B.

[74]  Libor Barto,et al.  The CSP Dichotomy Holds for Digraphs with No Sources and No Sinks (A Positive Answer to a Conjecture of Bang-Jensen and Hell) , 2008, SIAM J. Comput..

[75]  Peter Jeavons,et al.  Classifying the Complexity of Constraints Using Finite Algebras , 2005, SIAM J. Comput..

[76]  Georg Gottlob,et al.  Uniform Constraint Satisfaction Problems and Database Theory , 2008, Complexity of Constraints.

[77]  Phokion G. Kolaitis,et al.  Constraint Satisfaction, Bounded Treewidth, and Finite-Variable Logics , 2002, CP.

[78]  Prabhu Manyem,et al.  Polynomial-TimeMaximisation Classes: Syntactic Hierarchy , 2008, Fundam. Informaticae.

[79]  Martin Grohe,et al.  Fixed-Point Definability and Polynomial Time on Graphs with Excluded Minors , 2010, 2010 25th Annual IEEE Symposium on Logic in Computer Science.

[80]  Miklós Ajtai,et al.  Recursive construction for 3-regular expanders , 1987, 28th Annual Symposium on Foundations of Computer Science (sfcs 1987).

[81]  Pawel M. Idziak,et al.  Tractability and Learnability Arising from Algebras with Few Subpowers , 2010, SIAM J. Comput..

[82]  Tomás Feder,et al.  Dichotomy for Digraph Homomorphism Problems , 2017, ArXiv.

[83]  Martin C. Cooper,et al.  An Algebraic Theory of Complexity for Discrete Optimization , 2012, SIAM J. Comput..

[84]  Dmitriy Zhuk,et al.  A Proof of CSP Dichotomy Conjecture , 2017, 2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS).

[85]  Peter Jeavons,et al.  On the Algebraic Structure of Combinatorial Problems , 1998, Theor. Comput. Sci..

[86]  B. Larose,et al.  Bounded width problems and algebras , 2007 .

[87]  Anuj Dawar,et al.  Solving Linear Programs without Breaking Abstractions , 2015, J. ACM.

[88]  Pascal Tesson,et al.  Symmetric Datalog and Constraint Satisfaction Problems in Logspace , 2007, 22nd Annual IEEE Symposium on Logic in Computer Science (LICS 2007).

[89]  Saharon Shelah,et al.  Choiceless Polynomial Time , 1997, Ann. Pure Appl. Log..