A Complexity Analysis of Space-Bounded Learning Algorithms for the Constraint Satisfaction Problem

Learning during backtrack search is a space-intensive process that records information (such as additional constraints) in order to avoid redundant work. In this paper, we analyze the effects of polynomial-space-bounded learning on runtime complexity of backtrack search. One space-bounded learning scheme records only those constramts With limited size, and another records arbitrarily large constraints but deletes those that become irrelevant to the portion of the search space being explored. We find that relevance-bounded learning allows better runtime bounds than size-bounded learning on structurally restricted constraint satisfaction problems. Even when restricted to linear space, our relevance-bounded learning algorithm has runtime complexity near that of unrestricted (exponential space-consuming) learning schemes.

[1]  Matthew L. Ginsberg,et al.  Dynamic Backtracking , 1993, J. Artif. Intell. Res..

[2]  David A. McAllester,et al.  GSAT and Dynamic Backtracking , 1994, KR.

[3]  Christophe Lecoutre Constraint Networks , 1992 .

[4]  Stefan Arnborg,et al.  Efficient algorithms for combinatorial problems on graphs with bounded decomposability — A survey , 1985, BIT.

[5]  Robert M. Haralick,et al.  Increasing Tree Search Efficiency for Constraint Satisfaction Problems , 1979, Artif. Intell..

[6]  Bernard A. Nadel,et al.  Tree search and ARC consistency in constraint satisfaction algorithms , 1988 .

[7]  Rina Dechter,et al.  Enhancement Schemes for Constraint Processing: Backjumping, Learning, and Cutset Decomposition , 1990, Artif. Intell..

[8]  Rina Dechter,et al.  Network-Based Heuristics for Constraint-Satisfaction Problems , 1987, Artif. Intell..

[9]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[10]  Daniel P. Miranker,et al.  An Optimal Backtrack Algorithm for Tree-Structured Constraint Satisfaction problems , 1994, Artif. Intell..

[11]  Eugene C. Freuder A sufficient condition for backtrack-bounded search , 1985, JACM.

[12]  Rina Dechter,et al.  Dead-End Driven Learning , 1994, AAAI.

[13]  Toby Walsh,et al.  The Satisfiability Constraint Gap , 1996, Artif. Intell..

[14]  Patrick Prosser,et al.  HYBRID ALGORITHMS FOR THE CONSTRAINT SATISFACTION PROBLEM , 1993, Comput. Intell..

[15]  Michael J. Quinn,et al.  Taking Advantage of Stable Sets of Variables in Constraint Satisfaction Problems , 1985, IJCAI.

[16]  Arun N. Swami,et al.  Optimization of large join queries: combining heuristics and combinatorial techniques , 1989, SIGMOD '89.

[17]  Daniel P. Miranker,et al.  On the Space-Time Trade-off in Solving Constraint Satisfaction Problems , 1995, IJCAI.