Learning from Failure in Constraint Satisfaction Search

Much work has been done on learning from failure in search to boost solving of combinatorial problems, such as clause-learning in boolean satisfiability (SAT), nogood and explanation-based learning, and constraint weighting in constraint satisfaction problems (CSPs), etc. Many of the top solvers in SAT use clause learning to good effect. A similar approach (nogood learning) has not had as large an impact in CSPs. Constraint weighting is a less fine grained approach where the information learnt gives an approximation as to which variables may be the sources of greatest contention. In this paper we present a method for learning from search using restarts, in order to identify these critical variables in a given constraint satisfaction problem, prior to solving. Our method is based on the conflict-directed heuristic (weighted-degree heuristic) introduced by Boussemart et al. and is aimed at producing a better-informed version of the heuristic by gathering information through restarting and probing of the search space prior to solving, while minimising the overhead of these restarts/probes. We show that random probing of the search space can boost the heuristics power by improving early decisions in search. We also provide an in-depth analysis of the effects of constraint weighting.

[1]  W. Hays Statistics for the social sciences , 1973 .

[2]  Robert M. Haralick,et al.  Increasing Tree Search Efficiency for Constraint Satisfaction Problems , 1979, Artif. Intell..

[3]  Tom M. Mitchell,et al.  Learning from Solution Paths: An Approach to the Credit Assignment Problem , 1982, AI Mag..

[4]  P. A. Geelen,et al.  Dual Viewpoint Heuristics for Binary Constraint Satisfaction Problems , 1992, ECAI.

[5]  Bart Selman,et al.  Domain-Independent Extensions to GSAT : Solving Large StructuredSatis ability , 1993 .

[6]  Paul Morris,et al.  The Breakout Method for Escaping from Local Minima , 1993, AAAI.

[7]  17. Statistics for the Social Sciences , 1996 .

[8]  David Joslin,et al.  "Squeaky Wheel" Optimization , 1998, AAAI/IAAI.

[9]  M. Moskewicz,et al.  Chaff: engineering an efficient SAT solver , 2001, Proceedings of the 38th Design Automation Conference (IEEE Cat. No.01CH37232).

[10]  Boi Faltings,et al.  Using the Breakout Algorithm to Identify Hard and Unsolvable Subproblems , 2003, CP.

[11]  Lakhdar Sais,et al.  Boosting Systematic Search by Weighting Constraints , 2004, ECAI.

[12]  Holger H. Hoos,et al.  Warped Landscapes and Random Acts of SAT Solving , 2004, AI&M.

[13]  Christophe Lecoutre,et al.  Backjump-based techniques versus conflict-directed heuristics , 2004, 16th IEEE International Conference on Tools with Artificial Intelligence.

[14]  Philippe Refalo,et al.  Impact-Based Search Strategies for Constraint Programming , 2004, CP.

[15]  Fahiem Bacchus,et al.  Generalized NoGoods in CSPs , 2005, AAAI.

[16]  Barry O'Sullivan,et al.  The Impact of Search Heuristics on Heavy-Tailed Behaviour , 2006, Constraints.