Best-First Search for Bounded-Depth Trees

Tree search is a common technique for solving constraint satisfaction and combinatorial optimization problems. The most popular strategies are depth-first search and limited discrepancy search. Aside from pruning or ordering the children of each node, these algorithms do not adapt their search order to take advantage of information that becomes available during search, such as heuristic scores or leaf costs. We present a framework called best-leaf-first search (BLFS) that uses this additional information to estimate the cost of taking discrepancies in the search tree and then attempts to visit leaves in a best-first order. In this way, BLFS brings the idea of best-first search from shortest path problems to the areas of constraint satisfaction and combinatorial optimization. Empirical results demonstrate that this new dynamic approach results in better search performance than previous static search strategies on two very different domains: structured CSPs and the traveling salesman problem.

[1]  Judea Pearl,et al.  Studies in Semi-Admissible Heuristics , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Matthew L. Ginsberg,et al.  Limited Discrepancy Search , 1995, IJCAI.

[3]  P. P. Chakrabarti,et al.  Reducing Reexpansions in Iterative-Deepening Search by Controlling Cutoff Bounds , 1991, Artif. Intell..

[4]  Tania Bedrax-Weiss,et al.  Optimal search protocols , 1999 .

[5]  R. Wallace,et al.  Learning from Failure in Constraint Satisfaction Search , 2006 .

[6]  Robert M. Haralick,et al.  Increasing Tree Search Efficiency for Constraint Satisfaction Problems , 1979, Artif. Intell..

[7]  Barry O'Sullivan,et al.  The Impact of Search Heuristics on Heavy-Tailed Behaviour , 2006, Constraints.

[8]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[9]  Wady Naanaa,et al.  YIELDS: A Yet Improved Limited Discrepancy Search for CSPs , 2007, CPAIOR.

[10]  W. Ruml,et al.  Heuristic Search in Bounded-depth Trees: Best-Leaf-First Search , 2002 .

[11]  D. Shmoys,et al.  Completing Quasigroups or Latin Squares: A Structured Graph Coloring Problem , 2002 .

[12]  Richard E. Korf,et al.  Iterative-Deepening-A*: An Optimal Admissible Tree Search , 1985, IJCAI.

[13]  Richard E. Korf,et al.  Improved Limited Discrepancy Search , 1996, AAAI/IAAI, Vol. 1.

[14]  P. A. Geelen,et al.  Dual Viewpoint Heuristics for Binary Constraint Satisfaction Problems , 1992, ECAI.

[15]  Richard E. Korf,et al.  Linear-Space Best-First Search , 1993, Artif. Intell..

[16]  Richard J. Wallace,et al.  Analysis of Heuristic Methods for Partial Constraint Satisfaction Problems , 1996, CP.

[17]  Lakhdar Sais,et al.  Boosting Systematic Search by Weighting Constraints , 2004, ECAI.

[18]  Toby Walsh Depth-bounded Discrepancy Search , 1997, IJCAI.