A Two Level Local Search for MAX-SAT Problems with Hard and Soft Constraints

Local search techniques have attracted considerable interest in the AI community since the development of GSAT for solving large propositional SAT problems. Newer SAT techniques, such as the Discrete Lagrangian Method (DLM), have further improved on GSAT and can also be applied to general constraint satisfaction and optimisation. However, little work has applied local search to MAX-SAT problems with hard and soft constraints. As many real-world problems are best represented by hard (mandatory) and soft (desirable) constraints, the development of effective local search heuristics for this domain is of significant practical importance.This paper extends previous work on dynamic constraint weighting by introducing a two-level heuristic that switches search strategy according to whether a current solution contains unsatisfied hard constraints. Using constraint weighting techniques derived from DLM to satisfy hard constraints, we apply a Tabu search to optimise the soft constraint violations. These two heuristics are further combined with a dynamic hard constraint multiplier that changes the relative importance of the hard constraints during the search. We empirically evaluate this new algorithm using a set of randomly generated 3-SAT problems of various sizes and difficulty, and in comparison with various state-of-the-art SAT techniques. The results indicate that our dynamic, two-level heuristic offers significant performance benefits over the standard SAT approaches.

[1]  Bart Selman,et al.  Evidence for Invariants in Local Search , 1997, AAAI/IAAI.

[2]  Paul Morris,et al.  The Breakout Method for Escaping from Local Minima , 1993, AAAI.

[3]  Richard J. Wallace,et al.  Partial Constraint Satisfaction , 1989, IJCAI.

[4]  Andrea Schaerf,et al.  Tabu Search Techniques for Large High-School Timetabling Problems , 1996, AAAI/IAAI, Vol. 1.

[5]  Fred W. Glover,et al.  Tabu Search - Part I , 1989, INFORMS J. Comput..

[6]  Holger H. Hoos,et al.  On the Run-time Behaviour of Stochastic Local Search Algorithms for SAT , 1999, AAAI/IAAI.

[7]  Francesca Rossi,et al.  Semiring-based constraint solving and optimization , 1997 .

[8]  Jeremy Frank Learning Short-Term Weights for GSAT , 1997, IJCAI.

[9]  Bjørn N. Freeman-Benson,et al.  Constraint hierarchies , 1987, OOPSLA '87.

[10]  Zhe Wu,et al.  The Theory and Applications of Discrete Constrained Optimization using Lagrange Multipliers , 2001 .

[11]  Francesca Rossi,et al.  Semiring-based constraint satisfaction and optimization , 1997, JACM.

[12]  Edward P. K. Tsang,et al.  Guided Local Search for Solving SAT and Weighted MAX-SAT Problems , 2000, Journal of Automated Reasoning.

[13]  Byungki Cha,et al.  Local Search Algorithms for Partial MAXSAT , 1997, AAAI/IAAI.

[14]  Benjamin W. Wah,et al.  A Discrete Lagrangian-Based Global-Search Method for Solving Satisfiability Problems , 1996, J. Glob. Optim..

[15]  Abdul Sattar,et al.  Dynamic Constraint Weighting for Over-Constrained Problems , 1998, PRICAI.

[16]  Wayne J. Pullan,et al.  Towards Fewer Parameters for SAT Clause Weighting Algorithms , 2002, Australian Joint Conference on Artificial Intelligence.

[17]  Fred Glover,et al.  Tabu Search - Part II , 1989, INFORMS J. Comput..

[18]  Roland H. C. Yap,et al.  Solving Hierarchical Constraints over Finite Domains , 2000, AMAI.

[19]  Dale Schuurmans,et al.  Local search characteristics of incomplete SAT procedures , 2000, Artif. Intell..

[20]  Henry A. Kautz,et al.  Solving Problems with Hard and Soft Constraints Using a Stochastic Algorithm for MAX-SAT , 1995 .