Learning to Integrate Deduction and Search in Reasoning about Quantified Boolean Formulas

In this paper we study the problem of integrating deduction and search with the aid of machine learning techniques to yield practically efficient decision procedures for quantified Boolean formulas (QBFs). We show that effective on-line policies can be learned from the observed performances of deduction and search on representative sets of formulas. Such policies can be leveraged to switch between deduction and search during the solving process. We provide empirical evidence that learned policies perform better than either deduction and search, even when the latter are combined using hand-made policies based on previous works. The fact that even with a proof-of-concept implementation, our approach is competitive with sophisticated state-of-the-art QBF solvers shows the potential of machine learning techniques in the integration of different reasoning methods.

[1]  Fahiem Bacchus,et al.  Binary Clause Reasoning in QBF , 2006, SAT.

[2]  Luca Pulina,et al.  Treewidth: A Useful Marker of Empirical Hardness in Quantified Boolean Logic Encodings , 2008, LPAR.

[3]  Hans Kleine Büning,et al.  Resolution for Quantified Boolean Formulas , 1995, Inf. Comput..

[4]  Ian Witten,et al.  Data Mining , 2000 .

[5]  Alex K. Simpson,et al.  Computational Adequacy in an Elementary Topos , 1998, CSL.

[6]  Moshe Y. Vardi,et al.  Symbolic Decision Procedures for QBF , 2004, CP.

[7]  Armin Biere,et al.  Theory and Applications of Satisfiability Testing - SAT 2006, 9th International Conference, Seattle, WA, USA, August 12-15, 2006, Proceedings , 2006, SAT.

[8]  Bart Selman,et al.  The Achilles' Heel of QBF , 2005, AAAI.

[9]  Marco Schaerf,et al.  An Algorithm to Evaluate Quantified Boolean Formulae , 1998, AAAI/IAAI.

[10]  Georg Gottlob,et al.  The Complexity of Quantified Constraint Satisfaction Problems under Structural Restrictions , 2005, IJCAI.

[11]  Hans L. Bodlaender A linear time algorithm for finding tree-decompositions of small treewidth , 1993, STOC '93.

[12]  Horst Samulowitz,et al.  Learning to Solve QBF , 2007, AAAI.

[13]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[14]  Moshe Y. Vardi,et al.  Fixed-Parameter Hierarchies inside PSPACE , 2006, 21st Annual IEEE Symposium on Logic in Computer Science (LICS'06).

[15]  Armando Tacchella,et al.  Clause/Term Resolution and Learning in the Evaluation of Quantified Boolean Formulas , 2006, J. Artif. Intell. Res..

[16]  Graham Steel,et al.  Deduction with XOR Constraints in Security API Modelling , 2005, CADE.

[17]  Georg Gottlob,et al.  A Comparison of Structural CSP Decomposition Methods , 1999, IJCAI.

[18]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[19]  Armin Biere,et al.  Resolve and Expand , 2004, SAT.

[20]  Armando Tacchella,et al.  Backjumping for Quantified Boolean Logic satisfiability , 2001, Artif. Intell..

[21]  Luca Pulina,et al.  A self-adaptive multi-engine solver for quantified Boolean formulas , 2009, Constraints.

[22]  Stefan Woltran,et al.  Solving Advanced Reasoning Tasks Using Quantified Boolean Formulas , 2000, AAAI/IAAI.

[23]  Vladimir Vapnik,et al.  The Nature of Statistical Learning , 1995 .

[24]  Hubie Chen,et al.  From Pebble Games to Tractability: An Ambidextrous Consistency Algorithm for Quantified Constraint Satisfaction , 2005, CSL.

[25]  Rina Dechter,et al.  Resolution versus Search: Two Strategies for SAT , 2000, Journal of Automated Reasoning.

[26]  Marco Benedetti,et al.  sKizzo: A Suite to Evaluate and Certify QBFs , 2005, CADE.

[27]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[28]  Mark Wallace,et al.  Principles and Practice of Constraint Programming – CP 2004 , 2004, Lecture Notes in Computer Science.

[29]  Frank Wolter,et al.  Monodic fragments of first-order temporal logics: 2000-2001 A.D , 2001, LPAR.

[30]  S. Malik,et al.  Validating the result of a quantified Boolean formula (QBF) solver: theory and practice , 2005, Proceedings of the ASP-DAC 2005. Asia and South Pacific Design Automation Conference, 2005..

[31]  Javier Larrosa,et al.  Boosting Search with Variable Elimination in Constraint Optimization and Constraint Satisfaction Problems , 2003, Constraints.

[32]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[33]  Karem A. Sakallah,et al.  Computing Vertex Eccentricity in Exponentially Large Graphs: QBF Formulation and Solution , 2003, SAT.