Online Bayesian Moment Matching based SAT Solver Heuristics

In this paper, we present a Bayesian Moment Matching (BMM) based method aimed at solving the initialization problem in Boolean SAT solvers. The initialization problem can be stated as follows: given a SAT formula φ, compute an initial order over the variables of φ and values/polarity for these variables such that the runtime of SAT solvers on input φ is minimized. At the start of a solver run, our BMM-based methods compute a posterior probability distribution for an assignment to the variables of the input formula after analyzing its clauses, which will then be used by the solver to initialize its search. We perform extensive experiments to evaluate the efficacy of our BMM-based heuristic against 4 other initialization methods (random, survey propagation, Jeroslow-Wang, and default) in state-of-the-art solvers, MapleCOMSPS and MapleLCMDistChronotBT over the SAT competition 2018 application benchmark, as well as the best-known solvers in the cryptographic category, namely, CryptoMiniSAT, Glucose, and MapleSAT. On the cryptographic benchmark, BMMbased solvers out-perform all other initialization methods. Further, the BMM-based MapleCOMSPS significantly out-perform the same solver using all other initialization methods by 12 additional instances solved and better average runtime, over the SAT 2018 competition benchmark.

[1]  H. Kushner,et al.  Stochastic Approximation and Recursive Algorithms and Applications , 2003 .

[2]  Chunxiao Li,et al.  Machine Learning-Based Restart Policy for CDCL SAT Solvers , 2018, SAT.

[3]  Dawson R. Engler,et al.  EXE: automatically generating inputs of death , 2006, CCS '06.

[4]  V. Borkar Stochastic Approximation: A Dynamical Systems Viewpoint , 2008 .

[5]  Joao Marques-Silva,et al.  GRASP: A Search Algorithm for Propositional Satisfiability , 1999, IEEE Trans. Computers.

[6]  Jinchang Wang,et al.  Solving propositional satisfiability problems , 1990, Annals of Mathematics and Artificial Intelligence.

[7]  P. Hall,et al.  Martingale Limit Theory and Its Application , 1980 .

[8]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[9]  Farheen Omar,et al.  Online Bayesian Learning in Probabilistic Graphical Models using Moment Matching with Applications , 2016 .

[10]  Aaron R. Bradley,et al.  SAT-Based Model Checking without Unrolling , 2011, VMCAI.

[11]  P. R. Nelson Continuous Univariate Distributions Volume 2 , 1996 .

[12]  Fan Xiao,et al.  A branching heuristic for SAT solvers based on complete implication graphs , 2019, Science China Information Sciences.

[13]  Riccardo Zecchina,et al.  Survey propagation: An algorithm for satisfiability , 2002, Random Struct. Algorithms.

[14]  Marijn J. H. Heule,et al.  SAT Competition 2018 , 2019, J. Satisf. Boolean Model. Comput..

[15]  Krzysztof Czarnecki,et al.  Adaptive Restart and CEGAR-Based Solver for Inverting Cryptographic Hash Functions , 2016, VSTTE.

[16]  Krzysztof Czarnecki,et al.  Understanding VSIDS Branching Heuristics in Conflict-Driven Clause-Learning SAT Solvers , 2015, Haifa Verification Conference.

[17]  Jussi Rintanen Planning and SAT , 2009, Handbook of Satisfiability.

[18]  Ye Chen,et al.  Technical Note - Consistency Analysis of Sequential Learning Under Approximate Bayesian Inference , 2020, Oper. Res..

[19]  Vegard Nossum,et al.  SAT-based preimage attacks on SHA-1 , 2012 .

[20]  N. L. Johnson,et al.  Continuous Univariate Distributions. , 1995 .

[21]  Pascal Poupart,et al.  A Propagation Rate Based Splitting Heuristic for Divide-and-Conquer Solvers , 2017, SAT.

[22]  Han Zhao,et al.  Online and Distributed Bayesian Moment Matching for Parameter Learning in Sum-Product Networks , 2016, AISTATS.

[23]  Pascal Poupart,et al.  Online Bayesian Moment Matching for Topic Modeling with Unknown Number of Topics , 2016, NIPS.

[24]  You Li,et al.  Optimizing the Initialization of Dynamic Decision Heuristics in DPLL SAT Solvers Using Genetic Programming , 2006, EuroGP.

[25]  Krzysztof Czarnecki,et al.  Learning Rate Based Branching Heuristic for SAT Solvers , 2016, SAT.

[26]  Krzysztof Czarnecki,et al.  An Empirical Study of Branching Heuristics Through the Lens of Global Learning Rate , 2017, SAT.

[27]  David Brumley,et al.  AEG: Automatic Exploit Generation , 2011, NDSS.

[28]  Pascal Poupart,et al.  Online and Distributed learning of Gaussian mixture models by Bayesian Moment Matching , 2016, ArXiv.

[29]  Sharad Malik,et al.  Chaff: engineering an efficient SAT solver , 2001, Proceedings of the 38th Design Automation Conference (IEEE Cat. No.01CH37232).