Algorithm Engineering

One important category of SAT solver implementations use stochastic local search (SLS, for short). These solvers try to find a satisfying assignment for the input Boolean formula (mostly, required to be in CNF) by modifying the (mostly randomly chosen) initial assignment by bit flips until a satisfying assignment is possibly reached. Usually such SLS type algorithms proceed in a greedy fashion by increasing the number of satisfied clauses until some local optimum is reached. Trying to find its way out of such local optima typically requires the use of randomness. We present an easy, straightforward SLS type SAT solver, called probSAT, which uses just one simple strategy being based on biased probabilistic flips. Within an extensive empirical study we evaluate the current state-of-the-art solvers on a wide range of SAT problems, and show that our approach is able to exceed the performance of other solv-

[1]  Lars Michael Kristensen,et al.  Efficient Path Finding with the Sweep-Line Method Using External Storage , 2003, ICFEM.

[2]  Jan Vondrák,et al.  Dependent Randomized Rounding via Exchange Properties of Combinatorial Structures , 2010, 2010 IEEE 51st Annual Symposium on Foundations of Computer Science.

[3]  Thomas Sauerwald,et al.  Quasirandom rumor spreading: An experimental analysis , 2009, JEAL.

[4]  JAMAL N. AL-KARAKI,et al.  Routing techniques in wireless sensor networks: a survey , 2004, IEEE Wireless Communications.

[5]  Nathan R. Sturtevant,et al.  Minimizing Writes in Parallel External Memory Search , 2013, IJCAI.

[6]  Mahmoud Fouz,et al.  Experimental Analysis of Rumor Spreading in Social Networks , 2012, MedAlg.

[7]  Abdelkader Sbihi,et al.  A cooperative local search-based algorithm for the Multiple-Scenario Max-Min Knapsack Problem , 2010, Eur. J. Oper. Res..

[8]  J. Spencer Ten lectures on the probabilistic method , 1987 .

[9]  Nathan R. Sturtevant External Memory PDBs: Initial Results , 2013, SARA.

[10]  Roberto Montemanni,et al.  A Benders decomposition approach for the robust spanning tree problem with interval data , 2006, Eur. J. Oper. Res..

[11]  R. Tütüncü,et al.  Adjustable Robust Optimization Models for a Nonlinear Two-Period System , 2008 .

[12]  Chandra Chekuri,et al.  Dependent Randomized Rounding for Matroid Polytopes and Applications , 2009, 0909.4348.

[13]  Thomas Rothvoß,et al.  The entropy rounding method in approximation algorithms , 2011, SODA.

[14]  Magnus Wahlström,et al.  Hardness of discrepancy computation and epsilon-net verification in high dimension , 2011, ArXiv.

[15]  José Luis González Velarde,et al.  Adaptive memory programing for the robust capacitated international sourcing problem , 2008, Comput. Oper. Res..

[16]  Christopher D. Rosin,et al.  Nested Rollout Policy Adaptation for Monte Carlo Tree Search , 2011, IJCAI.

[17]  Yuchung J. Wang,et al.  Stochastic Blockmodels for Directed Graphs , 1987 .

[18]  Silke Wagner,et al.  Comparing Clusterings - An Overview , 2007 .

[19]  Jonathan Schaeffer,et al.  Checkers Is Solved , 2007, Science.

[20]  R. Reemtsen Some outer approximation methods for semi-infinite optimization problems , 1994 .

[21]  Xiaowei Xu,et al.  SCAN: a structural clustering algorithm for networks , 2007, KDD '07.

[22]  Igor Averbakh,et al.  Exact and heuristic algorithms for the interval data robust assignment problem , 2011, Comput. Oper. Res..

[23]  Amin Saberi,et al.  An O(log n/ log log n)-approximation algorithm for the asymmetric traveling salesman problem , 2010, SODA '10.

[24]  Harald Niederreiter,et al.  Random number generation and Quasi-Monte Carlo methods , 1992, CBMS-NSF regional conference series in applied mathematics.

[25]  Rajiv Gandhi,et al.  Dependent rounding and its applications to approximation algorithms , 2006, JACM.

[26]  Gábor Tardos,et al.  A constructive proof of the general lovász local lemma , 2009, JACM.

[27]  Tomas Rokicki,et al.  The Diameter of the Rubik's Cube Group Is Twenty , 2013, SIAM J. Discret. Math..

[28]  Prasad Raghavendra,et al.  How to Round Any CSP , 2009, 2009 50th Annual IEEE Symposium on Foundations of Computer Science.

[29]  Gabriel Kliot,et al.  Streaming graph partitioning for large distributed graphs , 2012, KDD.

[30]  Robert J. Vanderbei,et al.  Robust Optimization of Large-Scale Systems , 1995, Oper. Res..

[31]  Benjamin Doerr Non-independent randomized rounding , 2003, SODA '03.

[32]  Ulrich Meyer,et al.  Algorithms for Memory Hierarchies , 2003, Lecture Notes in Computer Science.

[33]  Paolo Toth,et al.  On exact solutions for the Minmax Regret Spanning Tree problem , 2014, Comput. Oper. Res..

[34]  Benjamin Doerr Structured Randomized Rounding and Coloring , 2001, FCT.

[35]  James B. Orlin,et al.  Max flows in O(nm) time, or better , 2013, STOC '13.

[36]  Aravind Srinivasan,et al.  A new approximation technique for resource‐allocation problems , 2010, ICS.

[37]  Thorsten Schütt,et al.  Very large pattern databases for heuristic search , 2010, HPDC '10.

[38]  Jan Vondrák,et al.  Multi-budgeted matchings and matroid intersection via dependent rounding , 2011, SODA '11.

[39]  Benjamin Doerr Generating Randomized Roundings with Cardinality Constraints and Derandomizations , 2006, STACS.

[40]  Richard E. Korf,et al.  Recent Progress in Heuristic Search: A Case Study of the Four-Peg Towers of Hanoi Problem , 2007, IJCAI.

[41]  Anita Schöbel,et al.  Generalized light robustness and the trade-off between robustness and nominal quality , 2014, Math. Methods Oper. Res..

[42]  Roberto Montemanni,et al.  A branch and bound algorithm for the robust spanning tree problem with interval data , 2002, Eur. J. Oper. Res..

[43]  Kurt Mehlhorn,et al.  External-Memory Breadth-First Search with Sublinear I/O , 2002, ESA.

[44]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[45]  W. Zachary,et al.  An Information Flow Model for Conflict and Fission in Small Groups , 1977, Journal of Anthropological Research.

[46]  Maxim Sviridenko,et al.  Pipage Rounding: A New Method of Constructing Algorithms with Proven Performance Guarantee , 2004, J. Comb. Optim..

[47]  Bo Zhao,et al.  Community evolution detection in dynamic heterogeneous information networks , 2010, MLG '10.

[48]  Malte Helmert,et al.  Landmarks Revisited , 2008, AAAI.

[49]  Richard E. Korf,et al.  Finding Optimal Solutions to Rubik's Cube Using Pattern Databases , 1997, AAAI/IAAI.

[50]  Prabhakar Raghavan,et al.  Randomized rounding: A technique for provably good algorithms and algorithmic proofs , 1985, Comb..

[51]  Paul Erdös,et al.  On a Combinatorial Game , 1973, J. Comb. Theory A.

[52]  Richard E. Korf Minimizing Disk I/O in Two-Bit Breadth-First Search , 2008, AAAI.

[53]  J. Spencer Six standard deviations suffice , 1985 .

[54]  Richard E. Korf,et al.  Best-First Frontier Search with Delayed Duplicate Detection , 2004, AAAI.

[55]  Thorsten Schütt,et al.  Out-of-Core Parallel Frontier Search with MapReduce , 2009, HPCS.

[56]  A. Vázquez Growing network with local rules: preferential attachment, clustering hierarchy, and degree correlations. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[57]  David P. Williamson,et al.  Iterative rounding 2-approximation algorithms for minimum-cost vertex connectivity problems , 2006, J. Comput. Syst. Sci..

[58]  Charu C. Aggarwal,et al.  Graph Clustering , 2010, Encyclopedia of Machine Learning and Data Mining.

[59]  Christian Staudt,et al.  Engineering High-Performance Community Detection Heuristics for Massive Graphs , 2013, 2013 42nd International Conference on Parallel Processing.

[60]  Peter Sanders Algorithm Engineering , 2010, Informatik-Spektrum.

[61]  Joel H. Spencer,et al.  Deterministic Discrepancy Minimization , 2011, ESA.

[62]  Adam Ouorou Tractable approximations to a robust capacity assignment model in telecommunications under demand uncertainty , 2013, Comput. Oper. Res..

[63]  J. Krüger,et al.  Linear algebra operators for GPU implementation of numerical algorithms , 2003, ACM Trans. Graph..

[64]  Martin Mares,et al.  Linear-Time Ranking of Permutations , 2007, ESA.

[65]  Thomas Sauerwald,et al.  Quasirandom Rumor Spreading: Expanders, Push vs. Pull, and Robustness , 2009, ICALP.

[66]  James G. Oxley,et al.  Matroid theory , 1992 .

[67]  Yafeng Yin,et al.  Production , Manufacturing and Logistics Robust improvement schemes for road networks under demand uncertainty , 2009 .

[68]  Eric A. Hansen,et al.  Breadth-first heuristic search , 2004, Artif. Intell..

[69]  Anton Wijs,et al.  What to do next? Analysing and optimising system behaviour in time , 2007 .

[70]  Jianbo Shi,et al.  Multiclass spectral clustering , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[71]  Benjamin Doerr,et al.  MULTI – COLOR DISCREPANCIES , 2004 .

[72]  Krishna P. Gummadi,et al.  On the evolution of user interaction in Facebook , 2009, WOSN '09.

[73]  Daoud Aït-Kadi,et al.  Robust production planning in a manufacturing environment with random yield: A case in sawmill production planning , 2010, Eur. J. Oper. Res..

[74]  Robin Sibson,et al.  SLINK: An Optimally Efficient Algorithm for the Single-Link Cluster Method , 1973, Comput. J..

[75]  Yury Nikulin Simulated annealing algorithm for the robust spanning tree problem , 2008, J. Heuristics.

[76]  David Eppstein,et al.  Computing the discrepancy with applications to supersampling patterns , 1996, TOGS.

[77]  Richard E. Korf,et al.  Divide-and-Conquer Frontier Search Applied to Optimal Sequence Alignment , 2000, AAAI/IAAI.

[78]  Richard E. Korf,et al.  Large-Scale Parallel Breadth-First Search , 2005, AAAI.

[79]  Aravind Srinivasan,et al.  Distributions on level-sets with applications to approximation algorithms , 2001, Proceedings 2001 IEEE International Conference on Cluster Computing.

[80]  Csaba Szepesvári,et al.  Bandit Based Monte-Carlo Planning , 2006, ECML.

[81]  Eric A. Hansen,et al.  Structured Duplicate Detection in External-Memory Graph Search , 2004, AAAI.

[82]  Myra Spiliopoulou,et al.  MONIC: modeling and monitoring cluster transitions , 2006, KDD '06.

[83]  Aravind Srinivasan,et al.  Randomized Distributed Edge Coloring via an Extension of the Chernoff-Hoeffding Bounds , 1997, SIAM J. Comput..

[84]  Thorsten Schütt,et al.  MR‐search: massively parallel heuristic search , 2013, Concurr. Comput. Pract. Exp..

[85]  Rajiv Gandhi,et al.  Dependent rounding in bipartite graphs , 2002, The 43rd Annual IEEE Symposium on Foundations of Computer Science, 2002. Proceedings..

[86]  Magnus Wahlström,et al.  Randomized Rounding in the Presence of a Cardinality Constraint , 2009, ALENEX.

[87]  Juraj Hromkovič Design and Analysis of Randomized Algorithms , 2005 .

[88]  Mahmoud Fouz,et al.  Why rumors spread so quickly in social networks , 2012, Commun. ACM.

[89]  Benjamin Doerr Randomly Rounding Rationals with Cardinality Constraints and Derandomizations , 2007, STACS.

[90]  Gene Cooperman,et al.  Solving Rubik's Cube: disk is the new RAM , 2008, CACM.

[91]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[92]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[93]  Lise Getoor,et al.  Co-evolution of social and affiliation networks , 2009, KDD.

[94]  S. Schroedl An Improved Search Algorithm for Optimal Multiple-Sequence Alignment , 2005, J. Artif. Intell. Res..

[95]  Richard E. Korf,et al.  Disjoint pattern database heuristics , 2002, Artif. Intell..

[96]  Bernard Roy,et al.  Robustness in operational research and decision aiding: A multi-faceted issue , 2010, Eur. J. Oper. Res..

[97]  Benjamin Doerr,et al.  Construction of Low-Discrepancy Point Sets of Small Size by Bracketing Covers and Dependent Randomized Rounding , 2008 .

[98]  Ilya R. Fischhoff,et al.  Network metrics reveal differences in social organization between two fission–fusion species, Grevy’s zebra and onager , 2007, Oecologia.

[99]  Philip S. Yu,et al.  Colibri: fast mining of large static and dynamic graphs , 2008, KDD.

[100]  Peter Sanders Algorithm Engineering - An Attempt at a Definition , 2009, Efficient Algorithms.

[101]  Philip S. Yu,et al.  GraphScope: parameter-free mining of large time-evolving graphs , 2007, KDD '07.

[102]  Kamal Jain,et al.  A Factor 2 Approximation Algorithm for the Generalized Steiner Network Problem , 1998, Proceedings 39th Annual Symposium on Foundations of Computer Science (Cat. No.98CB36280).

[103]  Akihiro Kishimoto,et al.  Scalable, Parallel Best-First Search for Optimal Sequential Planning , 2009, ICAPS.

[104]  Jirí Síma,et al.  On the NP-Completeness of Some Graph Cluster Measures , 2005, SOFSEM.

[105]  D. Watts Networks, Dynamics, and the Small‐World Phenomenon1 , 1999, American Journal of Sociology.

[106]  Yihong Gong,et al.  Detecting communities and their evolutions in dynamic social networks—a Bayesian approach , 2011, Machine Learning.

[107]  Richard E. Korf,et al.  Frontier search , 2005, JACM.

[108]  Volker Tresp,et al.  Soft Clustering on Graphs , 2005, NIPS.

[109]  Shapour Azarm,et al.  A modified Benders decomposition method for efficient robust optimization under interval uncertainty , 2011 .

[110]  Philip S. Yu,et al.  On Graph Stream Clustering with Side Information , 2013, SDM.

[111]  Boleslaw K. Szymanski,et al.  LabelRank: A stabilized label propagation algorithm for community detection in networks , 2013, 2013 IEEE 2nd Network Science Workshop (NSW).

[112]  Jonathan Schaeffer,et al.  Solving Checkers , 2005, IJCAI.

[113]  Sebastian Stiller,et al.  Extending Concepts of Reliability - Network Creation Games, Real-time Scheduling, and Robust Optimization , 2009 .

[114]  David J. Thuente Technical Note - Duality Theory for Generalized Linear Programs with Computational Methods , 1980, Oper. Res..

[115]  Frank Ruskey,et al.  Ranking and unranking permutations in linear time , 2001, Inf. Process. Lett..

[116]  Mao-Bin Hu,et al.  Detect overlapping and hierarchical community structure in networks , 2008, ArXiv.

[117]  Harold N. Gabow,et al.  Packing algorithms for arborescences (and spanning trees) in capacitated graphs , 1995, Math. Program..

[118]  Magnus Wahlström,et al.  Randomized Rounding for Routing and Covering Problems: Experiments and Improvements , 2010, SEA.

[119]  John W. Fowler,et al.  Semiconductor lot allocation using robust optimization , 2010, Eur. J. Oper. Res..

[120]  Osmar R. Zaïane,et al.  Incremental local community identification in dynamic social networks , 2013, 2013 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2013).

[121]  Benjamin Doerr,et al.  Quasirandom rumor spreading , 2008, SODA 2008.

[122]  Kamesh Munagala,et al.  I/O-complexity of graph algorithms , 1999, SODA '99.

[123]  Jonathan M. Thompson,et al.  An incomplete m-exchange algorithm for solving the large-scale multi-scenario knapsack problem , 2012, Comput. Oper. Res..

[124]  Amedeo Caflisch,et al.  Efficient modularity optimization by multistep greedy algorithm and vertex mover refinement. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[125]  Laxmikant V. Kalé,et al.  Scalable molecular dynamics with NAMD , 2005, J. Comput. Chem..

[126]  Boleslaw K. Szymanski,et al.  LabelRankT: incremental community detection in dynamic networks via label propagation , 2013, DyNetMM '13.

[127]  William H. Cunningham,et al.  Testing membership in matroid polyhedra , 1984, J. Comb. Theory, Ser. B.

[128]  Hande Yaman,et al.  The robust spanning tree problem with interval data , 2001, Oper. Res. Lett..

[129]  Nikhil Bansal,et al.  Constructive Algorithms for Discrepancy Minimization , 2010, 2010 IEEE 51st Annual Symposium on Foundations of Computer Science.

[130]  Magnus Wahlström,et al.  Algorithmic construction of low-discrepancy point sets via dependent randomized rounding , 2010, J. Complex..

[131]  Allen L. Soyster,et al.  Technical Note - Convex Programming with Set-Inclusive Constraints and Applications to Inexact Linear Programming , 1973, Oper. Res..

[132]  Mahmoud Fouz,et al.  Social networks spread rumors in sublogarithmic time , 2011, STOC '11.

[133]  Peter Kritzer,et al.  Component-by-component construction of low-discrepancy point sets of small size , 2008, Monte Carlo Methods Appl..

[134]  Satoshi Suzuki,et al.  Surrogate duality for robust optimization , 2013, Eur. J. Oper. Res..

[135]  Magnus Wahlström,et al.  Implementation of a Component-By-Component Algorithm to Generate Small Low-Discrepancy Samples , 2009 .

[136]  T. Snijders,et al.  Estimation and Prediction for Stochastic Blockmodels for Graphs with Latent Block Structure , 1997 .

[137]  Alexander Schrijver,et al.  Combinatorial optimization. Polyhedra and efficiency. , 2003 .

[138]  Takeo Yamada,et al.  Heuristic and exact algorithms for the max-min optimization of the multi-scenario knapsack problem , 2008, Comput. Oper. Res..

[139]  David P. Williamson,et al.  Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming , 1995, JACM.

[140]  Richard E. Korf,et al.  Linear-Space Best-First Search , 1993, Artif. Intell..

[141]  Bernd Finkbeiner,et al.  Uppaal/DMC- Abstraction-Based Heuristics for Directed Model Checking , 2007, TACAS.

[142]  Jianhua Xu,et al.  Robust placement of sensors in dynamic water distribution systems , 2010, Eur. J. Oper. Res..

[143]  Alfred O. Hero,et al.  Tracking Communities in Dynamic Social Networks , 2011, SBP.

[144]  Stephen P. Boyd,et al.  Cutting-set methods for robust convex optimization with pessimizing oracles , 2009, Optim. Methods Softw..

[145]  Doug Terry,et al.  Epidemic algorithms for replicated database maintenance , 1988, OPSR.

[146]  Eric A. Hansen,et al.  Edge Partitioning in External-Memory Graph Search , 2007, IJCAI.

[147]  Osmar R. Zaïane,et al.  Tracking changes in dynamic information networks , 2011, 2011 International Conference on Computational Aspects of Social Networks (CASoN).

[148]  Roberto Montemanni,et al.  An exact algorithm for the robust shortest path problem with interval data , 2004, Comput. Oper. Res..

[149]  Magnus Wahlström,et al.  Dependent Randomized Rounding: The Bipartite Case , 2011, ALENEX.

[150]  Eric A. Hansen,et al.  External-Memory Pattern Databases Using Structured Duplicate Detection , 2005, AAAI.

[151]  Prasad Raghavendra,et al.  Optimal algorithms and inapproximability results for every CSP? , 2008, STOC.

[152]  Peter Stangier,et al.  Algorithmic Chernoff-Hoeffding inequalities in integer programming , 1996, Random Struct. Algorithms.

[153]  Magnus Wahlström,et al.  A New Randomized Algorithm to Approximate the Star Discrepancy Based on Threshold Accepting , 2012, SIAM J. Numer. Anal..