Exploiting Erraticism in Search

High sensitivity to initial conditions is generally viewed as a drawback of tree search methods because it leads to erratic behavior to be mitigated somehow. In this paper we investigate the opposite viewpoint and consider this behavior as an opportunity to exploit. Our working hypothesis is that erraticism is in fact just a consequence of the exponential nature of tree search that acts as a chaotic amplifier, so it is largely unavoidable. We propose a bet-and-run approach to actually turn erraticism to one's advantage. The idea is to make a number of short sample runs with randomized initial conditions, to bet on the “most promising” run selected according to certain simple criteria, and to bring it to completion. Computational results on a large testbed of mixed integer linear programs from the literature are presented, showing the potential of this approach even when embedded in a proof-of-concept implementation.

[1]  Yuri Malitsky,et al.  Backdoors to Combinatorial Optimization: Feasibility and Optimality , 2009, CPAIOR.

[2]  Thorsten Koch,et al.  What could a million CPUs do to solve Integer Programs , 2011 .

[3]  Thorsten Koch,et al.  Could we use a million cores to solve an integer program? , 2012, Mathematical Methods of Operations Research.

[4]  Jinbo Huang,et al.  The Effect of Restarts on the Efficiency of Clause Learning , 2007, IJCAI.

[5]  Yuji Shinano,et al.  A Dynamic Load Balancing Mechanism for New ParaLEX , 2008, 2008 14th IEEE International Conference on Parallel and Distributed Systems.

[6]  Andrea Lodi,et al.  Mixed Integer Programming Library version 5 , 2011 .

[7]  Yuji Shinano,et al.  ParaLEX: A Parallel Extension for the CPLEX Mixed Integer Optimizer , 2007, PVM/MPI.

[8]  Bart Selman,et al.  Boosting Combinatorial Search Through Randomization , 1998, AAAI/IAAI.

[9]  Bart Selman,et al.  Heavy-Tailed Phenomena in Satisfiability and Constraint Satisfaction Problems , 2000, Journal of Automated Reasoning.

[10]  Gérard Cornuéjols,et al.  Early Estimates of the Size of Branch-and-Bound Trees , 2006, INFORMS J. Comput..

[11]  Bart Selman,et al.  Algorithm Portfolio Design: Theory vs. Practice , 1997, UAI.

[12]  Jeff T. Linderoth,et al.  Solving large quadratic assignment problems on computational grids , 2002, Math. Program..

[13]  Bart Selman,et al.  Heavy-Tailed Distributions in Combinatorial Search , 1997, CP.

[14]  Matteo Fischetti,et al.  Backdoor Branching , 2011, INFORMS J. Comput..

[15]  Bart Selman,et al.  Randomization in Backtrack Search: Exploiting Heavy-Tailed Profiles for Solving Hard Scheduling Problems , 1998, AIPS.

[16]  Andrea Lodi,et al.  Performance Variability in Mixed-Integer Programming , 2013 .

[17]  Thorsten Koch,et al.  ParaSCIP: A Parallel Extension of SCIP , 2010, CHPC.

[18]  Martin W. P. Savelsbergh,et al.  Information-based branching schemes for binary linear mixed integer problems , 2009, Math. Program. Comput..

[19]  Marijn J. H. Heule,et al.  Towards Ultra Rapid Restarts , 2014, ArXiv.

[20]  Andrea Lodi,et al.  MIPLIB 2010 , 2011, Math. Program. Comput..