Black box scatter search for general classes of binary optimization problems

The purpose of this paper is to apply the scatter search methodology to general classes of binary problems. We focus on optimization problems for which the solutions are represented as binary vectors and that may or may not include constraints. Binary problems arise in a variety of settings, including engineering design and statistical mechanics (e.g., the spin glass problem). A distinction is made between two sets of general constraint types that are handled directly by the solver and other constraints that are addressed via penalty functions. In both cases, however, the heuristic treats the objective function evaluation as a black box. We perform computational experiments with four well-known binary optimization problems to study the efficiency (speed) and effectiveness (solution quality) of the proposed method. Comparisons are made against both commercial software and specialized procedures on a set of 376 instances. We chose commercial software that is similar in nature to the proposed procedure, namely, it treats the objective function as a black box and the search is based on evolutionary optimization techniques.

[1]  Rafael Martí,et al.  Context-Independent Scatter and Tabu Search for Permutation Problems , 2005, INFORMS J. Comput..

[2]  Abraham Duarte,et al.  Hybridizing the cross-entropy method: An application to the max-cut problem , 2009, Comput. Oper. Res..

[3]  Fred Glover,et al.  Practical introduction to simulation optimization , 2003, Proceedings of the 2003 Winter Simulation Conference, 2003..

[4]  Catherine M. Harmonosky,et al.  An improved simulated annealing simulation optimization method for discrete parameter stochastic systems , 2005, Comput. Oper. Res..

[5]  Paola Cappanera,et al.  A Local-Search-Based Heuristic for the Demand-Constrained Multidimensional Knapsack Problem , 2001, INFORMS J. Comput..

[6]  Lars Magnus Hvattum,et al.  Adaptive memory search for multidemand multidimensional knapsack problems , 2006, Comput. Oper. Res..

[7]  Dirk P. Kroese,et al.  The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation and Machine Learning , 2004 .

[8]  Seth D. Guikema,et al.  Efficient simulation-based discrete optimization , 2004, Proceedings of the 2004 Winter Simulation Conference, 2004..

[9]  Dirk P. Kroese,et al.  The Cross Entropy Method: A Unified Approach To Combinatorial Optimization, Monte-carlo Simulation (Information Science and Statistics) , 2004 .

[10]  Hanno Lefmann,et al.  A Comparison of Approximation Algorithms for the MaxCut-Problem , 2001 .

[11]  Rafael Martí,et al.  Scatter Search: Diseño Básico y Estrategias avanzadas , 2002, Inteligencia Artif..

[12]  Paolo Toth,et al.  Knapsack Problems: Algorithms and Computer Implementations , 1990 .

[13]  Abraham Duarte,et al.  Advanced Scatter Search for the Max-Cut Problem , 2009, INFORMS J. Comput..

[14]  James P. Heaney,et al.  Robust Water System Design with Commercial Intelligent Search Optimizers , 1999 .

[15]  Teofilo F. Gonzalez,et al.  P-Complete Approximation Problems , 1976, J. ACM.

[16]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[17]  Rafael Martí,et al.  GRASP and Path Relinking for 2-Layer Straight Line Crossing Minimization , 1999, INFORMS J. Comput..

[18]  A. Duarte,et al.  Tabu Search for the Maximum Diversity Problem , 2005 .

[19]  Leon S. Lasdon,et al.  Design and Use of the Microsoft Excel Solver , 1998, Interfaces.

[20]  Luiz Satoru Ochi,et al.  Experimental Comparison of Greedy Randomized Adaptive Search Procedures for the Maximum Diversity Problem , 2004, WEA.

[21]  Micael Gallego,et al.  Hybrid heuristics for the maximum diversity problem , 2009, Comput. Optim. Appl..

[22]  Celso C. Ribeiro,et al.  A Hybrid GRASP with Perturbations for the Steiner Problem in Graphs , 2002, INFORMS J. Comput..

[23]  Panos M. Pardalos,et al.  Randomized heuristics for the Max-Cut problem , 2002, Optim. Methods Softw..

[24]  David Pisinger,et al.  An expanding-core algorithm for the exact 0-1 knapsack problem , 1995 .

[25]  Abraham Duarte,et al.  Tabu search and GRASP for the maximum diversity problem , 2007, Eur. J. Oper. Res..

[26]  David Pisinger,et al.  Core Problems in Knapsack Algorithms , 1999, Oper. Res..

[27]  Fred W. Glover,et al.  Simulation optimization: a review, new developments, and applications , 2005, Proceedings of the Winter Simulation Conference, 2005..

[28]  Fred W. Glover,et al.  A Template for Scatter Search and Path Relinking , 1997, Artificial Evolution.