A Metaheuristic Relying on Random Walk on a Graph for Binary Optimization Problems

Recently, evolutionary algorithms that can solve decomposable binary problems very efficiently have been developed. They are so-called model-based evolutionary algorithms, which build a model for generating solution candidates by a machine learning technique using a population. Their central procedure is linkage detection that reveals a problem structure, that is, how the entire problem consists of sub-problems. However, the model-based evolutionary algorithms have been shown to be ineffective against problems that are hard to identify their structures. Therefore, metaheuristics including evolutionary algorithms that can solve both problems quickly, reliably, and accurately are required. In this paper, toward realizing such algorithms, we propose a new model-based metaheuristic. It initially forms a graph in which a pair of a position and a value on the string of a solution candidate is a vertex and directed edges are randomly made between vertexes, and then repeats the following three steps: (1) conducting random walk on the graph, (2) producing solution candidates, and (3) reconstructing the topology of the graph. The simulation results show that the proposed metaheuristic is inferior to conventional algorithms against decomposable problems, but superior to conventional ones against problems that are hard to identify their structures.

[1]  David E. Goldberg,et al.  Hierarchical Problem Solving and the Bayesian Optimization Algorithm , 2000, GECCO.

[2]  Carlos M. Fonseca,et al.  On the performance of linkage-tree genetic algorithms for the multidimensional knapsack problem , 2014, Neurocomputing.

[3]  Dirk Thierens,et al.  More concise and robust linkage learning by filtering and combining linkage hierarchies , 2013, GECCO '13.

[4]  Dirk Thierens,et al.  Mixing in Genetic Algorithms , 1993, ICGA.

[5]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[6]  David E. Goldberg,et al.  Dependency Structure Matrix, Genetic Algorithms, and Effective Recombination , 2009, Evolutionary Computation.

[7]  Kalyanmoy Deb,et al.  Analyzing Deception in Trap Functions , 1992, FOGA.

[8]  G. Harik Linkage Learning via Probabilistic Modeling in the ECGA , 1999 .

[9]  David E. Goldberg,et al.  A Survey of Optimization by Building and Using Probabilistic Models , 2002, Comput. Optim. Appl..

[10]  Tian-Li Yu,et al.  Optimization by Pairwise Linkage Detection, Incremental Linkage Set, and Restricted / Back Mixing: DSMGA-II , 2015, GECCO.

[11]  John E. Beasley,et al.  A Genetic Algorithm for the Multidimensional Knapsack Problem , 1998, J. Heuristics.

[12]  Dirk Thierens,et al.  Hierarchical problem solving with the linkage tree genetic algorithm , 2013, GECCO '13.

[13]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.