Estimating the reproductive potential of offspring in evolutionary heuristics for combinatorial optimization problems

This paper proposes a metaheuristic selection technique for controlling the progress of an evolutionary algorithm (and possibly other heuristic search techniques) to manipulate and make use of the relationship between runtime and solution quality. The paper examines the idea that very rapid increases in initial fitness may lead to premature convergence and a reported solution that is less than optimal. We examine the advantages provided by this metaheuristic selection technique in solving two different combinatorial optimization problems: including a “toy” problem of finding magic squares and a more realistic vehicle routing problem (VRP) benchmark. The method is found to be useful for finding both higher quality solutions with a marginally longer algorithm run time and for obtaining lower quality solutions in a shorter time. Furthermore, the impact on the search results is similar for both the magic square and the VRP problem providing evidence the method is scalable to other problem domains, and therefore is potentially a relatively straight forward addition to many heuristic approaches that can add value by improving both runtime and solution quality.

[1]  Gerhard W. Dueck,et al.  Threshold accepting: a general purpose optimization algorithm appearing superior to simulated anneal , 1990 .

[2]  Kenneth O. Stanley,et al.  Exploiting Open-Endedness to Solve Problems Through the Search for Novelty , 2008, ALIFE.

[3]  Josh C. Bongard,et al.  Guarding against premature convergence while accelerating evolutionary search , 2010, GECCO '10.

[4]  Fred W. Glover,et al.  Tabu Search , 1997, Handbook of Heuristics.

[5]  Kenneth A. De Jong,et al.  Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents , 2000, Evolutionary Computation.

[6]  G. Dueck New optimization heuristics , 1993 .

[7]  Jong-Hwan Kim,et al.  Genetic quantum algorithm and its application to combinatorial optimization problem , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[8]  Stéphane Doncieux,et al.  Overcoming the bootstrap problem in evolutionary robotics using behavioral diversity , 2009, 2009 IEEE Congress on Evolutionary Computation.

[9]  Luca Maria Gambardella,et al.  Ant colony system: a cooperative learning approach to the traveling salesman problem , 1997, IEEE Trans. Evol. Comput..

[10]  Marius M. Solomon,et al.  Algorithms for the Vehicle Routing and Scheduling Problems with Time Window Constraints , 1987, Oper. Res..

[11]  W. W. Ball,et al.  Mathematical Recreations and Essays , 1905, Nature.

[12]  Ingo Rechenberg,et al.  Case studies in evolutionary experimentation and computation , 2000 .

[13]  Stéphane Doncieux,et al.  Using behavioral exploration objectives to solve deceptive problems in neuro-evolution , 2009, GECCO.

[14]  Gregory Hornby,et al.  ALPS: the age-layered population structure for reducing the problem of premature convergence , 2006, GECCO.

[15]  Günter Rudolph,et al.  Self-adaptive mutations may lead to premature convergence , 2001, IEEE Trans. Evol. Comput..

[16]  Lishan Kang,et al.  An evolutionary algorithm for magic squares , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[17]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.