Exploiting linkage information in real-valued optimization with the real-valued gene-pool optimal mixing evolutionary algorithm

The recently introduced Gene-pool Optimal Mixing Evolutionary Algorithm (GOMEA) has been shown to be among the state-of-the-art for solving discrete optimization problems. Key to the success of GOMEA is its ability to efficiently exploit the linkage structure of a problem. Here, we introduce the Real-Valued GOMEA (RV-GOMEA), which incorporates several aspects of the real-valued EDA known as AMaLGaM into GOMEA in order to make GOMEA well-suited for real-valued optimization. The key strength of GOMEA to competently exploit linkage structure is effectively preserved in RV-GOMEA, enabling excellent performance on problems that exhibit a linkage structure that is to some degree decomposable. Moreover, the main variation operator of GOMEA enables substantial improvements in performance if the problem allows for partial evaluations, which may be very well possible in many real-world applications. Comparisons of performance with state-of-the-art algorithms such as CMA-ES and AMaLGaM on a set of well-known benchmark problems show that RV-GOMEA achieves comparable, excellent scalability in case of black-box optimization. Moreover, RV-GOMEA achieves unprecedented scalability on problems that allow for partial evaluations, reaching near-optimal solutions for problems with up to millions of real-valued variables within one hour on a normal desktop computer.

[1]  Shlomo Moran,et al.  Optimal implementations of UPGMA and other common clustering algorithms , 2007, Inf. Process. Lett..

[2]  Richard M. Karp,et al.  Reducibility Among Combinatorial Problems , 1972, 50 Years of Integer Programming.

[3]  Peter A. N. Bosman,et al.  A novel model-based evolutionary algorithm for multi-objective deformable image registration with content mismatch and large deformations: benchmarking efficiency and quality , 2017, Medical Imaging.

[4]  Dirk Thierens Linkage tree genetic algorithm: first results , 2010, GECCO '10.

[5]  Dirk Thierens,et al.  Benchmarking Parameter-Free AMaLGaM on Functions With and Without Noise , 2013, Evolutionary Computation.

[6]  Petros Koumoutsakos,et al.  Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES) , 2003, Evolutionary Computation.

[7]  Raymond Ros,et al.  A Simple Modification in CMA-ES Achieving Linear Time and Space Complexity , 2008, PPSN.

[8]  Dirk Thierens,et al.  Linkage neighbors, optimal mixing and forced improvements in genetic algorithms , 2012, GECCO '12.

[9]  Dirk Thierens,et al.  Optimal mixing evolutionary algorithms , 2011, GECCO '11.

[10]  Youhei Akimoto,et al.  Projection-Based Restricted Covariance Matrix Adaptation for High Dimension , 2016, GECCO.

[11]  Fernando G. Lobo,et al.  A Java Implementation of Parameter-less Evolutionary Algorithms , 2015, ArXiv.

[12]  A. Kraskov,et al.  Estimating mutual information. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  Dirk Thierens,et al.  The Linkage Tree Genetic Algorithm , 2010, PPSN.

[14]  Fernando G. Lobo,et al.  A parameter-less genetic algorithm , 1999, GECCO.