Scaling Up Covariance Matrix Adaptation Evolution Strategy Using Cooperative Coevolution

Covariance matrix adaptation evolution strategy CMA-ES has demonstrated competitive performance especially on multimodal non-separable problems. However, CMA-ES is not capable of dealing with problems having several hundreds dimensions. Motivated by that cooperative coevolution CC has scaled up many kinds of evolutionary algorithms EAs to high dimensional optimization problems effectively, we propose an algorithm called CC-CMA-ES which apply CC to CMA-ES in order to scale up CMA-ES to large scale problems. CC-CMA-ES adopts a new sampling scheme which does not divide population into small subpopulations and conducts mutation and crossover operations in subpopulation to generate offspring, but extracts a subspace Gaussian distribution from the global Gaussian distribution for subspace sampling. Also in CC-CMA-ES, two new decomposition strategies are proposed in order to balance exploration and exploitation. Lastly, an adaptive scheme is adopted to self-adapt appropriate decomposition strategy during evolution process. Experimental studies on a series of benchmark functions with different characteristic have been conducted and verified the excellent performance of our newly proposed algorithm and the effectiveness of the new decomposition strategies.

[1]  Ponnuthurai Nagaratnam Suganthan,et al.  Benchmark Functions for the CEC'2013 Special Session and Competition on Large-Scale Global Optimization , 2008 .

[2]  Zhenyu Yang,et al.  Large-Scale Global Optimization Using Cooperative Coevolution with Variable Interaction Learning , 2010, PPSN.

[3]  R. Paul Wiegand,et al.  An empirical analysis of collaboration methods in cooperative coevolutionary algorithms , 2001 .

[4]  Xiaodong Li,et al.  A Comparative Study of CMA-ES on Large Scale Global Optimisation , 2010, Australasian Conference on Artificial Intelligence.

[5]  Xin Yao,et al.  Evolutionary Optimization , 2002 .

[6]  Raymond Ros,et al.  A Simple Modification in CMA-ES Achieving Linear Time and Space Complexity , 2008, PPSN.

[7]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[8]  Hussein A. Abbass,et al.  Robustness Against the Decision-Maker's Attitude to Risk in Problems With Conflicting Objectives , 2012, IEEE Transactions on Evolutionary Computation.

[9]  Xiaodong Li,et al.  Cooperatively Coevolving Particle Swarms for Large Scale Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[10]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[11]  Kenneth A. De Jong,et al.  Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents , 2000, Evolutionary Computation.

[12]  Xin Yao,et al.  Multilevel cooperative coevolution for large scale optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[13]  Nikolaus Hansen,et al.  Evaluating the CMA Evolution Strategy on Multimodal Test Functions , 2004, PPSN.

[14]  M. Giphart-Gassler,et al.  Thermo-inducible expression of cloned early genes of bacteriophage Mu. , 1979, Gene.