Benchmarking the (1,4)-CMA-ES with mirrored sampling and sequential selection on the noisy BBOB-2010 testbed

The Covariance-Matrix-Adaptation Evolution-Strategy (CMA-ES) is a robust stochastic search algorithm for optimizing functions defined on a continuous search space RD. Recently, mirrored samples and sequential selection have been introduced within CMA-ES to improve its local search performances. In this paper, we benchmark the (1,4ms)-CMA-ES which implements mirrored samples and sequential selection on the BBOB-2010 noisy testbed. Independent restarts are conducted until a maximal number of 104 D function evaluations is reached. Although the tested (1,4ms)-CMA-ES is only a local search strategy, it solves 8 of the noisy BBOB-2010 functions in 20D and 9 of them in 5D for a target of 10-8. There is also one additional function in 20D and 5 additional functions in 5D where a successful run for at least one of the 15 instances can be reported. Moreover, on 7 of the 8 functions that are solved by the (1,4ms)-CMA-ES in 20D, we see a large improvement over the best algorithm of the BBOB-2009 benchmarking for the corresponding functions--ranging from an 37% improvement on the sphere with moderate Cauchy noise to a speed-up by a factor of about 3 on the Gallagher function with Cauchy noise.

[1]  Anne Auger,et al.  Mirrored Sampling and Sequential Selection for Evolution Strategies , 2010, PPSN.

[2]  Nikolaus Hansen,et al.  A restart CMA evolution strategy with increasing population size , 2005, 2005 IEEE Congress on Evolutionary Computation.

[3]  Anne Auger,et al.  Comparing results of 31 algorithms from the black-box optimization benchmarking BBOB-2009 , 2010, GECCO '10.

[4]  Anne Auger,et al.  Benchmarking the (1+1)-CMA-ES on the BBOB-2009 function testbed , 2009, GECCO '09.

[5]  Nikolaus Hansen,et al.  Benchmarking a BI-population CMA-ES on the BBOB-2009 noisy testbed , 2009, GECCO '09.

[6]  Anne Auger,et al.  Investigating the impact of sequential selection in the (1,2)-CMA-ES on the noisy BBOB-2010 testbed , 2010, GECCO '10.

[7]  Anne Auger,et al.  BBOB 2009: Comparison Tables of All Algorithms on All Noiseless Functions , 2010 .

[8]  Nikolaus Hansen,et al.  The CMA Evolution Strategy: A Comparing Review , 2006, Towards a New Evolutionary Computation.

[9]  Anne Auger,et al.  Benchmarking the (1+1)-CMA-ES on the BBOB-2009 noisy testbed , 2009, GECCO '09.

[10]  Anne Auger,et al.  Real-Parameter Black-Box Optimization Benchmarking 2009: Noiseless Functions Definitions , 2009 .

[11]  Andrew M. Sutton,et al.  The Impact of Global Structure on Search , 2008, PPSN.

[12]  Nikolaus Hansen,et al.  Evaluating the CMA Evolution Strategy on Multimodal Test Functions , 2004, PPSN.

[13]  Anne Auger,et al.  Mirrored variants of the (1,4)-CMA-ES compared on the noisy BBOB-2010 testbed , 2010, GECCO '10.

[14]  Raymond Ros,et al.  Benchmarking sep-CMA-ES on the BBOB-2009 noisy testbed , 2009, GECCO '09.

[15]  Anne Auger,et al.  Benchmarking the (1,4)-CMA-ES with mirrored sampling and sequential selection on the noiseless BBOB-2010 testbed , 2010, GECCO '10.

[16]  Anne Auger,et al.  Investigating the impact of sequential selection in the (1,2)-CMA-ES on the noiseless BBOB-2010 testbed , 2010, GECCO '10.

[17]  Carlos García-Martínez,et al.  A continuous variable neighbourhood search based on specialised eas: application to the noisy BBO-benchmark 2009 testbed , 2009, GECCO '09.

[18]  Anne Auger,et al.  Mirrored variants of the (1,2)-CMA-ES compared on the noisy BBOB-2010 testbed , 2010, GECCO '10.

[19]  Anne Auger,et al.  Mirrored variants of the (1,4)-CMA-ES compared on the noiseless BBOB-2010 testbed , 2010, GECCO '10.

[20]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[21]  Anne Auger,et al.  Mirrored variants of the (1,2)-CMA-ES compared on the noiseless BBOB-2010 testbed , 2010, GECCO '10.

[22]  Nikolaus Hansen,et al.  Benchmarking a BI-population CMA-ES on the BBOB-2009 function testbed , 2009, GECCO '09.

[23]  Raymond Ros,et al.  Real-Parameter Black-Box Optimization Benchmarking 2009: Experimental Setup , 2009 .

[24]  Edmund K. Burke,et al.  The Genetic and Evolutionary Computation Conference , 2011 .