论文信息 - Benchmarking the local metamodel CMA-ES on the noiseless BBOB'2013 test bed

Benchmarking the local metamodel CMA-ES on the noiseless BBOB'2013 test bed

This paper evaluates the performance of a variant of the local-meta-model CMA-ES (lmm-CMA) in the BBOB 2013 expensive setting. The lmm-CMA is a surrogate variant of the CMA-ES algorithm. Function evaluations are saved by building, with weighted regression, full quadratic meta-models to estimate the candidate solutions' function values. The quality of the approximation is appraised by checking how much the predicted rank changes when evaluating a fraction of the candidate solutions on the original objective function. The results are compared with the CMA-ES without meta-modeling and with previously benchmarked algorithms, namely BFGS, NEWUOA and saACM. It turns out that the additional meta-modeling improves the performance of CMA-ES on almost all BBOB functions while giving significantly worse results only on the attractive sector function. Over all functions, the performance is comparable with saACM and the lmm-CMA often outperforms NEWUOA and BFGS starting from about 2 times D2 function evaluations with D being the search space dimension.

[1] Nikolaus Hansen,et al. Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[2] Nikolaus Hansen,et al. Evaluating the CMA Evolution Strategy on Multimodal Test Functions , 2004, PPSN.

[3] Nikolaus Hansen,et al. A restart CMA evolution strategy with increasing population size , 2005, 2005 IEEE Congress on Evolutionary Computation.

[4] Petros Koumoutsakos,et al. Local Meta-models for Optimization Using Evolution Strategies , 2006, PPSN.

[5] Raymond Ros,et al. Benchmarking the NEWUOA on the BBOB-2009 function testbed , 2009, GECCO '09.

[6] Raymond Ros,et al. Benchmarking the BFGS algorithm on the BBOB-2009 function testbed , 2009, GECCO '09.

[7] Raymond Ros,et al. Real-Parameter Black-Box Optimization Benchmarking 2009: Experimental Setup , 2009 .

[8] Anne Auger,et al. Real-Parameter Black-Box Optimization Benchmarking 2009: Noiseless Functions Definitions , 2009 .

[9] Raymond Ros,et al. Black-box optimization benchmarking the IPOP-CMA-ES on the noiseless testbed: comparison to the BIPOP-CMA-ES , 2010, GECCO '10.

[10] Anne Auger,et al. Investigating the Local-Meta-Model CMA-ES for Large Population Sizes , 2010, EvoApplications.

[11] Edmund K. Burke,et al. The Genetic and Evolutionary Computation Conference , 2011 .

[12] Michèle Sebag,et al. Black-box optimization benchmarking of IPOP-saACM-ES and BIPOP-saACM-ES on the BBOB-2012 noiseless testbed , 2012, GECCO '12.