Comparing results of 31 algorithms from the black-box optimization benchmarking BBOB-2009

This paper presents results of the BBOB-2009 benchmarking of 31 search algorithms on 24 noiseless functions in a black-box optimization scenario in continuous domain. The runtime of the algorithms, measured in number of function evaluations, is investigated and a connection between a single convergence graph and the runtime distribution is uncovered. Performance is investigated for different dimensions up to 40-D, for different target precision values, and in different subgroups of functions. Searching in larger dimension and multi-modal functions appears to be more difficult. The choice of the best algorithm also depends remarkably on the available budget of function evaluations.

[1]  J. Davenport.  Editor , 1960 .

[2]  Julian F. Miller,et al.  Genetic and Evolutionary Computation — GECCO 2003 , 2003, Lecture Notes in Computer Science.

[3]  Anne Auger,et al.  Performance evaluation of an advanced local search evolutionary algorithm , 2005, 2005 IEEE Congress on Evolutionary Computation.

[4]  Mahmoud Fouz,et al.  BBOB: Nelder-Mead with resize and halfruns , 2009, GECCO '09.

[5]  Mohammed El-Abd,et al.  Black-box optimization benchmarking for noiseless function testbed using an EDA and PSO hybrid , 2009, GECCO '09.

[6]  Anne Auger,et al.  Benchmarking the (1+1) evolution strategy with one-fifth success rule on the BBOB-2009 function testbed , 2009, GECCO '09.

[7]  Mihály Csaba Markót,et al.  BBO-Benchmarking of the GLOBAL method for the Noiseless Function Testbed , 2009 .

[8]  José García-Nieto,et al.  Noiseless functions black-box optimization: evaluation of a hybrid particle swarm with differential operators , 2009, GECCO '09.

[9]  Carlos García-Martínez,et al.  A continuous variable neighbourhood search based on specialised EAs: application to the noiseless BBO-benchmark 2009 , 2009, GECCO '09.

[10]  Jirí Kubalík,et al.  Black-box optimization benchmarking of prototype optimization with evolved improvement steps for noiseless function testbed , 2009, GECCO '09.

[11]  Raymond Ros,et al.  Benchmarking the NEWUOA on the BBOB-2009 function testbed , 2009, GECCO '09.

[12]  Miguel Nicolau,et al.  Application of a simple binary genetic algorithm to a noiseless testbed benchmark , 2009, GECCO '09.

[13]  Nikolaus Hansen,et al.  Benchmarking the nelder-mead downhill simplex algorithm with many local restarts , 2009, GECCO '09.

[14]  Francisco Herrera,et al.  A memetic algorithm using local search chaining forblack-box optimization benchmarking 2009 for noise free functions , 2009, GECCO '09.

[15]  Dirk Thierens,et al.  AMaLGaM IDEAs in noiseless black-box optimization benchmarking , 2009, GECCO '09.

[16]  Raymond Ros,et al.  Benchmarking the BFGS algorithm on the BBOB-2009 function testbed , 2009, GECCO '09.

[17]  Mohammed El-Abd,et al.  Black-box optimization benchmarking for noiseless function testbed using particle swarm optimization , 2009, GECCO '09.

[18]  Anne Auger,et al.  Benchmarking the pure random search on the BBOB-2009 testbed , 2009, GECCO '09.

[19]  Raymond Ros,et al.  Real-Parameter Black-Box Optimization Benchmarking 2009: Experimental Setup , 2009 .

[20]  Jurij Silc,et al.  A stigmergy-based algorithm for black-box optimization: noiseless function testbed , 2009, GECCO '09.

[21]  G. Hornby.  The Age-Layered Population Structure (ALPS) Evolutionary Algorithm , 2009 .

[22]  Anne Auger,et al.  Real-Parameter Black-Box Optimization Benchmarking 2009: Noiseless Functions Definitions , 2009 .

[23]  Anne Auger,et al.  Benchmarking the (1+1)-CMA-ES on the BBOB-2009 function testbed , 2009, GECCO '09.

[24]  Petr Posík,et al.  BBOB-benchmarking a simple estimation of distribution algorithm with cauchy distribution , 2009, GECCO '09.

[25]  Marcus Gallagher,et al.  Black-box optimization benchmarking: results for the BayEDAcG algorithm on the noiseless function testbed , 2009, GECCO '09.

[26]  Nikolaus Hansen,et al.  Benchmarking a BI-population CMA-ES on the BBOB-2009 function testbed , 2009, GECCO '09.

[27]  Raymond Ros,et al.  Benchmarking sep-CMA-ES on the BBOB-2009 function testbed , 2009, GECCO '09.

[28]  Gregory Hornby,et al.  Steady-state ALPS for real-valued problems , 2009, GECCO.

[29]  Petr Posík,et al.  BBOB-benchmarking the generalized generation gap model with parent centric crossover , 2009, GECCO '09.

[30]  Petr Posík,et al.  BBOB-benchmarking the DIRECT global optimization algorithm , 2009, GECCO '09.

[31]  Petr Posík,et al.  BBOB-benchmarking two variants of the line-search algorithm , 2009, GECCO '09.

[32]  Mohammed El-Abd,et al.  Black-box optimization benchmarking for noiseless function testbed using PSO_bounds , 2009, GECCO '09.

[33]  Petr Posík,et al.  BBOB-benchmarking the Rosenbrock's local search algorithm , 2009, GECCO '09.