Optimization with Noisy Function Evaluations

In the optimization literature it is frequently assumed that the quality of solutions can be determined by calculating deterministic objective function values. Practical optimization problems, however, often require the evaluation of solutions through experimentation, stochastic simulation, sampling, or even interaction with the user. Thus, most practical problems involve noise. We empirically investigate the robustness of population-based versus point-based optimization methods on a range of parameter optimization problems when noise is added. Our results favor population-based optimization, and the evolution strategy in particular.

[1]  Kalyanmoy Deb,et al.  Genetic Algorithms, Noise, and the Sizing of Populations , 1992, Complex Syst..

[2]  Volker Nissen,et al.  Evolutionary Algorithms in Management Applications , 1995 .

[3]  Heinz Mühlenbein,et al.  Evolution in Time and Space - The Parallel Genetic Algorithm , 1990, FOGA.

[4]  Thomas Bäck,et al.  Evolution Strategies on Noisy Functions: How to Improve Convergence Properties , 1994, PPSN.

[5]  James E. Baker,et al.  Reducing Bias and Inefficienry in the Selection Algorithm , 1987, ICGA.

[6]  Thomas Bäck,et al.  Evolutionary Algorithms in Theory and Practice , 1996 .

[7]  Gerhard W. Dueck,et al.  Threshold accepting: a general purpose optimization algorithm appearing superior to simulated anneal , 1990 .

[8]  L. Darrell Whitley,et al.  Searching in the Presence of Noise , 1996, PPSN.

[9]  Volker Nissen,et al.  On the robustness of population-based versus point-based optimization in the presence of noise , 1998, IEEE Trans. Evol. Comput..

[10]  Volker Nissen,et al.  A modification of threshold accepting and its application to the quadratic assignment problem , 1995 .

[11]  John J. Grefenstette,et al.  Deception Considered Harmful , 1992, FOGA.

[12]  David B. Fogel,et al.  Schema processing under proportional selection in the presence of random effects , 1997, IEEE Trans. Evol. Comput..

[13]  Günter Rudolph,et al.  Massively Parallel Simulated Annealing and Its Relation to Evolutionary Algorithms , 1993, Evolutionary Computation.

[14]  Hans-Paul Schwefel,et al.  Evolution and optimum seeking , 1995, Sixth-generation computer technology series.

[15]  Jörg Biethahn,et al.  Determining a Good Inventory Policy with a Genetic Algorithm , 1995 .

[16]  Hans-Georg Beyer,et al.  Toward a Theory of Evolution Strategies: Some Asymptotical Results from the (1,+ )-Theory , 1993, Evolutionary Computation.