A comparative study of common and self-adaptive differential evolution strategies on numerical benchmark problems

Abstract Differential Evolution (DE) is a population-based stochastic global optimization technique that requires the adjustment of a very few parameters in order to produce results. However, the control parameters involved in DE are highly dependent on the optimization problem; in practice, their fine-tuning is not always an easy task. The self-adaptive differential evolution (SADE) variants are those that do not require the pre-specified choice of control parameters. On the contrary, control parameters are selfadapted by using the previous learning experience. In this paper, we discuss and evaluate popular common and self-adaptive differential evolution (DE) algorithms. In particular, we present an empirical comparison between two self-adaptive DE variants and common DE methods. In order to assure a fair comparison, we test the methods by using a number of well-known unimodal and multimodal, separable and non-separable, benchmark optimization problems for different dimensions and population size. The results show that SADE variants outperform, or at least produce similar results, to common differential evolution algorithms in terms of solution accuracy and convergence speed. The advantage of using the self-adaptive methods is that the user does not need to adjust control parameters. Therefore, the total computational effort is significantly reduced.

[1]  Zbigniew Michalewicz,et al.  Parameter Control in Evolutionary Algorithms , 2007, Parameter Setting in Evolutionary Algorithms.

[2]  Jouni Lampinen,et al.  A Fuzzy Adaptive Differential Evolution Algorithm , 2005, Soft Comput..

[3]  T. Krink,et al.  Parameter control using the agent based patchwork model , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[4]  Sotirios K. Goudos,et al.  Design of microwave broadband absorbers using a self-adaptive differential evolution algorithm , 2009 .

[5]  A. Massa,et al.  Optimization of the difference patterns for monopulse antennas by a hybrid real/integer-coded differential evolution method , 2005, IEEE Transactions on Antennas and Propagation.

[6]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[7]  L. G. van Willigenburg,et al.  Efficient Differential Evolution algorithms for multimodal optimal control problems , 2003, Appl. Soft Comput..

[8]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[9]  Rainer Storn,et al.  Differential Evolution Research – Trends and Open Questions , 2008 .

[10]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[11]  Shiwen Yang,et al.  Antenna‐array pattern nulling using a differential evolution algorithm , 2004 .

[12]  A. Rydberg,et al.  Synthesis of uniform amplitude unequally spaced antenna arrays using the differential evolution algorithm , 2003 .

[13]  Arthur C. Sanderson,et al.  Differential evolution for discrete optimization: An experimental study on Combinatorial Auction problems , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[14]  René Thomsen,et al.  A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[15]  Carlos A. Coello Coello,et al.  A comparative study of differential evolution variants for global optimization , 2006, GECCO.

[16]  Jouni Lampinen,et al.  GDE3: the third evolution step of generalized differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[17]  Z. Nie,et al.  The Application of a Modified Differential Evolution Strategy to Some Array Pattern Synthesis Problems , 2008, IEEE Transactions on Antennas and Propagation.

[18]  Konstantinos B. Baltzis,et al.  Design of optimum gain pyramidal horn using self‐adaptive differential evolution algorithms , 2011 .

[19]  Gao-Ji Sun,et al.  A new evolutionary algorithm for global numerical optimization , 2010, 2010 International Conference on Machine Learning and Cybernetics.

[20]  Qingfu Zhang,et al.  DE/EDA: A new evolutionary algorithm for global optimization , 2005, Inf. Sci..

[21]  Stefan Janaqi,et al.  Generalization of the strategies in differential evolution , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..