Differential evolution algorithm with ensemble of populations for global numerical optimization

Differential evolution (DE) is an efficient and powerful population-based stochastic search technique for solving global optimization problems over continuous space, which has been widely applied in many scientific and engineering fields. However, the success of DE to handle a specific problem crucially depends on the proper choice of various parameters including the size of the population. Employing the trial and error scheme to search for the most suitable parameter settings requires high computational costs. In this paper, we propose a DE algorithm with an ensemble of parallel populations in which the number of function evaluations allocated to each population is self-adapted by learning from their previous experiences in generating superior solutions. Consequently, a more suitable population size takes most of the function evaluations adaptively to match different phases of the search process/evolution. Although the evolutionary algorithms have been investigated for about five decades, to our best of knowledge so far no effective population adaptation scheme has been proposed. The performance of the DE algorithm with an ensemble of parallel populations is extensively evaluated on a suite of 14 bound-constrained numerical optimization problems and compares favorably with the conventional DE with different single population sizes.

[1]  R. Storn,et al.  On the usage of differential evolution for function optimization , 1996, Proceedings of North American Fuzzy Information Processing.

[2]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[3]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[4]  Kenneth V. Price,et al.  An introduction to differential evolution , 1999 .

[5]  Riccardo Poli,et al.  New ideas in optimization , 1999 .

[6]  Arthur C. Sanderson,et al.  Minimal representation multisensor fusion using differential evolution , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[7]  Joni-Kristian Kämäräinen,et al.  Differential Evolution Training Algorithm for Feed-Forward Neural Networks , 2003, Neural Processing Letters.

[8]  Nikolaus Hansen,et al.  Compilation of Results on the 2005 CEC Benchmark Function Set , 2005 .

[9]  Jing J. Liang,et al.  Novel composition test functions for numerical global optimization , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[10]  Saku Kukkonen,et al.  Real-parameter optimization with differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[11]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[12]  Amit Konar,et al.  Two improved differential evolution schemes for faster global search , 2005, GECCO '05.

[13]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.