A statistical study of the Differential Evolution based on continuous generation model

Differentiation Evolution (DE) is an Evolutionary Algorithm (EA) for solving function optimization problems. In order to renew the population in EA, there are two generation models. The first one is “discrete generation model”, and the second one is “continuous generation model”. Conventional DEs have been based on the discrete generation model in which the current generation's population is replaced by the next generation's population at a time. In this paper, a novel DE based on the continuous generation model is described. Because a newborn excellent individual is added to an only population and can be used immediately to generate offspring in the continuous generation model, it can be expected that the novel DE converges faster than the conventional ones. Furthermore, by employing the continuous generation model, it becomes easy to introduce various survival selection methods into DE. Therefore, three survival selection methods are contrived for the novel DE based on the continuous generation model. Finally, the effects of the generation model, the survival selection method, the reproduction selection method, the population size and their interactions on the performance of DE are evaluated statistically by using the analysis of variance (ANOVA).

[1]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[2]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[3]  Héctor Pomares,et al.  Statistical analysis of the main parameters involved in the design of a genetic algorithm , 2002, IEEE Trans. Syst. Man Cybern. Part C.

[4]  Alexandre R. S. Romariz,et al.  Digital filter arbitrary magnitude and phase approximations - statistical analysis applied to a stochastic-based optimization approach , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[5]  Saku Kukkonen,et al.  Real-parameter optimization with differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[6]  Kiyoharu Tagawa Evolutionary computation techniques for the optimum design of Balanced Surface Acoustic Wave filters , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[7]  Hitoshi Iba,et al.  Accelerating Differential Evolution Using an Adaptive Local Search , 2008, IEEE Transactions on Evolutionary Computation.

[8]  Ritu Gupta,et al.  Statistical exploratory analysis of genetic algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[9]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[10]  Jouni Lampinen,et al.  A Trigonometric Mutation Operation to Differential Evolution , 2003, J. Glob. Optim..

[11]  Yun Shang,et al.  A Note on the Extended Rosenbrock Function , 2006 .

[12]  Gilbert Syswerda,et al.  A Study of Reproduction in Generational and Steady State Genetic Algorithms , 1990, FOGA.

[13]  Hitoshi Iba,et al.  A new generation alternation model for differential evolution , 2006, GECCO '06.

[14]  René Thomsen,et al.  Multimodal optimization using crowding-based differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[15]  Andries Petrus Engelbrecht,et al.  Differential evolution methods for unsupervised image classification , 2005, 2005 IEEE Congress on Evolutionary Computation.

[16]  Shahryar Rahnamayan,et al.  Opposition-Based Differential Evolution for Optimization of Noisy Problems , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[17]  Vitaliy Feoktistov,et al.  Differential Evolution: In Search of Solutions (Springer Optimization and Its Applications) , 2006 .

[18]  Vitaliy Feoktistov Differential Evolution: In Search of Solutions , 2006 .

[19]  Jouni Lampinen,et al.  GDE3: the third evolution step of generalized differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[20]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[21]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[22]  Rainer Storn,et al.  System design by constraint adaptation and differential evolution , 1999, IEEE Trans. Evol. Comput..

[23]  Joseph Schmuller,et al.  Statistical analysis with Excel for dummies , 2005 .