Differential evolution with generalized differentials

In this paper, we study the mutation operation of the differential evolution (DE) algorithm. In particular, we propose the differential of scaled vectors, called the 'generalized differential', as opposed to the existing scaled differential vector in the mutation of DE. We derive the probability distribution of points generated by the mutation with 'generalized differentials'. We incorporate a vector-projection-based exploratory method within the new mutation scheme. The vector projection is not mandatory and it is only invoked if trial points continue to be unsuccessful. An algorithm is then proposed which implements the mutation strategy based on the difference of the scaled vectors as well as the vector projection technique. A numerical study is carried out using a set of 50 test problems, many of which are inspired by practical applications. Numerical results suggest that the new algorithm is superior to DE.

[1]  M. M. Ali,et al.  A numerical study of some modified differential evolution algorithms , 2006, Eur. J. Oper. Res..

[2]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[3]  Russell C. Eberhart,et al.  The particle swarm: social adaptation in information-processing systems , 1999 .

[4]  M. Ali,et al.  Some Variants of the Controlled Random Search Algorithm for Global Optimization , 2006 .

[5]  P. J. Green,et al.  Probability and Statistical Inference , 1978 .

[6]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1992, Artificial Intelligence.

[7]  L. P. Fatti,et al.  A Differential Free Point Generation Scheme in the Differential Evolution Algorithm , 2006, J. Glob. Optim..

[8]  M. Montaz Ali,et al.  Population set-based global optimization algorithms: some modifications and numerical studies , 2004, Comput. Oper. Res..

[9]  Zelda B. Zabinsky,et al.  A Numerical Evaluation of Several Stochastic Algorithms on Selected Continuous Global Optimization Test Problems , 2005, J. Glob. Optim..

[10]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[11]  Uday K. Chakraborty,et al.  Advances in Differential Evolution , 2010 .

[12]  M. Kendall Probability and Statistical Inference , 1956, Nature.

[13]  W. Price Global optimization by controlled random search , 1983 .

[14]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[15]  Riccardo Poli,et al.  New ideas in optimization , 1999 .

[16]  Shu-Cherng Fang,et al.  An Electromagnetism-like Mechanism for Global Optimization , 2003, J. Glob. Optim..