Differential Evolution Using Opposite Point for Global Numerical Optimization

The Differential Evolution (DE) algorithm is arguably one of the most powerful stochastic optimization algorithms, which has been widely applied in various fields. Global numerical optimization is a very important and extremely dif-ficult task in optimization domain, and it is also a great need for many practical applications. This paper proposes an opposition-based DE algorithm for global numerical optimization, which is called GNO2DE. In GNO2DE, firstly, the opposite point method is employed to utilize the existing search space to improve the convergence speed. Secondly, two candidate DE strategies “DE/rand/1/bin” and “DE/current to best/2/bin” are randomly chosen to make the most of their respective advantages to enhance the search ability. In order to reduce the number of control parameters, this algorithm uses an adaptive crossover rate dynamically tuned during the evolutionary process. Finally, it is validated on a set of benchmark test functions for global numerical optimization. Compared with several existing algorithms, the performance of GNO2DE is superior to or not worse than that of these algorithms in terms of final accuracy, convergence speed, and robustness. In addition, we also especially compare the opposition-based DE algorithm with the DE algorithm without using the opposite point method, and the DE algorithm using “DE/rand/1/bin” or “DE/current to best/2/bin”, respectively.

[1]  D. Fogel.  Applying evolutionary programming to selected traveling salesman problems , 1993 .

[2]  Hamid R. Tizhoosh,et al.  Opposition-Based Reinforcement Learning , 2006, J. Adv. Comput. Intell. Intell. Informatics.

[3]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[4]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[5]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1992, Artificial Intelligence.

[6]  Wenyin Gong,et al.  Enhancing the performance of differential evolution using orthogonal design method , 2008, Appl. Math. Comput..

[7]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[8]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[9]  Huang Hou-kuan.  Self-adapting control parameters in differential evolution , 2012 .

[10]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[11]  D. Karaboga,et al.  A Simple and Global Optimization Algorithm for Engineering Problems: Differential Evolution Algorithm , 2004 .

[12]  Masao Fukushima,et al.  Directed Evolutionary Programming: Towards an Improved Performance of Evolutionary Programming , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[13]  H. Abbass,et al.  PDE: a Pareto-frontier differential evolution approach for multi-objective optimization problems , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[14]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[15]  Michael N. Vrahatis,et al.  Recent approaches to global optimization problems through Particle Swarm Optimization , 2002, Natural Computing.

[16]  S. Rahnamayan,et al.  Solving large scale optimization problems by opposition-based differential evolution (ODE) , 2008 .

[17]  Shahryar Rahnamayan,et al.  Opposition versus randomness in soft computing techniques , 2008, Appl. Soft Comput..

[18]  Vincenzo Cutello,et al.  An Immunological Algorithm for Global Numerical Optimization , 2005, Artificial Evolution.

[19]  Qingfu Zhang,et al.  DE/EDA: A new evolutionary algorithm for global optimization , 2005, Inf. Sci..

[20]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[21]  H. Chi,et al.  An Adaptive Differential Evolution Algorithm to Solve Constrained Optimization Problems in Engineering Design , 2010 .

[22]  Yonghua Song,et al.  Seeker optimization algorithm: A novel stochastic search algorithm for global numerical optimization , 2010 .

[23]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[24]  Millie Pant,et al.  Two modified differential evolution algorithms and their applications to engineering design problems , 2009 .

[25]  Amit Konar,et al.  Differential Evolution Using a Neighborhood-Based Mutation Operator , 2009, IEEE Transactions on Evolutionary Computation.

[26]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[27]  K. Kammeyer,et al.  Examination of Stopping Criteria for Differential Evolution based on a Power Allocation Problem , 2006 .

[28]  Hans-Paul Schwefel,et al.  Numerical Optimization of Computer Models , 1982 .

[29]  M. Montaz Ali,et al.  Application of some recent stochastic global optimization algorithms to practical problems. , 1996 .

[30]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[31]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.

[32]  René Thomsen,et al.  A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[33]  Xin Yao,et al.  Self-adaptive differential evolution with neighborhood search , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[34]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.