Enhanced differential evolution using random-based sampling and neighborhood mutation

Differential evolution (DE) is a simple and efficient global optimization algorithm. When differential evolution is applied in complex optimization problems, it has the shortages of prematurity and stagnation. An enhanced differential evolution using random sampling and neighborhood mutation to solve the above problems is proposed in this paper. The proposed enhanced DE is called random-based differential evolution with neighborhood mutation (NRDE). Random-based sampling is an improvement of center-based sampling. In NRDE, random-based sampling as the new mutation operator to generate the random-based individuals and the designed neighborhood mutation operator are used to search in the neighborhood created by the centers of the population and the sub-population. This paper compares other state-of-the-art evolutionary algorithms with the proposed algorithm, NRDE. Experimental verifications are conducted on 24 benchmark functions and the CEC’05 competition, including detailed analysis for NRDE. The results clearly show that NRDE outperforms other evolutionary algorithms in terms of the solution accuracy and the convergence rate.

[1]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[2]  Hitoshi Iba,et al.  Accelerating Differential Evolution Using an Adaptive Local Search , 2008, IEEE Transactions on Evolutionary Computation.

[3]  Shahryar Rahnamayan,et al.  Opposition versus randomness in soft computing techniques , 2008, Appl. Soft Comput..

[4]  Athanasios V. Vasilakos,et al.  On Convergence of Differential Evolution Over a Class of Continuous Functions With Unique Global Optimum , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[5]  Liangpei Zhang,et al.  Remote Sensing Image Subpixel Mapping Based on Adaptive Differential Evolution , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Konstantin Kozlov,et al.  DEEP—differential evolution entirely parallel method for gene regulatory networks , 2011, The Journal of Supercomputing.

[7]  Ferrante Neri,et al.  Memetic Compact Differential Evolution for Cartesian Robot Control , 2010, IEEE Computational Intelligence Magazine.

[8]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[9]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[10]  Zhijian Wu,et al.  Parallel differential evolution with self-adapting control parameters and generalized opposition-based learning for solving high-dimensional optimization problems , 2013, J. Parallel Distributed Comput..

[11]  Hui Wang,et al.  Gaussian Bare-Bones Differential Evolution , 2013, IEEE Transactions on Cybernetics.

[12]  Liang Gao,et al.  A differential evolution algorithm with intersect mutation operator , 2013, Appl. Soft Comput..

[13]  Yiqiao Cai,et al.  Learning-enhanced differential evolution for numerical optimization , 2011, Soft Computing.

[14]  Adel Al-Jumaily,et al.  Feature subset selection using differential evolution and a statistical repair mechanism , 2011, Expert Syst. Appl..

[15]  René Thomsen,et al.  A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[16]  Dimitris K. Tasoulis,et al.  Enhancing Differential Evolution Utilizing Proximity-Based Mutation Operators , 2011, IEEE Transactions on Evolutionary Computation.

[17]  Zhijian Wu,et al.  Enhanced opposition-based differential evolution for solving high-dimensional continuous optimization problems , 2011, Soft Comput..

[18]  Ajith Abraham,et al.  Unconventional initialization methods for differential evolution , 2013, Appl. Math. Comput..

[19]  Shahryar Rahnamayan,et al.  Enhanced Differential Evolution using center-based sampling , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[20]  Hao Zheng,et al.  A novel clustering-based differential evolution with 2 multi-parent crossovers for global optimization , 2012, Appl. Soft Comput..

[21]  Amit Konar,et al.  Differential Evolution Using a Neighborhood-Based Mutation Operator , 2009, IEEE Transactions on Evolutionary Computation.

[22]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[23]  Jing J. Liang,et al.  Differential Evolution With Neighborhood Mutation for Multimodal Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[24]  Vinicius Veloso de Melo,et al.  Investigating Smart Sampling as a population initialization method for Differential Evolution in continuous problems , 2012, Inf. Sci..

[25]  Jia-Sheng Heh,et al.  A 2-Opt based differential evolution for global optimization , 2010, Appl. Soft Comput..

[26]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[27]  Ahmet Bedri Özer,et al.  CIDE: Chaotically Initialized Differential Evolution , 2010, Expert Syst. Appl..

[28]  Daniela Zaharie,et al.  Influence of crossover on the behavior of Differential Evolution Algorithms , 2009, Appl. Soft Comput..

[29]  Ajith Abraham,et al.  A simple adaptive Differential Evolution algorithm , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[30]  Wenyin Gong,et al.  A clustering-based differential evolution for global optimization , 2011, Appl. Soft Comput..

[31]  T. Samaras,et al.  Self-Adaptive Differential Evolution Applied to Real-Valued Antenna and Microwave Design Problems , 2011, IEEE Transactions on Antennas and Propagation.

[32]  Ruhul A. Sarker,et al.  An Improved Self-Adaptive Differential Evolution Algorithm for Optimization Problems , 2013, IEEE Transactions on Industrial Informatics.

[33]  Thomas Bäck,et al.  An Overview of Evolutionary Algorithms for Parameter Optimization , 1993, Evolutionary Computation.

[34]  A. Srinivasa Reddy,et al.  Shuffled differential evolution for large scale economic dispatch , 2013 .

[35]  Shahryar Rahnamayan,et al.  A note on "Opposition versus randomness in soft computing techniques" [Appl. Soft Comput 8 (2) (2008) 906-918] , 2010, Appl. Soft Comput..

[36]  Uday K. Chakraborty,et al.  PEM fuel cell modeling using differential evolution , 2012 .

[37]  Swagatam Das,et al.  An improved differential evolution algorithm with fitness-based adaptation of the control parameters , 2011, Inf. Sci..

[38]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[39]  Antonio Moreno Ortiz,et al.  Dimensional synthesis of mechanisms using Differential Evolution with auto-adaptive control parameters , 2013 .

[40]  Pascal Bouvry,et al.  Improving Classical and Decentralized Differential Evolution With New Mutation Operator and Population Topologies , 2011, IEEE Transactions on Evolutionary Computation.

[41]  Xin Yao,et al.  Making a Difference to Differential Evolution , 2008, Advances in Metaheuristics for Hard Optimization.

[42]  Francisco Herrera,et al.  Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power , 2010, Inf. Sci..

[43]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[44]  Shahryar Rahnamayan,et al.  Center-based sampling for population-based algorithms , 2009, 2009 IEEE Congress on Evolutionary Computation.

[45]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.

[46]  Wen-Hsien Ho,et al.  Hybrid Taguchi-Differential Evolution Algorithm for Parameter Estimation of Differential Equation Models with Application to HIV Dynamics , 2011 .

[47]  Sanyou Zeng,et al.  Generalised opposition-based differential evolution: an experimental study , 2012, Int. J. Comput. Appl. Technol..