A robust memory based hybrid differential evolution for continuous optimization problem

A number of efficient variants of differential evolution (DE) and its hybrid have been suggested in recent years to deal with continuous optimization problems. However, recent past studies have indicated that the performance of such algorithms is largely affected by the choice of parameters e.g. mutation factor, crossover rate, mutation strategy and the type of crossover. A combination of these parameters may work out to be the best for a problem while resulting in poor performance for others. In general practice, during simulation DE does not employ any strategy of memorizing the so-far-best results obtained in the initial part of the previous generation. In this paper, a hybrid DE based on use of memory concept under the particle swarm optimization (PSO), called memory based DE (MBDE), is presented for the continuous optimization problems. The algorithm employs two newly operators namely swarm mutation and swarm crossover. These operators are properly balance exploration and exploitation and improving the convergence rate of the proposed algorithm. Experiments are conducted on a comprehensive set of benchmark functions and real life problems. The results of proposed MBDE are compared with state-of-the-art algorithms. Numerical, statistical and graphical analysis reveals the competency of the proposed MBDE.

[1]  Antonio Martínez-Álvarez,et al.  Feature selection by multi-objective optimisation: Application to network anomaly detection by hierarchical self-organising maps , 2014, Knowl. Based Syst..

[2]  R. A. Cuninghame-Green,et al.  Applied geometric programming , 1976 .

[3]  Mohammad Reza Meybodi,et al.  CDEPSO: a bi-population hybrid approach for dynamic optimization problems , 2014, Applied Intelligence.

[4]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[5]  Francisco Herrera,et al.  Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power , 2010, Inf. Sci..

[6]  Quan Yang,et al.  Research on Hybrid PSODE with Triple Populations Based on Multiple Differential Evolutionary Models , 2010, 2010 International Conference on Electrical and Control Engineering.

[7]  Ville Tirronen,et al.  Recent advances in differential evolution: a survey and experimental analysis , 2010, Artificial Intelligence Review.

[8]  Li Xiao,et al.  A DE and PSO based hybrid algorithm for dynamic optimization problems , 2014, Soft Comput..

[9]  Mohammad Reza Meybodi,et al.  A novel hybrid adaptive collaborative approach based on particle swarm optimization and local search for dynamic optimization problems , 2015, Appl. Soft Comput..

[10]  Liang Gao,et al.  A differential evolution algorithm with intersect mutation operator , 2013, Appl. Soft Comput..

[11]  Kenneth V. Price,et al.  An introduction to differential evolution , 1999 .

[12]  Mirjana Cangalovic,et al.  Solving spread spectrum radar polyphase code design problem by tabu search and variable neighbourhood search , 2003, Eur. J. Oper. Res..

[13]  Liang Gao,et al.  An improved fruit fly optimization algorithm for continuous function optimization problems , 2014, Knowl. Based Syst..

[14]  Taher Niknam,et al.  A novel hybrid particle swarm optimization for economic dispatch with valve-point loading effects , 2011 .

[15]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[16]  Yong Wang,et al.  Hybridizing particle swarm optimization with differential evolution for constrained numerical and engineering optimization , 2010, Appl. Soft Comput..

[17]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[18]  Amit Konar,et al.  Particle Swarm Optimization and Differential Evolution Algorithms: Technical Analysis, Applications and Hybridization Perspectives , 2008, Advances of Computational Intelligence in Industrial Systems.

[19]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[20]  Kedar Nath Das,et al.  An ideal tri-population approach for unconstrained optimization and applications , 2015, Appl. Math. Comput..

[21]  Carlos García-Martínez,et al.  Global and local real-coded genetic algorithms based on parent-centric crossover operators , 2008, Eur. J. Oper. Res..

[22]  Nélio Henderson,et al.  Differential evolution with topographical mutation applied to nuclear reactor core design , 2014 .

[23]  Jie Chen,et al.  Hybridizing Differential Evolution and Particle Swarm Optimization to Design Powerful Optimizers: A Review and Taxonomy , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[24]  Kedar Nath Das,et al.  An efficient hybrid technique for numerical optimization and applications , 2015, Comput. Ind. Eng..

[25]  Pascal Bouvry,et al.  Particle swarm optimization: Hybridization perspectives and experimental illustrations , 2011, Appl. Math. Comput..

[26]  Wei-Ping Lee,et al.  Modified the Performance of Differential Evolution Algorithm with Dual Evolution Strategy , 2009 .

[27]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[28]  Wang Yu-ping,et al.  A new uniform evolutionary algorithm based on decomposition and CDAS for many-objective optimization , 2015 .

[29]  Godfrey C. Onwubolu,et al.  New optimization techniques in engineering , 2004, Studies in Fuzziness and Soft Computing.

[30]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[31]  Harish Sharma,et al.  Fitness based Differential Evolution , 2012, Memetic Computing.

[32]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[33]  Atulya K. Nagar,et al.  Hybrid differential evolution and particle swarm optimization for optimal well placement , 2013, Computational Geosciences.

[34]  Samir Sayah,et al.  A hybrid differential evolution algorithm based on particle swarm optimization for nonconvex economic dispatch problems , 2013, Appl. Soft Comput..

[35]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[36]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[37]  J. S. Saini,et al.  Optimal thermohydraulic performance of artificially roughened solar air heaters , 1991 .

[38]  Bin Li,et al.  Estimation of distribution and differential evolution cooperation for large scale economic load dispatch optimization of power systems , 2010, Inf. Sci..

[39]  Seyed Taghi Akhavan Niaki,et al.  Optimization of a multiproduct economic production quantity problem with stochastic constraints using sequential quadratic programming , 2015, Knowl. Based Syst..

[40]  Maurice Clerc,et al.  Hybridization of Differential Evolution and Particle Swarm Optimization in a New Algorithm: DEPSO-2S , 2012, ICAISC.

[41]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .