An adaptive multi-population differential evolution algorithm for continuous multi-objective optimization

For evolutionary algorithms, the search data during evolution has attracted considerable attention and many kinds of data mining methods have been proposed to derive useful information behind these data so as to guide the evolution search. However, these methods mainly centered on the single objective optimization problems. In this paper, an adaptive differential evolution algorithm based on analysis of search data is developed for the multi-objective optimization problems. In this algorithm, the useful information is firstly derived from the search data during the evolution process by clustering and statistical methods, and then the derived information is used to guide the generation of new population and the local search. In addition, the proposed differential evolution algorithm adopts multiple subpopulations, each of which evolves according to the assigned crossover operator borrowed from genetic algorithms to generate perturbed vectors. During the evolution process, the size of each subpopulation is adaptively adjusted based on the information derived from its search results. The local search consists of two phases that focus on exploration and exploitation, respectively. Computational results on benchmark multi-objective problems show that the improvements of the strategies are positive and that the proposed differential evolution algorithm is competitive or superior to some previous multi-objective evolutionary algorithms in the literature.

[1]  Bogdan Filipic,et al.  DEMO: Differential Evolution for Multiobjective Optimization , 2005, EMO.

[2]  Yang Tang,et al.  Adaptive population tuning scheme for differential evolution , 2013, Inf. Sci..

[3]  Hitoshi Iba,et al.  Accelerating Differential Evolution Using an Adaptive Local Search , 2008, IEEE Transactions on Evolutionary Computation.

[4]  Jouni Lampinen,et al.  GDE3: the third evolution step of generalized differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[5]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[6]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[7]  M. Yamamura,et al.  Multi-parent recombination with simplex crossover in real coded genetic algorithms , 1999 .

[8]  Enrique Alba,et al.  SMPSO: A new PSO-based metaheuristic for multi-objective optimization , 2009, 2009 IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making(MCDM).

[9]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[10]  Jun Zhang,et al.  Evolutionary Computation Meets Machine Learning: A Survey , 2011, IEEE Computational Intelligence Magazine.

[11]  Xianpeng Wang,et al.  A Hybrid Multiobjective Evolutionary Algorithm for Multiobjective Optimization Problems , 2013, IEEE Transactions on Evolutionary Computation.

[12]  Yu Wang,et al.  Self-adaptive learning based particle swarm optimization , 2011, Inf. Sci..

[13]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[14]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[15]  Liqun Gao,et al.  A hierarchical differential evolution algorithm with multiple sub-population parallel search mechanism , 2010, 2010 International Conference On Computer Design and Applications.

[16]  Jun Zhang,et al.  Orthogonal Learning Particle Swarm Optimization , 2011, IEEE Trans. Evol. Comput..

[17]  Kalyanmoy Deb,et al.  A Computationally Efficient Evolutionary Algorithm for Real-Parameter Optimization , 2002, Evolutionary Computation.

[18]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[19]  Lixin Tang,et al.  Differential Evolution With an Individual-Dependent Mechanism , 2015, IEEE Transactions on Evolutionary Computation.

[20]  Hussein A. Abbass,et al.  A Memetic Coevolutionary Multi-Objective Differential Evolution Algorithm , 2009 .

[21]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[22]  N. Madavan.  Multiobjective optimization using a Pareto differential evolution approach , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[23]  Enrique Alba,et al.  AbYSS: Adapting Scatter Search to Multiobjective Optimization , 2008, IEEE Transactions on Evolutionary Computation.

[24]  Mehmet Fatih Tasgetiren,et al.  Multi-objective optimization based on self-adaptive differential evolution algorithm , 2007, 2007 IEEE Congress on Evolutionary Computation.

[25]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[26]  Millie Pant,et al.  An efficient Differential Evolution based algorithm for solving multi-objective optimization problems , 2011, Eur. J. Oper. Res..

[27]  Yiqiao Cai,et al.  Differential evolution with hybrid linkage crossover , 2015, Inf. Sci..

[28]  Dana Petcu,et al.  Adaptive Pareto Differential Evolution and Its Parallelization , 2003, PPAM.

[29]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[30]  A. C. Martínez-Estudillo,et al.  Hybridization of evolutionary algorithms and local search by means of a clustering method , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[31]  Gary G. Yen,et al.  Dynamic Multiple Swarms in Multiobjective Particle Swarm Optimization , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[32]  Lixin Tang,et al.  An Improved Differential Evolution Algorithm for Practical Dynamic Scheduling in Steelmaking-Continuous Casting Production , 2014, IEEE Transactions on Evolutionary Computation.

[33]  Dimitris K. Tasoulis,et al.  Vector evaluated differential evolution for multiobjective optimization , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[34]  H. Abbass,et al.  PDE: a Pareto-frontier differential evolution approach for multi-objective optimization problems , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[35]  Carlos A. Coello Coello,et al.  Using Clustering Techniques to Improve the Performance of a Multi-objective Particle Swarm Optimizer , 2004, GECCO.

[36]  El-Ghazali Talbi,et al.  Using Datamining Techniques to Help Metaheuristics: A Short Survey , 2006, Hybrid Metaheuristics.

[37]  Wei-jie Yu,et al.  Multi-population differential evolution with adaptive parameter control for global optimization , 2011, GECCO '11.

[38]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.

[39]  Carlos A. Coello Coello,et al.  Handling multiple objectives with particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[40]  René Thomsen,et al.  A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[41]  C. Coello,et al.  Multiobjective optimization using a micro-genetic algorithm , 2001 .

[42]  Kay Chen Tan,et al.  A data mining approach to evolutionary optimisation of noisy multi-objective problems , 2012, Int. J. Syst. Sci..

[43]  Ilpo Poikolainen,et al.  Cluster-Based Population Initialization for differential evolution frameworks , 2015, Inf. Sci..

[44]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[45]  Carlos A. Coello Coello,et al.  DEMORS: A hybrid multi-objective optimization algorithm using differential evolution and rough set theory for constrained problems , 2010, Comput. Oper. Res..

[46]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.