Adaptive differential evolution algorithm with novel mutation strategies in multiple sub-populations

Differential evolution (DE) algorithm has been shown to be a very effective and efficient approach for solving global numerical optimization problems, which attracts a great attention of scientific researchers. Generally, most of DE algorithms only evolve one population by using certain kind of DE operators. However, as observed in nature, the working efficiency can be improved by using the concept of work specialization, in which the entire group should be divided into several sub-groups that are responsible for different tasks according to their capabilities. Inspired by this phenomenon, a novel adaptive multiple sub-populations based DE algorithm is designed in this paper, named MPADE, in which the parent population is split into three sub-populations based on the fitness values and then three novel DE strategies are respectively performed to take on the responsibility for either exploitation or exploration. Furthermore, a simple yet effective adaptive approach is designed for parameter adjustment in the three DE strategies and a replacement strategy is put forward to fully exploit the useful information from the trial vectors and target vectors, which enhance the optimization performance. In order to validate the effectiveness of MPADE, it is tested on 55 benchmark functions and 15 real world problems. When compared with other DE variants, MPADE performs better in most of benchmark problems and real-world problems. Moreover, the impacts of the MPADE components and their parameter sensitivity are also analyzed experimentally. Three novel mutation strategies are run in three sub-populations respectively.A novel adaptive strategy is presented to tune the systemic parameters.A simple replacement strategy is designed to remain good solutions.

[1]  Rakesh Angira,et al.  Optimization of dynamic systems: A trigonometric differential evolution approach , 2007, Comput. Chem. Eng..

[2]  Ponnuthurai N. Suganthan,et al.  Self-adaptive differential evolution with multi-trajectory search for large-scale optimization , 2011, Soft Comput..

[3]  Jouni Lampinen,et al.  A Fuzzy Adaptive Differential Evolution Algorithm , 2005, Soft Comput..

[4]  Nenad Mladenovic,et al.  DE-VNS: Self-adaptive Differential Evolution with crossover neighborhood search for continuous global optimization , 2013, Comput. Oper. Res..

[5]  Jin-Kao Hao,et al.  A memetic algorithm for the Minimum Sum Coloring Problem , 2013, Comput. Oper. Res..

[6]  Andries Petrus Engelbrecht,et al.  Self-adaptive Differential Evolution , 2005, CIS.

[7]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[8]  Amit Konar,et al.  Differential Evolution Using a Neighborhood-Based Mutation Operator , 2009, IEEE Transactions on Evolutionary Computation.

[9]  Ming Yang,et al.  Differential Evolution With Auto-Enhanced Population Diversity , 2015, IEEE Transactions on Cybernetics.

[10]  P. N. Suganthan,et al.  Problem Definitions and Evaluation Criteria for CEC 2011 Competition on Testing Evolutionary Algorithms on Real World Optimization Problems , 2011 .

[11]  Dexuan Zou,et al.  A novel modified differential evolution algorithm for constrained optimization problems , 2011, Comput. Math. Appl..

[12]  Ponnuthurai N. Suganthan,et al.  Differential Evolution Algorithm with Ensemble of Parameters and Mutation and Crossover Strategies , 2010, SEMCCO.

[13]  Luiz Lebensztajn,et al.  A Multiobjective Approach of Differential Evolution Optimization Applied to Electromagnetic Problems , 2014, IEEE Transactions on Magnetics.

[14]  Yong Wang,et al.  Combining Multiobjective Optimization With Differential Evolution to Solve Constrained Optimization Problems , 2012, IEEE Transactions on Evolutionary Computation.

[15]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[16]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization , 2014 .

[17]  Jyh-Horng Chou,et al.  Optimized task scheduling and resource allocation on cloud computing environment using improved differential evolution algorithm , 2013, Comput. Oper. Res..

[18]  Ponnuthurai N. Suganthan,et al.  Ensemble differential evolution algorithm for CEC2011 problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[19]  Masaharu Munetomo,et al.  An adaptive parameter binary-real coded genetic algorithm for constraint optimization problems: Performance analysis and estimation of optimal control parameters , 2013, Inf. Sci..

[20]  Swagatam Das,et al.  A Cluster-Based Differential Evolution Algorithm With External Archive for Optimization in Dynamic Environments , 2013, IEEE Transactions on Cybernetics.

[21]  Hui Wang,et al.  Gaussian Bare-Bones Differential Evolution , 2013, IEEE Transactions on Cybernetics.

[22]  Xiaodong Li,et al.  Solving Rotated Multi-objective Optimization Problems Using Differential Evolution , 2004, Australian Conference on Artificial Intelligence.

[23]  Amer Draa,et al.  A sinusoidal differential evolution algorithm for numerical optimisation , 2015, Appl. Soft Comput..

[24]  Alex S. Fukunaga,et al.  Success-history based parameter adaptation for Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[25]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[26]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[27]  Dan Simon,et al.  Differential particle swarm evolution for robot control tuning , 2014, 2014 American Control Conference.

[28]  M. M. Ali,et al.  Differential evolution algorithms using hybrid mutation , 2007, Comput. Optim. Appl..

[29]  Ponnuthurai N. Suganthan,et al.  An Adaptive Differential Evolution Algorithm With Novel Mutation and Crossover Strategies for Global Numerical Optimization , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[30]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[31]  Jouni Lampinen,et al.  A Trigonometric Mutation Operation to Differential Evolution , 2003, J. Glob. Optim..

[32]  Ruhul A. Sarker,et al.  Differential evolution with multiple strategies for solving CEC2011 real-world numerical optimization problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[33]  Alex S. Fukunaga,et al.  Improving the search performance of SHADE using linear population size reduction , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[34]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[35]  Wenyin Gong,et al.  Differential Evolution With Ranking-Based Mutation Operators , 2013, IEEE Transactions on Cybernetics.

[36]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[37]  Yiqiao Cai,et al.  Differential Evolution With Neighborhood and Direction Information for Numerical Optimization , 2013, IEEE Transactions on Cybernetics.

[38]  Qingfu Zhang,et al.  Stable Matching-Based Selection in Evolutionary Multiobjective Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[39]  D. Y. Sha,et al.  A new particle swarm optimization for the open shop scheduling problem , 2008, Comput. Oper. Res..

[40]  Jinghuai Gao,et al.  A New Highly Efficient Differential Evolution Scheme and Its Application to Waveform Inversion , 2014, IEEE Geoscience and Remote Sensing Letters.

[41]  Andrew M. Sutton,et al.  Differential evolution and non-separability: using selective pressure to focus search , 2007, GECCO '07.

[42]  Qiuzhen Lin,et al.  A novel micro-population immune multiobjective optimization algorithm , 2013, Comput. Oper. Res..

[43]  Carlos A. Coello Coello,et al.  A comparative study of differential evolution variants for global optimization , 2006, GECCO.

[44]  Dimitris K. Tasoulis,et al.  Enhancing Differential Evolution Utilizing Proximity-Based Mutation Operators , 2011, IEEE Transactions on Evolutionary Computation.

[45]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[46]  Meie Shen,et al.  Differential Evolution With Two-Level Parameter Adaptation , 2014, IEEE Transactions on Cybernetics.