Ensemble particle swarm optimization and differential evolution with alternative mutation method

This paper presents a new ensemble algorithm which combines two well-known algorithms particle swarm optimization (PSO) and differential evolution (DE). To avoid the suboptimal solutions occurring in the previous hybrid algorithms, in this study, an alternative mutation method is developed and embedded in the proposed algorithm. The population of the proposed algorithm consists of two groups which employ two independent updating methods (i.e. velocity updating method from PSO and mutative method from DE). By comparing with the previously generated population at the last generation, two new groups are generated according to the updating methods. Based on the alternative mutation method, the population is updated by the alternative selection according to the evaluation functions. To enhance the diversity of the population, the strategies of re-mutation, crossover, and selection are conducted throughout the optimization process. Each individual conducts the correspondent mutation and crossover strategies according to the parameter values randomly selected, and the parameter values of scaling factor and crossover probability will be updated accordingly throughout the iterations. Numerous simulations on twenty-five benchmark functions have been conducted, which indicates the proposed algorithm outperforms some well-exploited algorithms (i.e. inertia weight PSO, comprehensive learning PSO, and DE) and recently proposed algorithms (i.e. DE with the ensemble of parameters and mutation strategies and ensemble PSO).

[1]  Miaomiao Wang,et al.  Hybrid particle swarm optimization and differential evolution algorithm for bi-level programming problem and its application to pricing and lot-sizing decisions , 2015, J. Intell. Manuf..

[2]  Shao Yong Zheng,et al.  Differential Evolution Algorithm With Two-Step Subpopulation Strategy and Its Application in Microwave Circuit Designs , 2016, IEEE Transactions on Industrial Informatics.

[3]  Xu Jun,et al.  Research of Hybrid Differential Evolution and Particle Swarm Optimization Algorithm Using Map Reduce to Schedule Tasks , 2016 .

[4]  Yongbo Wang,et al.  A hybrid differential evolution and particle swarm optimization algorithm for numerical kinematics solution of remote maintenance manipulators , 2017 .

[5]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[6]  Jianzhong Zhou,et al.  Weighted fuzzy kernel-clustering algorithm with adaptive differential evolution and its application on flood classification , 2013, Natural Hazards.

[7]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[8]  Haralambos Sarimveis,et al.  Cooperative learning for radial basis function networks using particle swarm optimization , 2016, Appl. Soft Comput..

[9]  Hsing-Chih Tsai,et al.  Unified particle swarm delivers high efficiency to particle swarm optimization , 2017, Appl. Soft Comput..

[10]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[11]  Mohamed A. Tawhid,et al.  A Hybrid PSO and DE Algorithm for Solving Engineering Optimization Problems , 2016 .

[12]  Najeh Ben Guedria,et al.  Improved accelerated PSO algorithm for mechanical engineering optimization problems , 2016, Appl. Soft Comput..

[13]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[14]  Ponnuthurai N. Suganthan,et al.  Differential Evolution Algorithm with Ensemble of Parameters and Mutation and Crossover Strategies , 2010, SEMCCO.

[15]  Trung Nguyen-Thoi,et al.  An improved constrained differential evolution using discrete variables (D-ICDE) for layout optimization of truss structures , 2015, Expert Syst. Appl..

[16]  Li Li,et al.  Particle Swarm Optimization for Yard Truck Scheduling in Container Terminal with a Cooperative Strategy , 2017 .

[17]  Li Xiao,et al.  A DE and PSO based hybrid algorithm for dynamic optimization problems , 2014, Soft Comput..

[18]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[19]  C. Christober Asir Rajan,et al.  Application of differential evolution algorithm in static and dynamic economic or emission dispatch problem: A review , 2017 .

[20]  Andries Petrus Engelbrecht,et al.  Empirical analysis of self-adaptive differential evolution , 2007, Eur. J. Oper. Res..

[21]  Manisha Sharma,et al.  Environmental economic dispatch in multi-area power system employing improved differential evolution with fuzzy selection , 2015, Appl. Soft Comput..

[22]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[23]  Jianjun Luo,et al.  Hybridizing Particle Swarm Optimization and Differential Evolution for the Mobile Robot Global Path Planning , 2016 .

[24]  Felix T. S. Chan,et al.  Particle swarm optimization for the truck scheduling in container terminals , 2014, 2014 International Conference on Information Science, Electronics and Electrical Engineering.

[25]  A. Naveen Sait,et al.  Performance evaluation of proposed Differential Evolution and Particle Swarm Optimization algorithms for scheduling m-machine flow shops with lot streaming , 2013, J. Intell. Manuf..

[26]  Jiansheng Liu,et al.  A image segmentation algorithm based on differential evolution particle swarm optimization fuzzy c-means clustering , 2015, Comput. Sci. Inf. Syst..

[27]  Ying-Han Chen,et al.  Wall-Following Control of a Hexapod Robot Using a Data-Driven Fuzzy Controller Learned Through Differential Evolution , 2015, IEEE Transactions on Industrial Electronics.

[28]  P. N. Suganthan,et al.  Ensemble particle swarm optimizer , 2017, Appl. Soft Comput..

[29]  Daniela Zaharie,et al.  Influence of crossover on the behavior of Differential Evolution Algorithms , 2009, Appl. Soft Comput..

[30]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[31]  Mostafa A. El-Hosseini,et al.  Design of optimal PID controller using hybrid differential evolution and particle swarm optimization with an aging leader and challengers , 2016, Appl. Soft Comput..

[32]  Xiaodong Li,et al.  Solving Rotated Multi-objective Optimization Problems Using Differential Evolution , 2004, Australian Conference on Artificial Intelligence.

[33]  R. Storn,et al.  On the usage of differential evolution for function optimization , 1996, Proceedings of North American Fuzzy Information Processing.

[34]  Masoud Shariat Panahi,et al.  An improved PSO algorithm with a territorial diversity-preserving scheme and enhanced exploration-exploitation balance , 2013, Swarm Evol. Comput..

[35]  Kedar Nath Das,et al.  A modified competitive swarm optimizer for large scale optimization problems , 2017, Appl. Soft Comput..

[36]  Ben Niu,et al.  Symbiosis-Based Alternative Learning Multi-Swarm Particle Swarm Optimization , 2017, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[37]  Jason Sheng-Hong Tsai,et al.  Improving Differential Evolution With a Successful-Parent-Selecting Framework , 2015, IEEE Transactions on Evolutionary Computation.

[38]  M. Cheng,et al.  Using a fuzzy clustering chaotic-based differential evolution with serial method to solve resource-constrained project scheduling problems , 2014 .

[39]  Qinghua Wu,et al.  Dynamic particle swarm optimizer with escaping prey for solving constrained non-convex and piecewise optimization problems , 2017, Expert Syst. Appl..

[40]  Jinn-Tsong Tsai,et al.  Improved differential evolution algorithm for nonlinear programming and engineering design problems , 2015, Neurocomputing.

[41]  Gade Pandu Rangaiah,et al.  Design of shell-and-tube heat exchangers for multiple objectives using elitist non-dominated sorting genetic algorithm with termination criteria , 2016 .