A novel multi-swarm particle swarm optimization with dynamic learning strategy

Abstract In the paper, we proposed a novel multi-swarm particle swarm optimization with dynamic learning strategy (PSO-DLS) to improve the performance of PSO. To promote information exchange among sub-swarms, the particle classification mechanism advocates that particles in each sub-swarm are classified into ordinary particles and communication particles with different tasks at each iteration. The ordinary particles focus on exploitation under the guidance of the local best position in its sub-swarm, while the communication particles with dynamic ability that focus on exploration under the guidance of a united local best position in a new search region promote information to be exchanged among sub-swarms. Moreover the strategy sets a dynamic control mechanism with an increasing parameter p for implementing the classification operation, which provides ordinary particles an increasing sense of evolution into communication particles during the searching process. A simple case of analysis on searching behavior supports its remarkable impact on maintaining the diversity and searching a better solution. Experimental results on 15 function problems of CEC 2015 for 10 and 30 dimensions also demonstrate its promising effectiveness in solving complex problems statistically comparing to other algorithms. What's more, the computational times reveal the subtle design of PSO-DLS.

[1]  Mohammed Azmi Al-Betar,et al.  Text feature selection with a robust weight scheme and dynamic dimension reduction to text document clustering , 2017, Expert Syst. Appl..

[2]  Xianjia Wang,et al.  The evolution of cooperation in the Prisoner’s Dilemma and the Snowdrift game based on Particle Swarm Optimization , 2017 .

[3]  Yan Jiang,et al.  Improved particle swarm algorithm for hydrological parameter optimization , 2010, Appl. Math. Comput..

[4]  Fred Glover,et al.  Tabu Search - Part II , 1989, INFORMS J. Comput..

[5]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[6]  Changhe Li,et al.  A Self-Learning Particle Swarm Optimizer for Global Optimization Problems , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  Gang Xu,et al.  An adaptive parameter tuning of particle swarm optimization algorithm , 2013, Appl. Math. Comput..

[8]  Nikolaus Hansen,et al.  Adapting arbitrary normal mutation distributions in evolution strategies: the covariance matrix adaptation , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[9]  Yang Gao,et al.  Selectively-informed particle swarm optimization , 2015, Scientific Reports.

[10]  Zhou Wei,et al.  A novel particle swarm optimization algorithm based on particle migration , 2012 .

[11]  Bo Yang,et al.  Improving particle swarm optimization using multi-layer searching strategy , 2014, Inf. Sci..

[12]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[13]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[14]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[15]  T. Bakhshpoori,et al.  An efficient hybrid Particle Swarm and Swallow Swarm Optimization algorithm , 2014 .

[16]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[17]  Chongzhao Han,et al.  Knowledge-based cooperative particle swarm optimization , 2008, Appl. Math. Comput..

[18]  Li-Yeh Chuang,et al.  Chaotic maps based on binary particle swarm optimization for feature selection , 2011, Appl. Soft Comput..

[19]  A. Zolfaghari,et al.  A new hybrid method for multi-objective fuel management optimization using parallel PSO-SA , 2014 .

[20]  Fariborz Jolai,et al.  Prepositioning emergency earthquake response supplies: A new multi-objective particle swarm optimization algorithm , 2016 .

[21]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[22]  Parham Moradi,et al.  A hybrid particle swarm optimization for feature subset selection by integrating a novel local search strategy , 2016, Appl. Soft Comput..

[23]  Tiranee Achalakul,et al.  Particle Swarm Optimization inspired by starling flock behavior , 2015, Appl. Soft Comput..

[24]  David E. Goldberg,et al.  Genetic algorithms and Machine Learning , 1988, Machine Learning.

[25]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[26]  Wen-Bo Du,et al.  Particle Swarm Optimization with Scale-Free Interactions , 2014, PloS one.

[27]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[28]  Lichao Cao,et al.  Improved particle swarm optimization algorithm and its application in text feature selection , 2015, Appl. Soft Comput..

[29]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[30]  Halife Kodaz,et al.  A novel parallel multi-swarm algorithm based on comprehensive learning particle swarm optimization , 2015, Eng. Appl. Artif. Intell..

[31]  Amitava Chatterjee,et al.  A new social and momentum component adaptive PSO algorithm for image segmentation , 2011, Expert Syst. Appl..

[32]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[33]  Magdalene Marinaki,et al.  Particle Swarm Optimization for the Vehicle Routing Problem with Stochastic Demands , 2013, Appl. Soft Comput..

[34]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[35]  ChunXia Zhao,et al.  Particle swarm optimization with adaptive population size and its application , 2009, Appl. Soft Comput..

[36]  James Kennedy,et al.  Some Issues and Practices for Particle Swarms , 2007, 2007 IEEE Swarm Intelligence Symposium.

[37]  Debasish Ghose,et al.  Glowworm swarm optimization for simultaneous capture of multiple local optima of multimodal functions , 2009, Swarm Intelligence.

[38]  R. Venkata Rao,et al.  Teaching-learning-based optimization: A novel method for constrained mechanical design optimization problems , 2011, Comput. Aided Des..

[39]  Halife Kodaz,et al.  A new hybrid method based on Particle Swarm Optimization, Ant Colony Optimization and 3-Opt algorithms for Traveling Salesman Problem , 2015, Appl. Soft Comput..

[40]  D. Karaboga,et al.  On the performance of artificial bee colony (ABC) algorithm , 2008, Appl. Soft Comput..

[41]  Xin-Ping Guan,et al.  Dynamic multi-swarm particle swarm optimizer with cooperative learning strategy , 2015, Appl. Soft Comput..

[42]  Antonios Tsourdos,et al.  Convergence proof of an enhanced Particle Swarm Optimisation method integrated with Evolutionary Game Theory , 2016, Inf. Sci..

[43]  Hossein Nezamabadi-pour,et al.  A gravitational search algorithm for multimodal optimization , 2014, Swarm Evol. Comput..

[44]  K. Lee,et al.  A new meta-heuristic algorithm for continuous engineering optimization: harmony search theory and practice , 2005 .

[45]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[46]  James Kennedy,et al.  Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[47]  Mehmet Fatih Tasgetiren,et al.  Dynamic multi-swarm particle swarm optimizer with harmony search , 2011, Expert Syst. Appl..

[48]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[49]  Shilpa Suresh,et al.  Multilevel thresholding based on Chaotic Darwinian Particle Swarm Optimization for segmentation of satellite images , 2017, Appl. Soft Comput..

[50]  Licheng Jiao,et al.  A coevolutionary technique based on multi-swarm particle swarm optimization for dynamic multi-objective optimization , 2017, Eur. J. Oper. Res..

[51]  Mohammad Mehdi Ebadzadeh,et al.  A novel particle swarm optimization algorithm with adaptive inertia weight , 2011, Appl. Soft Comput..

[52]  Xia Li,et al.  A novel particle swarm optimizer hybridized with extremal optimization , 2010, Appl. Soft Comput..

[53]  Xiaodong Li,et al.  Adaptively Choosing Neighbourhood Bests Using Species in a Particle Swarm Optimizer for Multimodal Function Optimization , 2004, GECCO.

[54]  Xin-Ping Guan,et al.  A new particle swarm optimization algorithm with adaptive inertia weight based on Bayesian techniques , 2015, Appl. Soft Comput..

[55]  Jeff Orchard,et al.  Particle swarm optimization using dynamic tournament topology , 2016, Appl. Soft Comput..

[56]  Wei-Der Chang,et al.  A modified particle swarm optimization with multiple subpopulations for multimodal function optimization problems , 2015, Appl. Soft Comput..

[57]  Farshad Kowsary,et al.  Multi-objective optimization of the building energy performance: A simulation-based approach by means of particle swarm optimization (PSO) , 2016 .

[58]  Haibin Duan,et al.  Swarm intelligence inspired shills and the evolution of cooperation , 2014, Scientific Reports.

[59]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.