Particle Swarm Optimization with Moving Particles on Scale-Free Networks

PSO is a nature-inspired optimization algorithm widely applied in many fields. In this paper, we present a variant named MP-PSO, in which some particles are allowed to move on a scale-free network and change the interaction pattern during the search course. In contrast to traditional PSOs with fixed interaction sources, MP-PSO shows better flexibility and diversity, where the structure of the particle swarm could change adaptively and balance exploration and exploitation to a large extent. Experiments on benchmark functions show that MP-PSO outperforms other PSO variants on solution quality and success rate, especially for multimodal functions. We further investigate effects of the moving strategy from a microscopic view, finding that the cooperation mechanism of particles located on hub and non-hub nodes plays a crucial role during the optimization process. In particular, owing to the movement of particles on non-hub nodes, the exploration can be guaranteed to some extent even in the final stage, which may be benefit for optimization. We demonstrate the applicability of MP-PSO by using it to solve an important optimization problem, arrival sequencing and scheduling, in the field of air traffic control.

[1]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[2]  Wen-Hua Chen,et al.  Genetic algorithm based on receding horizon control for arrival sequencing and scheduling , 2005, Eng. Appl. Artif. Intell..

[3]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[4]  Wenbo Xu,et al.  Particle swarm optimization with particles having quantum behavior , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[5]  Xin Yao,et al.  Negatively Correlated Search , 2015, IEEE Journal on Selected Areas in Communications.

[6]  Changhe Li,et al.  A Self-Learning Particle Swarm Optimizer for Global Optimization Problems , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  Giovanni Andreatta,et al.  Aircraft Flow Management under Congestion , 1987, Transp. Sci..

[8]  Martin Middendorf,et al.  A hierarchical particle swarm optimizer and its adaptive variant , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[10]  Wen Ying,et al.  Heterogeneous Strategy Particle Swarm Optimization , 2016, IEEE Transactions on Circuits and Systems II: Express Briefs.

[11]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[12]  L. Coelho A quantum particle swarm optimizer with chaotic mutation operator , 2008 .

[13]  Jun Sun,et al.  A global search strategy of quantum-behaved particle swarm optimization , 2004, IEEE Conference on Cybernetics and Intelligent Systems, 2004..

[14]  Ponnuthurai N. Suganthan,et al.  A Distance-Based Locally Informed Particle Swarm Model for Multimodal Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[15]  James Kennedy,et al.  Defining a Standard for Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.

[16]  Xiaodong Li,et al.  Niching Without Niching Parameters: Particle Swarm Optimization Using a Ring Topology , 2010, IEEE Transactions on Evolutionary Computation.

[17]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[18]  A. Rezaee Jordehi Particle swarm optimisation for dynamic optimisation problems: a review , 2014, Neural Computing and Applications.

[19]  Xiaodong Li,et al.  An Analysis of the Inertia Weight Parameter for Binary Particle Swarm Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[20]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[21]  Wenbo Xu,et al.  Adaptive parameter control for quantum-behaved particle swarm optimization on individual level , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[22]  Jing J. Liang,et al.  Novel composition test functions for numerical global optimization , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[23]  Wen-Bo Du,et al.  Particle Swarm Optimization with Scale-Free Interactions , 2014, PloS one.

[24]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[25]  Xiaodong Li,et al.  Cooperative Coevolution With Route Distance Grouping for Large-Scale Capacitated Arc Routing Problems , 2014, IEEE Transactions on Evolutionary Computation.

[26]  Rajesh Arora,et al.  Optimization: Algorithms and Applications , 2015 .

[27]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[28]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[29]  James Kennedy,et al.  Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[30]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[31]  Hamsa Balakrishnan,et al.  Algorithms for Scheduling Runway Operations Under Constrained Position Shifting , 2010, Oper. Res..

[32]  D. Winfield,et al.  Optimization: Theory and practice , 1972 .

[33]  Yang Gao,et al.  Selectively-informed particle swarm optimization , 2015, Scientific Reports.

[34]  R. Salomon Re-evaluating genetic algorithm performance under coordinate rotation of benchmark functions. A survey of some theoretical and practical aspects of genetic algorithms. , 1996, Bio Systems.

[35]  Shuyuan Yang,et al.  A quantum particle swarm optimization , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[36]  R. Eberhart,et al.  Fuzzy adaptive particle swarm optimization , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[37]  Jun Zhang,et al.  Small-world particle swarm optimization with topology adaptation , 2013, GECCO '13.