A Complex Neighborhood based Particle Swarm Optimization

This paper proposes a new variant of the PSO algorithm named Complex Neighborhood Particle Swarm Optimizer (CNPSO) for solving global optimization problems. In the CNPSO, the neighborhood of the particles is organized through a complex network which is modified during the search process. This evolution of the topology seeks to improve the influence of the most successful particles and it is fine tuned for maintaining the scale-free characteristics of the network while the optimization is being performed. The use of a scale-free topology instead of the usual regular or global neighborhoods is intended to bring to the search procedure a better capability of exploring promising regions without a premature convergence, which would result in the procedure being easily trapped in a local optimum. The performance of the CNPSO is compared with the standard PSO on some well-known and high-dimensional benchmark functions, ranging from multimodal to plateau-like problems. In all the cases the CNPSO outperformed the standard PSO.

[1]  S. N. Dorogovtsev,et al.  Evolution of networks , 2001, cond-mat/0106144.

[2]  James Kennedy,et al.  Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[3]  James Kennedy,et al.  Dynamic-probabilistic particle swarms , 2005, GECCO '05.

[4]  Paul Erdös,et al.  On random graphs, I , 1959 .

[5]  Mark E. J. Newman,et al.  The Structure and Function of Complex Networks , 2003, SIAM Rev..

[6]  L. Amaral,et al.  The web of human sexual contacts , 2001, Nature.

[7]  R. May.  Food webs. , 1983, Science.

[8]  Carlos A. Coello Coello,et al.  A constraint-handling mechanism for particle swarm optimization , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[9]  J. Montoya,et al.  Small world patterns in food webs. , 2002, Journal of theoretical biology.

[10]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[11]  M. Newman,et al.  The structure of scientific collaboration networks. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[12]  Pablo A. Estévez,et al.  Selecting the Most Influential Nodes in Social Networks , 2007, 2007 International Joint Conference on Neural Networks.

[13]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[14]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[15]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[16]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[17]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[18]  A RAPOPORT,et al.  A study of a large sociogram. , 2007 .

[19]  Jing J. Liang,et al.  Particle swarm optimization algorithms with novel learning strategies , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[20]  Michalis Faloutsos,et al.  On power-law relationships of the Internet topology , 1999, SIGCOMM '99.

[21]  S. Shen-Orr,et al.  Network motifs in the transcriptional regulation network of Escherichia coli , 2002, Nature Genetics.

[22]  M. Handcock,et al.  An assessment of preferential attachment as a mechanism for human sexual network formation , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[23]  Jun Tani,et al.  How Hierarchical Control Self-organizes in Artificial Adaptive Systems , 2005, Adapt. Behav..

[24]  Ajith Abraham,et al.  A new quantum behaved particle swarm optimization , 2008, GECCO '08.

[25]  Yun Shang,et al.  A Note on the Extended Rosenbrock Function , 2006 .

[26]  Albert-László Barabási,et al.  Linked - how everything is connected to everything else and what it means for business, science, and everyday life , 2003 .

[27]  A. Barabasi,et al.  Evolution of the social network of scientific collaborations , 2001, cond-mat/0104162.