A decentralized quantum-inspired particle swarm optimization algorithm with cellular structured population

This paper proposes a decentralized form of quantum-inspired particle swarm optimization (QPSO) with cellular structured population (called cQPSO) for keeping the population diversity and balancing the global and local search. The cQPSO is further improved by re-designing the local attractor in the sub-population (called cQPSO-lbest) in order to accelerate the diffusion of the best solution and thus enhance the performance of cQPSO. The particles in cQPSO and cQPSO-lbest are distributed in a two-dimensional (2D) grid and only allowed to interact with their neighbors according to the specified neighborhood, which plays a role in exploiting the search space inside the neighborhood. The overlapping particles work for delivering the information among the nearest neighborhoods acting as exploring the search space with diffusion of solutions during the evolutionary process. Theoretical studies are made to analyze the global convergence of cPSO and cQPSO-lbest based on the theory of probabilistic metric space. We systematically investigate the performance of cQPSO-lbest on 42 benchmark functions with different properties (including unimodal, multimodal, separated, shifted, rotated, noisy, and mis-scaled) and compare with a set of PSO variants with different topologies and swarm-based evolutionary algorithms (EAs). The experimental results demonstrate the better performance of cQPSO-lbest. Moreover, two real-world problems, which are two-dimensional (2D) IIR digital filter design and economic dispatch (ED) problem from power systems area, are used to evaluate cQPSO-lbest and the experimental results verified the advantages of cQPSO-lbest.

[1]  Wenbo Xu,et al.  A Quantum-Behaved Particle Swarm Optimization With Diversity-Guided Mutation for the Design of Two-Dimensional IIR Digital Filters , 2010, IEEE Transactions on Circuits and Systems II: Express Briefs.

[2]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[3]  Mehmet Fatih Tasgetiren,et al.  A discrete particle swarm optimization algorithm for the no-wait flowshop scheduling problem , 2008, Comput. Oper. Res..

[4]  P. N. Suganthan,et al.  Ensemble of niching algorithms , 2010, Inf. Sci..

[5]  Teresa Wu,et al.  An Adaptive Particle Swarm Optimization With Multiple Adaptive Methods , 2013, IEEE Transactions on Evolutionary Computation.

[6]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[7]  Enrique Alba,et al.  The exploration/exploitation tradeoff in dynamic cellular genetic algorithms , 2005, IEEE Transactions on Evolutionary Computation.

[8]  Yaochu Jin,et al.  A social learning particle swarm optimization algorithm for scalable optimization , 2015, Inf. Sci..

[9]  Hung-Chih Chiu,et al.  Adaptive fuzzy particle swarm optimization for global optimization of multimodal functions , 2011, Inf. Sci..

[10]  James Kennedy,et al.  Some Issues and Practices for Particle Swarms , 2007, 2007 IEEE Swarm Intelligence Symposium.

[11]  P. J. Angeline,et al.  Using selection to improve particle swarm optimization , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[12]  P. Suganthan.  Particle swarm optimiser with neighbourhood operator , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[13]  Xiao-Feng Xie,et al.  DEPSO: hybrid particle swarm with differential evolution operator , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[14]  Ying Li,et al.  An improved particle swarm optimisation based on cellular automata , 2014, Int. J. Comput. Sci. Math..

[15]  James Kennedy,et al.  Bare bones particle swarms , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[16]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[17]  Jing Liu,et al.  Parameter Selection of Quantum-Behaved Particle Swarm Optimization , 2005, ICNC.

[18]  Wenbo Xu,et al.  A Diversity-Guided Quantum-Behaved Particle Swarm Optimization Algorithm , 2006, SEAL.

[19]  Gary B. Lamont,et al.  Visualizing particle swarm optimization - Gaussian particle swarm optimization , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[20]  Xiaojun Wu,et al.  Quantum-Behaved Particle Swarm Optimization: Analysis of Individual Particle Behavior and Parameter Selection , 2012, Evolutionary Computation.

[21]  Xin-She Yang,et al.  Cuckoo Search and Firefly Algorithm: Overview and Analysis , 2014 .

[22]  Renato A. Krohling,et al.  Bare Bones Particle Swarm Optimization with Gaussian or Cauchy jumps , 2009, 2009 IEEE Congress on Evolutionary Computation.

[23]  Jun Zhang,et al.  Competitive and cooperative particle swarm optimization with information sharing mechanism for global optimization problems , 2015, Inf. Sci..

[24]  Xiaodong Li,et al.  Niching Without Niching Parameters: Particle Swarm Optimization Using a Ring Topology , 2010, IEEE Transactions on Evolutionary Computation.

[25]  Tim M. Blackwell,et al.  The Lévy Particle Swarm , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[26]  Changhe Li,et al.  A Clustering Particle Swarm Optimizer for Locating and Tracking Multiple Optima in Dynamic Environments , 2010, IEEE Transactions on Evolutionary Computation.

[27]  Xiaodong Li,et al.  Cooperatively Coevolving Particle Swarms for Large Scale Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[28]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer with local search , 2005, 2005 IEEE Congress on Evolutionary Computation.

[29]  Xin-She Yang,et al.  Cuckoo Search and Firefly Algorithm: Theory and Applications , 2013 .

[30]  Xiaojun Wu,et al.  Convergence analysis and improvements of quantum-behaved particle swarm optimization , 2012, Inf. Sci..

[31]  Jun Zhang,et al.  Adaptive Particle Swarm Optimization , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[32]  Rui Mendes,et al.  Neighborhood topologies in fully informed and best-of-neighborhood particle swarms , 2006 .

[33]  Xiaojun Wu,et al.  Solving the Power Economic Dispatch Problem With Generator Constraints by Random Drift Particle Swarm Optimization , 2014, IEEE Transactions on Industrial Informatics.

[34]  Shengxiang Yang,et al.  A memetic particle swarm optimization algorithm for multimodal optimization problems , 2011, 2011 Chinese Control and Decision Conference (CCDC).

[35]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[36]  Jing J. Liang,et al.  Niching particle swarm optimization with local search for multi-modal optimization , 2012, Inf. Sci..

[37]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[38]  Kalyanmoy Deb,et al.  Development of efficient particle swarm optimizers by using concepts from evolutionary algorithms , 2010, GECCO '10.

[39]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[40]  Yu Wang,et al.  Self-adaptive learning based particle swarm optimization , 2011, Inf. Sci..

[41]  Andries Petrus Engelbrecht,et al.  Particle swarm optimization with spatially meaningful neighbours , 2008, 2008 IEEE Swarm Intelligence Symposium.

[42]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[43]  Michael G. Epitropakis,et al.  Evolving cognitive and social experience in Particle Swarm Optimization through Differential Evolution: A hybrid approach , 2012, Inf. Sci..

[44]  Meie Shen,et al.  Bi-Velocity Discrete Particle Swarm Optimization and Its Application to Multicast Routing Problem in Communication Networks , 2014, IEEE Transactions on Industrial Electronics.

[45]  Riccardo Poli,et al.  Analysis of the publications on the applications of particle swarm optimisation , 2008 .

[46]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[47]  Lehrstuhl für Elektrische,et al.  Gaussian swarm: a novel particle swarm optimization algorithm , 2004, IEEE Conference on Cybernetics and Intelligent Systems, 2004..

[48]  James Kennedy,et al.  Probability and dynamics in the particle swarm , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[49]  R. Eberhart,et al.  Fuzzy adaptive particle swarm optimization , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[50]  Robert W. Day,et al.  Comparisons of Treatments After an Analysis of Variance in Ecology , 1989 .

[51]  M.N.S. Swamy,et al.  Design of two-dimensional recursive filters using genetic algorithms , 2003 .

[52]  Jun Sun,et al.  A global search strategy of quantum-behaved particle swarm optimization , 2004, IEEE Conference on Cybernetics and Intelligent Systems, 2004..

[53]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[54]  James Kennedy,et al.  Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[55]  Xiaodong Li,et al.  Adaptively Choosing Neighbourhood Bests Using Species in a Particle Swarm Optimizer for Multimodal Function Optimization , 2004, GECCO.

[56]  Terence Soule,et al.  Breeding swarms: a GA/PSO hybrid , 2005, GECCO '05.

[57]  Chilukuri K. Mohan,et al.  Particle swarm optimization with adaptive linkage learning , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[58]  Wenbo Xu,et al.  Particle swarm optimization with particles having quantum behavior , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[59]  Changhe Li,et al.  A Self-Learning Particle Swarm Optimizer for Global Optimization Problems , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[60]  Xiaodong Li,et al.  Cooperative Co-Evolution With Differential Grouping for Large Scale Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[61]  Hui Wang,et al.  Diversity enhanced particle swarm optimization with neighborhood search , 2013, Inf. Sci..

[62]  Xiaojun Wu,et al.  A Review of Quantum-behaved Particle Swarm Optimization , 2010 .

[63]  Wen-Chih Peng,et al.  Particle Swarm Optimization With Recombination and Dynamic Linkage Discovery , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[64]  Thomas Kiel Rasmussen,et al.  Hybrid Particle Swarm Optimiser with breeding and subpopulations , 2001 .

[65]  Yaochu Jin,et al.  A Competitive Swarm Optimizer for Large Scale Optimization , 2015, IEEE Transactions on Cybernetics.

[66]  Amit Konar,et al.  An efficient evolutionary algorithm applied to the design of two-dimensional IIR filters , 2005, GECCO '05.

[67]  Christian Posthoff,et al.  Neighborhood Re-structuring in Particle Swarm Optimization , 2005, Australian Conference on Artificial Intelligence.

[68]  Maoguo Gong,et al.  Greedy discrete particle swarm optimization for large-scale social network clustering , 2015, Inf. Sci..

[69]  Piotr A. Kowalski,et al.  Study of Flower Pollination Algorithm for Continuous Optimization , 2014, IEEE Conf. on Intelligent Systems.

[70]  Enrique Alba,et al.  Cellular Evolutionary Algorithms: Evaluating the Influence of Ratio , 2000, PPSN.