Multi-swarm parallel PSO: Hardware implementation

The ever increasing popularity of the particle swarm optimization (PSO) algorithm is recently attracting attention to the embedded computing world. Although PSO is considered efficient compared to other contemporary population based optimization techniques, for many continuous multimodal and multidimensional problems, it still suffers from performance loss when it is targeted onto embedded application platforms. Examples of such target applications include small mobile robots and distributed sensor nodes in sensor network applications. In a previous work we presented a novel, modular, efficient and portable hardware architecture to accelerate the performance of the PSO for embedded applications. This paper extends the work by presenting a parallelization technique for further speedup of the PSO algorithm by dividing the swarm into a set of subswarms that are executing in parallel. The underlying communication topology and messaging protocols are described. Finally, the performance of the proposed system is evaluated on mathematical and real-world benchmark functions.

[1]  Richard E. Haskell,et al.  Enhancing performance of PSO with automatic parameter tuning technique , 2009, 2009 IEEE Swarm Intelligence Symposium.

[2]  Richard E. Haskell,et al.  Accelerating the performance of particle swarm optimization for embedded applications , 2009, 2009 IEEE Congress on Evolutionary Computation.

[3]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[4]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[5]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[6]  B J Fregly,et al.  Parallel global optimization with the particle swarm algorithm , 2004, International journal for numerical methods in engineering.

[7]  Gisbert Schneider,et al.  Optimized Particle Swarm Optimization (OPSO) and its application to artificial neural network training , 2006, BMC Bioinformatics.

[8]  Darrin M. Hanna,et al.  Particle Swarm Optimization for Cluster-Based Classification of Breast Cancer Data , 2007, GEM.

[9]  Yizhen Zhang,et al.  Particle swarm optimization for unsupervised robotic learning , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[10]  Bo Yang,et al.  Survey on Applications of Particle Swarm Optimization in Electric Power Systems , 2007, 2007 IEEE International Conference on Control and Automation.

[11]  Robert J. Marks,et al.  FPGA implementation of particle swarm optimization for inversion of large neural networks , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[12]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[13]  Jaroslaw Sobieszczanski-Sobieski,et al.  A Parallel Particle Swarm Optimization Algorithm Accelerated by Asynchronous Evaluations , 2005 .

[14]  James Kennedy,et al.  Defining a Standard for Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.

[15]  Richard E. Haskell,et al.  Hardware PSO for sensor network applications , 2008, 2008 IEEE Swarm Intelligence Symposium.

[16]  Thomas E. Potok,et al.  Document clustering using particle swarm optimization , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[17]  Byung-Il Koh,et al.  Parallel asynchronous particle swarm optimization , 2006, International journal for numerical methods in engineering.

[18]  D.M. Hanna,et al.  Particle Swarm Optimization for classification of breast cancer data using single and multisurface methods of data separation , 2007, 2007 IEEE International Conference on Electro/Information Technology.

[19]  Jianming Zhang,et al.  Optimization design based on PSO algorithm for PID controller , 2004, Fifth World Congress on Intelligent Control and Automation (IEEE Cat. No.04EX788).

[20]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[21]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[22]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[23]  Christian Posthoff,et al.  Earthquake classifying neural networks trained with random dynamic neighborhood PSOs , 2007, GECCO '07.

[24]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.