Parallel asynchronous particle swarm optimization

The high computational cost of complex engineering optimization problems has motivated the development of parallel optimization algorithms. A recent example is the parallel particle swarm optimization (PSO) algorithm, which is valuable due to its global search capabilities. Unfortunately, because existing parallel implementations are synchronous (PSPSO), they do not make efficient use of computational resources when a load imbalance exists. In this study, we introduce a parallel asynchronous PSO (PAPSO) algorithm to enhance computational efficiency. The performance of the PAPSO algorithm was compared to that of a PSPSO algorithm in homogeneous and heterogeneous computing environments for small‐ to medium‐scale analytical test problems and a medium‐scale biomechanical test problem. For all problems, the robustness and convergence rate of PAPSO were comparable to those of PSPSO. However, the parallel performance of PAPSO was significantly better than that of PSPSO for heterogeneous computing environments or heterogeneous computational tasks. For example, PAPSO was 3.5 times faster than was PSPSO for the biomechanical test problem executed on a heterogeneous cluster with 20 processors. Overall, PAPSO exhibits excellent parallel performance when a large number of processors (more than about 15) is utilized and either (1) heterogeneity exists in the computational task or environment, or (2) the computation‐to‐communication time ratio is relatively small. Copyright © 2006 John Wiley & Sons, Ltd.

[1]  A. Griewank Generalized descent for global optimization , 1981 .

[2]  Sandro Ridella,et al.  Minimizing multimodal functions of continuous variables with the “simulated annealing” algorithmCorrigenda for this article is available here , 1987, TOMS.

[3]  Klaus Ritter,et al.  An asynchronous parallel newton method , 1988, Math. Program..

[4]  Rajarshi Das,et al.  A Study of Control Parameters Affecting Online Performance of Genetic Algorithms for Function Optimization , 1989, ICGA.

[5]  Message Passing Interface Forum MPI: A message - passing interface standard , 1994 .

[6]  D. Conforti,et al.  Convergence and numerical results for a parallel asynchronous quasi-Newton method , 1995 .

[7]  M G Pandy,et al.  Application of high-performance computing to numerical simulation of human movement. , 1995, Journal of biomechanical engineering.

[8]  Scott B. Baden,et al.  Analysis of the numerical effects of parallelism on a parallel genetic algorithm , 1996, Proceedings of International Conference on Parallel Processing.

[9]  Jack Dongarra,et al.  MPI: The Complete Reference , 1996 .

[10]  Kyung-Geun Lee,et al.  Synchronous and Asynchronous Parallel Simulated Annealing with Multiple Markov Chains , 1996, IEEE Trans. Parallel Distributed Syst..

[11]  D N White Parallel pattern search energy minimization. , 1997, Journal of molecular graphics & modelling.

[12]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[13]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.

[14]  M. Clerc,et al.  The swarm and the queen: towards a deterministic and adaptive particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[15]  M. Pandy,et al.  A Dynamic Optimization Solution for Vertical Jumping in Three Dimensions. , 1999, Computer methods in biomechanics and biomedical engineering.

[16]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[17]  Enrique Alba,et al.  Analyzing synchronous and asynchronous parallel distributed genetic algorithms , 2001, Future Gener. Comput. Syst..

[18]  Tamara G. Kolda,et al.  Asynchronous Parallel Pattern Search for Nonlinear Optimization , 2001, SIAM J. Sci. Comput..

[19]  M G Pandy,et al.  Computer modeling and simulation of human movement. , 2001, Annual review of biomedical engineering.

[20]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[21]  Thomas Kiel Rasmussen,et al.  Hybrid Particle Swarm Optimiser with breeding and subpopulations , 2001 .

[22]  Jaroslaw Sobieszczanski-Sobieski,et al.  Multidisciplinary optimization of a transport aircraft wing using particle swarm optimization , 2002 .

[23]  Celso Marcelo Franklin Lapa,et al.  Coarse-grained parallel genetic algorithm applied to a nuclear reactor core design optimization problem , 2003 .

[24]  A J Knoek van Soest,et al.  The merits of a parallel genetic algorithm in solving hard optimization problems. , 2003, Journal of biomechanical engineering.

[25]  Yahya Rahmat-Samii,et al.  Particle swarm optimization for reconfigurable phase‐differentiated array design , 2003 .

[26]  B J Fregly,et al.  Parallel global optimization with the particle swarm algorithm , 2004, International journal for numerical methods in engineering.

[27]  Jeffrey A Reinbolt,et al.  Evaluation of Parallel Decomposition Methods for Biomechanical Optimizations , 2004, Computer methods in biomechanics and biomedical engineering.

[28]  R R Neptune,et al.  Simulated parallel annealing within a neighborhood for optimization of biomechanical systems. , 2005, Journal of biomechanics.

[29]  Jaco F Schutte,et al.  Evaluation of a particle swarm algorithm for biomechanical optimization. , 2005, Journal of biomechanical engineering.

[30]  Jaco F Schutte,et al.  Determination of patient-specific multi-joint kinematic models through two-level optimization. , 2005, Journal of biomechanics.

[31]  Byung-Il Koh,et al.  PARALLEL ASYNCHRONOUS PARTICLE SWARM FOR GLOBAL BIOMECHANICAL OPTIMIZATION , 2005 .

[32]  Jaroslaw Sobieszczanski-Sobieski,et al.  A Parallel Particle Swarm Optimization Algorithm Accelerated by Asynchronous Evaluations , 2005 .

[33]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.