Diversity and frame invariance characteristics in Particle Swarm Optimization with and without digital pheromones

Academic problems for testing optimization methods are widely criticized for not being a good representative of real world problems. Due to the unavailability of publishable proprietary information from industries they collaborate with, researchers tend to simulate complex problems by using ‘n-dimensional’ multimodal and/or multi-objective academic test problems for evaluating optimization methods developed. Most of these benchmarking test problems can be decomposed and solved as ‘n’ 1-dimensional optimization problems, rendering them as ineffective representation of real-world problems. However, studies show that coordinate rotation of test problems through an arbitrary angle makes design variables dependent on each other and cannot easily be decomposed into simpler problem chunks. Test problems formulated with coordinate rotation therefore will represent a realistic test bed for evaluating the performance of an optimization routine. However with coordinate rotation, the complexity of the problems potentially increases from O(n n ) to O(exp(n ln n)) imposing performance loss on the optimization method that solves the problem. In this paper, the authors attempted to investigate whether coordinate rotation affects the performance characteristics of the digital pheromone implementation of Particle Swarm Optimization (PSO). In particular, two characteristics - swarm diversity with different random number schemes for the velocity vector, and frame invariance with rotational problems are studied and reported. In other words, the authors intended to evaluate whether PSO with digital pheromones is truly capable of solving complex problems.

[1]  B J Fregly,et al.  Parallel global optimization with the particle swarm algorithm , 2004, International journal for numerical methods in engineering.

[2]  Jaroslaw Sobieszczanski-Sobieski,et al.  Multidisciplinary optimization of a transport aircraft wing using particle swarm optimization , 2002 .

[3]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.

[4]  Li Na Particle Swarm Algorithm and Its Applications , 2010 .

[5]  Hitoshi Iba,et al.  Particle swarm optimization with Gaussian mutation , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[6]  Andries Petrus Engelbrecht,et al.  Fundamentals of Computational Swarm Intelligence , 2005 .

[7]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[8]  B. P. Wang,et al.  Particle Swarm Optimization for Mixed Discrete, Integer and Continuous Variables , 2004 .

[9]  C. Loan,et al.  Nineteen Dubious Ways to Compute the Exponential of a Matrix , 1978 .

[10]  J. Sobieszczanski-Sobieski,et al.  Multidisciplinary optimization of a transport aircraft wing using particle swarm optimization , 2004 .

[11]  Eliot Winer,et al.  Improving solution characteristics of particle swarm optimization using digital pheromones , 2009 .

[12]  Eliot Winer,et al.  Asynchronous parallelization of particle swarm optimization through digital pheromone sharing , 2009 .

[13]  A Kaveh,et al.  ENGINEERING OPTIMIZATION WITH HYBRID PARTICLE SWARM AND ANT COLONY OPTIMIZATION , 2009 .

[14]  A. Groenwold,et al.  Comparison of linear and classical velocity update rules in particle swarm optimization: notes on scale and frame invariance , 2007 .

[15]  Russell C. Eberhart,et al.  Solving Constrained Nonlinear Optimization Problems with Particle Swarm Optimization , 2002 .

[16]  Oddvar O. Bendiksen,et al.  Structures, Structural Dynamics and Materials Conference , 1998 .

[17]  H. Van Dyke Parunak,et al.  DIGITAL PHEROMONES FOR AUTONOMOUS COORDINATION OF SWARMING UAV'S , 2002 .

[18]  Byung-Il Koh,et al.  Parallel asynchronous particle swarm optimization , 2006, International journal for numerical methods in engineering.

[19]  E. Bonabeau,et al.  Swarm Intelligence: A New C2 Paradigm with an Application to Control Swarms of UAVs , 2003 .

[20]  A. Groenwold,et al.  Comparison of linear and classical velocity update rules in particle swarm optimization: notes on diversity , 2007 .

[21]  Eliot Winer,et al.  Synchronous parallelization of Particle Swarm Optimization with digital pheromones , 2009, Adv. Eng. Softw..

[22]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[23]  Eliot Winer,et al.  A Statistical Analysis of Particle Swarm Optimization With and Without Digital Pheromones , 2007 .

[24]  Jaco F. Schutte,et al.  Particle swarms in sizing and global optimization , 2002 .

[25]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[26]  James H. Oliver,et al.  UAV Swarm Control: Calculating Digital Pheromone Fields with the GPU , 2006 .

[27]  Eliot Winer,et al.  Digital Pheromone Implementation of PSO with Velocity Vector Accelerated by Commodity Graphics Hardware , 2006 .

[28]  Eliot Winer,et al.  Implementation of digital pheromones in PSO accelerated by commodity Graphics Hardware , 2008 .

[29]  Russell C. Eberhart,et al.  Particle swarm with extended memory for multiobjective optimization , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[30]  Tony White,et al.  Towards multi-swarm problem solving in networks , 1998, Proceedings International Conference on Multi Agent Systems (Cat. No.98EX160).

[31]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[32]  R. Salomon Re-evaluating genetic algorithm performance under coordinate rotation of benchmark functions. A survey of some theoretical and practical aspects of genetic algorithms. , 1996, Bio Systems.

[33]  Marco Dorigo,et al.  Distributed Optimization by Ant Colonies , 1992 .

[34]  Cleve B. Moler,et al.  Nineteen Dubious Ways to Compute the Exponential of a Matrix, Twenty-Five Years Later , 1978, SIAM Rev..

[35]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[36]  K. Mahadevan,et al.  Comprehensive learning particle swarm optimization for reactive power dispatch , 2010, Appl. Soft Comput..

[37]  Russell C. Eberhart,et al.  Swarm intelligence for permutation optimization: a case study of n-queens problem , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).