Particle swarm optimization with adaptive linkage learning

In many problems, the quality of solutions and computational effort required by optimization algorithms can be improved by exploiting knowledge found in the linkages or interrelations between problem dimensions or components. These linkages are sometimes known a priori from the nature of the itself; in other cases linkages can be learned by sampling the data space prior to the application of the optimization algorithm. This paper presents a new version of the particle swarm optimization algorithm (PSO) that utilizes linkages between components, performing more frequent simultaneous updates on subsets of particle position components that are strongly linked. Prior to application of this linkage-sensitive PSO algorithm, problem specific linkages can be learned by examining a randomly chosen collection of points in the search space to determine the correlations in fitness changes resulting from perturbations in pairs of components of particle positions. The resulting algorithm, adaptive-linkage PSO (ALiPSO) has performed significantly better than the classical PSO, in simulations conducted so far on several test problems.

[1]  P. Suganthan Particle swarm optimiser with neighbourhood operator , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[2]  Russell C. Eberhart,et al.  Comparison between Genetic Algorithms and Particle Swarm Optimization , 1998, Evolutionary Programming.

[3]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[4]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[5]  Kishan G. Mehrotra,et al.  Adaptive Linkage Crossover , 2000, Evol. Comput..

[6]  G. Harik Learning gene linkage to efficiently solve problems of bounded difficulty using genetic algorithms , 1997 .

[7]  Hans-Georg Beyer,et al.  The Theory of Evolution Strategies , 2001, Natural Computing Series.

[8]  M. Clerc,et al.  The swarm and the queen: towards a deterministic and adaptive particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[9]  Kenneth A. De Jong,et al.  Using Problem Generators to Explore the Effects of Epistasis , 1997, ICGA.

[10]  David E. Goldberg,et al.  Modified Linkage Learning Genetic Algorithm For Difficult Non-stationary Problems , 2002, GECCO.

[11]  Frans van den Bergh,et al.  An analysis of particle swarm optimizers , 2002 .

[12]  James Kennedy,et al.  The particle swarm: social adaptation of knowledge , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[13]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[14]  David E. Goldberg,et al.  Alleles, loci and the traveling salesman problem , 1985 .

[15]  Kalyan Veeramachaneni,et al.  Fitness-distance-ratio based particle swarm optimization , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).