Identifying and exploiting the scale of a search space in particle swarm optimization

Multi-modal optimization involves two distinct tasks: identifying promising attraction basins and finding the local optima in these basins. Unfortunately, the second task can interfere with the first task if they are performed simultaneously. Specifically, the promise of an attraction basin is often estimated by the fitness of a single sample solution, so an attraction basin represented by a random sample solution can appear to be less promising than an attraction basin represented by its local optimum. The goal of thresheld convergence is to prevent these biased comparisons by disallowing local search while global search is still in progress. Ideally, thresheld convergence achieves this goal by using a distance threshold that is correlated to the size of the attraction basins in the search space. In this paper, a clustering-based method is developed to identify the scale of the search space which thresheld convergence can then exploit. The proposed method employed in the context of a multi-start particle swarm optimization algorithm has led to large improvements across a broad range of multi-modal problems.

[1]  Xiaodong Li,et al.  Adaptively choosing niching parameters in a PSO , 2006, GECCO.

[2]  Sheng Chen,et al.  Particle swarm optimization with thresheld convergence , 2013, 2013 IEEE Congress on Evolutionary Computation.

[3]  Antonio Bolufé Röhler,et al.  Differential evolution with thresheld convergence , 2013, 2013 IEEE Congress on Evolutionary Computation.

[4]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[5]  Jürgen Branke,et al.  Experimental Analysis of Bound Handling Techniques in Particle Swarm Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[6]  James Montgomery,et al.  Identifying and exploiting the scale of a search space in differential evolution , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[7]  Antonio Bolufé Röhler,et al.  Minimum population search - Lessons from building a heuristic technique with two population members , 2013, 2013 IEEE Congress on Evolutionary Computation.

[8]  Marjan Mernik,et al.  Exploration and exploitation in evolutionary algorithms: A survey , 2013, CSUR.

[9]  Frans van den Bergh,et al.  A NICHING PARTICLE SWARM OPTIMIZER , 2002 .

[10]  Heinz Mühlenbein,et al.  The parallel genetic algorithm as function optimizer , 1991, Parallel Comput..

[11]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer with local search for Large Scale Global Optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[12]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[13]  J. Kennedy Stereotyping: improving particle swarm performance with cluster analysis , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[14]  James Montgomery,et al.  A simple strategy for maintaining diversity and reducing crowding in differential evolution , 2012, 2012 IEEE Congress on Evolutionary Computation.

[15]  Peter J. Rousseeuw,et al.  Finding Groups in Data: An Introduction to Cluster Analysis , 1990 .

[16]  James Montgomery,et al.  A simple strategy to maintain diversity and reduce crowding in particle swarm optimization , 2011, Australasian Conference on Artificial Intelligence.

[17]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[18]  Tim Hendtlass,et al.  WoSP: a multi-optima particle swarm algorithm , 2005, 2005 IEEE Congress on Evolutionary Computation.

[19]  Frans van den Bergh,et al.  An analysis of particle swarm optimizers , 2002 .

[20]  Andries Petrus Engelbrecht,et al.  Particle swarm optimization: Velocity initialization , 2012, 2012 IEEE Congress on Evolutionary Computation.

[21]  James Kennedy,et al.  Defining a Standard for Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.