Switching Between Swarm Optimization Algorithms During a Run: An Empirical Study

In this paper, it is proposed to switch between swarm optimization algorithms during the optimization process, aiming at combining the best performance from each single swarm optimization algorithm and hence improving the overall empirical performance. To investigate this switching scheme, an empirical study is carried on four swarm algorithms, Particle Swarm Optimization, Gravitational Search, Grey Wolf Optimizer and Chicken Swarm Optimization. All possible switches (combinations) among those four algorithms are tested. In addition, instead of searching for the best switching point, it is prescribed in the experiment. The proposed method is empirically investigated on the so-called Black-Box Optimization Benchmark (BBOB), where the switching method is compared to each individual swarm algorithm as well as using the state-of-the-art black-box optimization algorithm, BIPOP-CMAES (BI-population Covariance Matrix Adaptation Evolution Strategy). The result shows that the switching approach generally improves the performance of individual swarm algorithms. However, none of them can rival the performance of the BIPOP-CMA-ES.

[1]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[2]  Hao Wang,et al.  Evolving the structure of Evolution Strategies , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[3]  Nikolaus Hansen,et al.  The CMA Evolution Strategy: A Comparing Review , 2006, Towards a New Evolutionary Computation.

[4]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[5]  Hao Wang,et al.  Algorithm configuration data mining for CMA evolution strategies , 2017, GECCO.

[6]  Thomas Bäck,et al.  Towards an Adaptive CMA-ES Configurator , 2018, PPSN.

[7]  Michèle Sebag,et al.  Analyzing bandit-based adaptive operator selection mechanisms , 2010, Annals of Mathematics and Artificial Intelligence.

[8]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[9]  Anne Auger,et al.  Real-Parameter Black-Box Optimization Benchmarking 2009: Noiseless Functions Definitions , 2009 .

[10]  Petros Koumoutsakos,et al.  Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES) , 2003, Evolutionary Computation.

[11]  Yu Liu,et al.  A New Bio-inspired Algorithm: Chicken Swarm Optimization , 2014, ICSI.