Proactive Particles in Swarm Optimization: A settings-free algorithm for real-parameter single objective optimization problems

Particle Swarm Optimization (PSO) is an effective Swarm Intelligence technique for the optimization of non-linear and complex high-dimensional problems. Since PSO's performance is strongly dependent on the choice of its functioning settings, in this work we consider a self-tuning version of PSO, called Proactive Particles in Swarm Optimization (PPSO). PPSO leverages Fuzzy Logic to dynamically determine the best settings for the inertia weight, cognitive factor and social factor. The PPSO algorithm significantly differs from other versions of PSO relying on Fuzzy Logic, because specific settings are assigned to each particle according to its history, instead of being globally assigned to the whole swarm. In such a way, PPSO's particles gain a limited autonomous and proactive intelligence with respect to the reactive agents proposed by PSO. Our results show that PPSO achieves overall good optimization performances on the benchmark functions proposed in the CEC 2017 test suite, with the exception of those based on the Schwefel function, whose fitness landscape seems to mislead the fuzzy reasoning. Moreover, with many benchmark functions, PPSO is characterized by a higher speed of convergence than PSO in the case of high-dimensional problems.

[1]  A. Rezaee Jordehi,et al.  Parameter selection in particle swarm optimisation: a survey , 2013, J. Exp. Theor. Artif. Intell..

[2]  Hitoshi Iba,et al.  A double swarm methodology for parameter estimation in oscillating Gene Regulatory Networks , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[3]  Oscar Castillo,et al.  Fuzzy Logic Augmentation of Nature-Inspired Optimization Metaheuristics - Theory and Applications , 2015, Fuzzy Logic Augmentation of Nature-Inspired Optimization Metaheuristics.

[4]  Marco S. Nobile,et al.  GPU-powered and settings-free parameter estimation of biochemical systems , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[5]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[6]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[7]  Anne Auger,et al.  Impacts of invariance in search: When CMA-ES and PSO face ill-conditioned and non-separable problems , 2011, Appl. Soft Comput..

[8]  R. Eberhart,et al.  Fuzzy adaptive particle swarm optimization , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[9]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[10]  Travis E. Oliphant,et al.  Python for Scientific Computing , 2007, Computing in Science & Engineering.

[11]  Dong-ping Tian,et al.  Fuzzy Particle Swarm Optimization Algorithm , 2009, 2009 International Joint Conference on Artificial Intelligence.

[12]  Gregor Papa,et al.  Parameter-less algorithm for evolutionary-based optimization , 2013, Comput. Optim. Appl..

[13]  Giancarlo Mauri,et al.  Proactive Particles in Swarm Optimization: A self-tuning algorithm based on Fuzzy Logic , 2015, 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[14]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization , 2014 .

[15]  Narasimhan Sundararajan,et al.  Self regulating particle swarm optimization algorithm , 2015, Inf. Sci..

[16]  Ming-Feng Yeh,et al.  Grey particle swarm optimization , 2012, Appl. Soft Comput..

[17]  Giancarlo Mauri,et al.  Multimodal medical image registration using Particle Swarm Optimization: A review , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[18]  Marco S. Nobile,et al.  The impact of particles initialization in PSO: Parameter estimation as a case in point , 2015, 2015 IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB).

[19]  Reza Safabakhsh,et al.  A novel stability-based adaptive inertia weight for particle swarm optimization , 2016, Appl. Soft Comput..

[20]  Y. Rahmat-Samii,et al.  Boundary Conditions in Particle Swarm Optimization Revisited , 2007, IEEE Transactions on Antennas and Propagation.