CriPS: Critical Particle Swarm Optimisation

Particle Swarm Optimisation (PSO) makes use of a dynamical system for solving a search task. Instead of adding search biases in order to improve performance in certain problems, we aim to remove algorithm-induced scales by controlling the swarm with a mechanism that is scale-free except possibly for a suppression of scales beyond the system size. In this way a very promising performance is achieved due to the balance of large-scale exploration and local search. The resulting algorithm shows evidence for self-organised criticality, brought about via the intrinsic dynamics of the swarm as it interacts with the objective function, rather than being explicitly specified. The Critical Particle Swarm (CriPS) can be easily combined with many existing extensions such as chaotic exploration, additional force terms or non-trivial topologies.

[1]  James Kennedy,et al.  The Behavior of Particles , 1998, Evolutionary Programming.

[2]  Jie Zhang,et al.  A mixed-discrete Particle Swarm Optimization algorithm with explicit diversity-preservation , 2013 .

[3]  J. M. Herrmann,et al.  Finite-size effects of avalanche dynamics. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[4]  James Kennedy,et al.  Defining a Standard for Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.

[5]  Woodrow L. Shew,et al.  Information Capacity and Transmission Are Maximized in Balanced Cortical Networks with Neuronal Avalanches , 2010, The Journal of Neuroscience.

[6]  Christensen,et al.  Self-organized criticality in a continuous, nonconservative cellular automaton modeling earthquakes. , 1992, Physical review letters.

[7]  T. Krink,et al.  Extending particle swarm optimisers with self-organized criticality , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[8]  Bak,et al.  Punctuated equilibrium and criticality in a simple model of evolution. , 1993, Physical review letters.

[9]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[10]  Carlos Garcia Cordero.  Parameter Adaptation and Criticality in Particle Swarm Optimization , 2017, ArXiv.

[11]  J. M. Herrmann,et al.  Dynamical synapses causing self-organized criticality in neural networks , 2007, 0712.1003.

[12]  Yu Wang,et al.  Self-adaptive learning based particle swarm optimization , 2011, Inf. Sci..

[13]  Jun Zhang,et al.  Adaptive Particle Swarm Optimization , 2008, ANTS Conference.

[14]  Jun Zhang,et al.  Adaptive Particle Swarm Optimization , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[16]  Ilya Loshchilov,et al.  CMA-ES with restarts for solving CEC 2013 benchmark problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[17]  Jacques Riget,et al.  A Diversity-Guided Particle Swarm Optimizer - the ARPSO , 2002 .

[18]  Alberto García-Villoria,et al.  Introducing dynamic diversity into a discrete particle swarm optimization , 2009, Comput. Oper. Res..

[19]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[20]  Agostinho C. Rosa,et al.  Controlling the Parameters of the Particle Swarm Optimization with a Self-Organized Criticality Model , 2012, PPSN.

[21]  Tang,et al.  Self-organized criticality. , 1988, Physical review. A, General physics.

[22]  Ajith Abraham,et al.  Inertia Weight strategies in Particle Swarm Optimization , 2011, 2011 Third World Congress on Nature and Biologically Inspired Computing.

[23]  Henrik Jeldtoft Jensen,et al.  Self-Organized Criticality: Emergent Complex Behavior in Physical and Biological Systems , 1998 .

[24]  Tim M. Blackwell,et al.  The Lévy Particle Swarm , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[25]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[26]  Xin-She Yang,et al.  Cuckoo Search via Lévy flights , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[27]  John M. Beggs,et al.  Neuronal Avalanches in Neocortical Circuits , 2003, The Journal of Neuroscience.

[28]  M. Clerc,et al.  Particle Swarm Optimization , 2006 .

[29]  Per Bak,et al.  How Nature Works , 1996 .

[30]  Hiroki Sayama,et al.  Swarm Chemistry , 2009, Artificial Life.