Integrating Particle Swarm Optimization with Learning Automata to solve optimization problems in noisy environment

Particle Swarm Optimization (PSO) is a brilliant evolutionary algorithm adaptable to various kinds of optimization problems in distinct fields. However, when facing noisy environments, its performance suffers from unexpected noise. To address this issue, one of the widely-used mechanisms is the resampling method that is based on the fact that the true objective value can be achieved by re-evaluations. Such method allocates a fixed number of re-evaluations before running but cannot change allocations according to the current environment adaptively. It may result in the waste of re-evaluations allocated to unpromising candidate particles. This paper proposes a novel hybrid approach by integrating PSO with Learning Automata (LAs) in noisy environments. LAs are well-known for their self-adaption, automatic learning capability as well as low computational complexity. They are able to converge in different situations. The proposed hybrid approach achieves much faster convergence than the existing ones by performing fewer re-evaluations in simple environments than in complex one automatically. This mechanism enables it to find the best particle efficiently. With its self-adaption and automatic learning capability, it leads to a more accurate and faster algorithm. Besides, its distinct selection mechanism helps it achieve a significantly lower computational complexity than that of the-state-of-the-art resampling methods. Through experiments on 20 large-scale benchmark functions subject to different levels of noise, it is validated that, the proposed approach is able to achieve much better performance results in terms of accuracy and convergence rate than the existing ones.

[1]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[2]  Mark Johnston,et al.  Resampling in Particle Swarm Optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[3]  P. S. Sastry,et al.  Estimator Algorithms for Learning Automata , 1986 .

[4]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.

[5]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[6]  Chun-Hung Chen,et al.  Simulation Budget Allocation for Further Enhancing the Efficiency of Ordinal Optimization , 2000, Discret. Event Dyn. Syst..

[7]  Konstantinos E. Parsopoulos,et al.  PARTICLE SWARM OPTIMIZER IN NOISY AND CONTINUOUSLY CHANGING ENVIRONMENTS , 2001 .

[8]  Leyuan Shi,et al.  Some topics for simulation optimization , 2008, 2008 Winter Simulation Conference.

[9]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[10]  M. L. Tsetlin On the Behavior of Finite Automata in Random Media , 1961 .

[11]  Frans van den Bergh,et al.  An analysis of particle swarm optimizers , 2002 .

[12]  Jürgen Branke,et al.  Integrating Techniques from Statistical Ranking into Evolutionary Algorithms , 2006, EvoWorkshops.

[13]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[14]  MengChu Zhou,et al.  Swarm Intelligence Approaches to Optimal Power Flow Problem With Distributed Generator Failures in Power Networks , 2013, IEEE Transactions on Automation Science and Engineering.

[15]  MengChu Zhou,et al.  Last-Position Elimination-Based Learning Automata , 2014, IEEE Transactions on Cybernetics.

[16]  Michael N. Vrahatis,et al.  PARTICLE SWARM OPTIMIZATION FOR IMPRECISE PROBLEMS , 2002 .

[17]  MengChu Zhou,et al.  An adaptive particle swarm optimization method based on clustering , 2015, Soft Comput..

[18]  Loo Hay Lee,et al.  Stochastic Simulation Optimization - An Optimal Computing Budget Allocation , 2010, System Engineering and Operations Research.