Turbulent Particle Swarm Optimization Using Fuzzy Parameter Tuning

Particle Swarm Optimization (PSO) algorithm is a stochastic search technique, which has exhibited good performance across a wide range of applications. However, very often for multi-modal problems involving high dimensions the algorithm tends to suffer from premature convergence. Premature convergence could make the PSO algorithm very difficult to arrive at the global optimum or even a local optimum. Analysis of the behavior of the particle swarm model reveals that such premature convergence is mainly due to the decrease of velocity of particles in the search space that leads to a total implosion and ultimately fitness stagnation of the swarm. This paper introduces Turbulence in the Particle Swarm Optimization (TPSO) algorithm to overcome the problem of stagnation. The algorithm uses a minimum velocity threshold to control the velocity of particles. TPSO mechanism is similar to a turbulence pump, which supplies some power to the swarm system to explore new neighborhoods for better solutions. The algorithm also avoids clustering of particles and at the same time attempts to maintain diversity of population. We attempt to theoretically analyze that the algorithm converges with a probability of 1 towards the global optimal. The parameter, the minimum velocity threshold of the particles is tuned adaptively by a fuzzy logic controller embedded in the TPSO algorithm, which is further called as Fuzzy Adaptive TPSO (FATPSO). We evaluated the performance of FATPSO and compared it with the Standard PSO (SPSO), Genetic Algorithm (GA) and Simulated Annealing (SA). The comparison was performed on a suite of 20 widely used benchmark problems. Empirical results illustrate that the FATPSO could prevent premature convergence very effectively. It clearly outperforms the considered methods, especially for high dimension multi-modal optimization problems.

[1]  Frans van den Bergh,et al.  An analysis of particle swarm optimizers , 2002 .

[2]  J. Kennedy,et al.  Matching algorithms to problems: an experimental test of the particle swarm and some genetic algorithms on the multimodal problem generator , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[3]  S. M. Lo,et al.  Application of evolutionary neural network method in predicting pollutant levels in downtown area of Hong Kong , 2003, Neurocomputing.

[4]  W. Feller,et al.  An Introduction to Probability Theory and Its Application. , 1951 .

[5]  Michael N. Vrahatis,et al.  On the computation of all global minimizers through particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[6]  Jiang Chuanwen,et al.  A hybrid method of chaotic particle swarm optimization and linear interior for reactive power optimisation , 2005, Math. Comput. Simul..

[7]  Yong Deng,et al.  Infrared image segmentation with 2-D maximum entropy method based on particle swarm optimization (PSO) , 2005, Pattern Recognit. Lett..

[8]  Francisco Herrera,et al.  Fuzzy adaptive genetic algorithms: design, taxonomy, and future directions , 2003, Soft Comput..

[9]  Zbigniew Michalewicz,et al.  Parameter Control in Evolutionary Algorithms , 2007, Parameter Setting in Evolutionary Algorithms.

[10]  Russell C. Eberhart,et al.  Implementation of evolutionary fuzzy systems , 1999, IEEE Trans. Fuzzy Syst..

[11]  Sheldon Howard Jacobson,et al.  Analysis of Static Simulated Annealing Algorithms , 2002 .

[12]  Derek A. Linkens,et al.  Adaptive Weighted Particle Swarm Optimisation for Multi-objective Optimal Design of Alloy Steels , 2004, PPSN.

[13]  D.H. Werner,et al.  Particle swarm optimization versus genetic algorithms for phased array synthesis , 2004, IEEE Transactions on Antennas and Propagation.

[14]  Mark Last,et al.  A fuzzy-based lifetime extension of genetic algorithms , 2005, Fuzzy Sets Syst..

[15]  Michael N. Vrahatis,et al.  Recent approaches to global optimization problems through Particle Swarm Optimization , 2002, Natural Computing.

[16]  R. Eberhart,et al.  Fuzzy adaptive particle swarm optimization , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[17]  Mitsuo Gen,et al.  Performance Analysis of Adaptive Genetic Algorithms with Fuzzy Logic and Heuristics , 2003, Fuzzy Optim. Decis. Mak..

[18]  Margaret Lech,et al.  Registration of 3D Range Images Using Particle Swarm Optimization , 2004, ASIAN.

[19]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[20]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[21]  Erick Cantú-Paz,et al.  Efficient and Accurate Parallel Genetic Algorithms , 2000, Genetic Algorithms and Evolutionary Computation.

[22]  Patrick Siarry,et al.  A theoretical study on the behavior of simulated annealing leading to a new cooling schedule , 2005, Eur. J. Oper. Res..

[23]  Russell C. Eberhart,et al.  Comparison between Genetic Algorithms and Particle Swarm Optimization , 1998, Evolutionary Programming.

[24]  Guangda Su,et al.  Eyeglasses removal from facial images , 2005, Pattern Recognit. Lett..

[25]  Chu Kiong Loo,et al.  Solving Unit Commitment Problem Using Hybrid Particle Swarm Optimization , 2003, J. Heuristics.

[26]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[27]  Albert A. Groenwold,et al.  A Study of Global Optimization Using Particle Swarms , 2005, J. Glob. Optim..

[28]  Tiago Ferra de Sousa,et al.  Particle Swarm based Data Mining Algorithms for classification tasks , 2004, Parallel Comput..

[29]  Ran He,et al.  An Improved Particle Swarm Optimization Based on Self-Adaptive Escape Velocity , 2005 .

[30]  Francisco Herrera,et al.  Applicability of the fuzzy operators in the design of fuzzy logic controllers , 1997, Fuzzy Sets Syst..

[31]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.