An adaptive parameter tuning of particle swarm optimization algorithm

An adaptive parameter tuning of particle swarm optimization based on velocity information (APSO-VI) algorithm is proposed. In this paper the velocity convergence of particles is first analyzed and the relationship between the velocity of particle and the search failures is pointed out, which reveals the reasons why PSO has relative poor global searching ability. Then this algorithm introduces the velocity information which is defined as the average absolute value of velocity of all the particles. A new strategy is presented that the inertia weight is dynamically adjusted according to average absolute value of velocity which follows a given nonlinear ideal velocity by feedback control, which can avoid the velocity closed to zero at the early stage. Under the guide of the nonlinear ideal velocity, APSO-VI can maintain appropriate swarm diversity and alleviate the premature convergence validly. Numerical experiments are conducted to compare the proposed algorithm with different variants of PSO on some benchmark functions. Experimental results show that the proposed algorithm remarkably improves the ability of PSO to jump out of the local optima and significantly enhance the convergence speed and precision.

[1]  Hung-Chih Chiu,et al.  Adaptive fuzzy particle swarm optimization for global optimization of multimodal functions , 2011, Inf. Sci..

[2]  Feng Qian,et al.  Automatically extracting T-S fuzzy models using cooperative random learning particle swarm optimization , 2010, Appl. Soft Comput..

[3]  Zelda B. Zabinsky,et al.  A Numerical Evaluation of Several Stochastic Algorithms on Selected Continuous Global Optimization Test Problems , 2005, J. Glob. Optim..

[4]  Amitava Chatterjee,et al.  Nonlinear inertia weight variation for dynamic adaptation in particle swarm optimization , 2006, Comput. Oper. Res..

[5]  Jiangye Yuan,et al.  A modified particle swarm optimizer with dynamic adaptation , 2007, Appl. Math. Comput..

[6]  Michael R. Lyu,et al.  A hybrid particle swarm optimization-back-propagation algorithm for feedforward neural network training , 2007, Appl. Math. Comput..

[7]  Keiichiro Yasuda,et al.  Dynamic parameter tuning of particle swarm optimization , 2006 .

[8]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[9]  Wei-Chiang Hong,et al.  Chaotic particle swarm optimization algorithm in a support vector regression electric load forecasting model , 2009 .

[10]  P. J. Angeline,et al.  Using selection to improve particle swarm optimization , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[11]  Bijaya Ketan Panigrahi,et al.  Adaptive particle swarm optimization approach for static and dynamic economic load dispatch , 2008 .

[12]  Hao Gao,et al.  Particle swarm algorithm with hybrid mutation strategy , 2011, Appl. Soft Comput..

[13]  Xingsheng Gu,et al.  A dynamic inertia weight particle swarm optimization algorithm , 2008 .

[14]  Andries P. Engelbrecht,et al.  Effects of swarm size on Cooperative Particle Swarm Optimisers , 2001 .

[15]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.

[16]  Yang Tang,et al.  Feedback learning particle swarm optimization , 2011, Appl. Soft Comput..

[17]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[18]  James Kennedy,et al.  Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[19]  M. A. El-Shorbagy,et al.  Integrating particle swarm optimization with genetic algorithms for solving nonlinear optimization problems , 2011, J. Comput. Appl. Math..

[20]  安田 恵一郎,et al.  適応型 Particle Swarm Optimization , 2005 .

[21]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[22]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[23]  Shiyuan Yang,et al.  Stochastic convergence analysis and parameter selection of the standard particle swarm optimization algorithm , 2007, Inf. Process. Lett..

[24]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[25]  Sanghamitra Bandyopadhyay,et al.  Multi-Objective Particle Swarm Optimization with time variant inertia and acceleration coefficients , 2007, Inf. Sci..

[26]  Zhou Wei,et al.  A novel particle swarm optimization algorithm based on particle migration , 2012 .

[27]  M. El-Sherbiny.  Particle swarm inspired optimization algorithm without velocity equation , 2011 .

[28]  Shu-Kai S. Fan,et al.  A decreasing inertia weight particle swarm optimizer , 2007 .

[29]  M. Senthil Arumugam,et al.  On the improved performances of the particle swarm optimization algorithms with adaptive parameters, cross-over operators and root mean square (RMS) variants for computing optimal control of a class of hybrid systems , 2008, Appl. Soft Comput..

[30]  Zhao Xinchao.  A perturbed particle swarm algorithm for numerical optimization , 2010 .

[31]  I. Erlich,et al.  A Stochastic Model for the Optimal Operation of a Wind-Thermal Power System , 2009, IEEE Transactions on Power Systems.

[32]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[33]  Xia Li,et al.  A novel particle swarm optimizer hybridized with extremal optimization , 2010, Appl. Soft Comput..