A Survey of the State of the Art in Particle Swarm Optimization

Meta-heuristic optimization algorithms have become popular choice for solving complex and intricate problems which are otherwise difficult to solve by traditional methods. In the present study an attempt is made to review the one main algorithm is a well known meta-heuristic; Particle Swarm Optimization (PSO). PSO, in its present form, has been in existence for roughly a decade, a relatively short time compared with some of the other natural computing paradigms such as artificial neural networks and evolutionary computation. However, in that short period, PSO has gained widespread appeal amongst researchers and has been shown to offer good performance in a variety of application domains, with potential for hybridization and specialization, and demonstration of some interesting emergent behavior. This study comprises a snapshot of particle swarm optimization from the authors' perspective, including variations in the algorithm, modifications and refinements introduced to prevent swarm stagnation and hybridization of PSO with other heuristic algorithms.

[1]  Azah Mohamed,et al.  Optimization and coordination of damping controls for optimal oscillations damping in multi-machine power system , 2011 .

[2]  Zhihua Cui,et al.  Particle swarm optimization with FUSS and RWS for high dimensional functions , 2008, Appl. Math. Comput..

[3]  Kwok-Wo Wong,et al.  An improved particle swarm optimization algorithm combined with piecewise linear chaotic map , 2007, Appl. Math. Comput..

[4]  F. Grimaccia,et al.  Genetical Swarm Optimization: Self-Adaptive Hybrid Evolutionary Algorithm for Electromagnetics , 2007, IEEE Transactions on Antennas and Propagation.

[5]  R. Adapa,et al.  A review of selected optimal power flow literature to 1993. II. Newton, linear programming and interior point methods , 1999 .

[6]  Erwie Zahara,et al.  A hybridized approach to data clustering , 2008, Expert Syst. Appl..

[7]  Azah Mohamed,et al.  Improved Particle Swarm Optimization with Disturbance Term for Multi-machine Power System Stabilizer Design , 2010 .

[8]  Shu-Kai S. Fan,et al.  A hybrid simplex search and particle swarm optimization for unconstrained optimization , 2007, Eur. J. Oper. Res..

[9]  Erwie Zahara,et al.  A hybrid genetic algorithm and particle swarm optimization for multimodal functions , 2008, Appl. Soft Comput..

[10]  Bo Liu,et al.  Improved particle swarm optimization combined with chaos , 2005 .

[11]  Ettore Francesco Bompard,et al.  A self-adaptive chaotic particle swarm algorithm for short term hydroelectric system scheduling in deregulated environment , 2005 .

[12]  Hitoshi Iba,et al.  Particle swarm optimization with Gaussian mutation , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[13]  Ali Haydar Kayhan,et al.  PSOLVER: A new hybrid particle swarm optimization algorithm for solving continuous optimization problems , 2010, Expert Syst. Appl..

[14]  A. Ebenezer Jeyakumar,et al.  Hybrid PSO–SQP for economic dispatch with valve-point effect , 2004 .

[15]  A. El-Shafie,et al.  Reliability analysis of earth slopes using hybrid chaotic particle swarm optimization , 2011 .

[16]  Andries Petrus Engelbrecht,et al.  Bare bones differential evolution , 2009, Eur. J. Oper. Res..

[17]  R. J. Kuo,et al.  Application of a hybrid of genetic algorithm and particle swarm optimization algorithm for order clustering , 2010, Decis. Support Syst..

[18]  Qingqiang Guo,et al.  A two-stage particle swarm optimizer , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[19]  Siamak Talatahari,et al.  A particle swarm ant colony optimization for truss structures with discrete variables , 2009 .

[20]  Zhihua Cui,et al.  A Guaranteed Global Convergence Particle Swarm Optimizer , 2004, Rough Sets and Current Trends in Computing.

[21]  Xiao-Feng Xie,et al.  Adaptive particle swarm optimization on individual level , 2002, 6th International Conference on Signal Processing, 2002..

[22]  Ajith Abraham,et al.  SEARCH OPTIMIZATION USING HYBRID PARTICLE SUB- SWARMS AND EVOLUTIONARY ALGORITHMS , 2005 .

[23]  Zhenya He,et al.  Swarm directions embedded in fast evolutionary programming , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[24]  Jonathan E. Fieldsend,et al.  A MOPSO Algorithm Based Exclusively on Pareto Dominance Concepts , 2005, EMO.

[25]  Ahmed El-Shafie,et al.  Modified particle swarm optimization for optimum design of spread footing and retaining wall , 2011 .

[26]  Xiaodong Li,et al.  Adaptively Choosing Neighbourhood Bests Using Species in a Particle Swarm Optimizer for Multimodal Function Optimization , 2004, GECCO.

[27]  Azah Mohamed,et al.  Particle Swarm Optimization for Simultaneous Tuning of Static Var Compensator and Power System Stabilizer , 2011 .

[28]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[29]  Erwie Zahara,et al.  Hybrid Nelder-Mead simplex search and particle swarm optimization for constrained engineering design problems , 2009, Expert Syst. Appl..

[30]  S. Khamsawang,et al.  Hybrid PSO-DE for solving the economic dispatch problem with generator constraints , 2010, 2010 The 2nd International Conference on Computer and Automation Engineering (ICCAE).

[31]  Ioannis G. Tsoulos,et al.  Enhancing PSO methods for global optimization , 2010, Appl. Math. Comput..

[32]  Tiew On Ting,et al.  Hybrid constrained genetic algorithm/particle swarm optimisation load flow algorithm , 2008 .

[33]  Yan Jiang,et al.  Improved particle swarm algorithm for hydrological parameter optimization , 2010, Appl. Math. Comput..

[34]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[35]  Hussain Shareef,et al.  Optimal location of PSS using improved PSO with chaotic sequence , 2011, International Conference on Electrical, Control and Computer Engineering 2011 (InECCE).

[36]  N. P. Padhy,et al.  Application of particle swarm optimization technique and its variants to generation expansion planning problem , 2004 .

[37]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[38]  Dantong Ouyang,et al.  A novel hybrid differential evolution and particle swarm optimization algorithm for unconstrained optimization , 2009, Oper. Res. Lett..

[39]  Thiemo Krink,et al.  Improving Particle Swarm Optimization by hybridization of stochastic search heuristics and Self-Organized Criticality , 2002 .

[40]  Carmelo J. A. Bastos Filho,et al.  Clan Particle Swarm Optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[41]  Marcus Randall,et al.  A survey of ant colony and particle swarm meta-heuristics and their application to discrete optimisation problems , 2001 .

[42]  Amit Konar,et al.  Particle Swarm Optimization and Differential Evolution Algorithms: Technical Analysis, Applications and Hybridization Perspectives , 2008, Advances of Computational Intelligence in Industrial Systems.

[43]  Oscar Castillo,et al.  An improved evolutionary method with fuzzy logic for combining Particle Swarm Optimization and Genetic Algorithms , 2011, Appl. Soft Comput..

[44]  Francesco Grimaccia,et al.  Genetical Swarm Optimization: an Evolutionary Algorithm for Antenna Design , 2006 .

[45]  Christian Posthoff,et al.  Randomized directed neighborhoods with edge migration in particle swarm optimization , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[46]  Hussain Shareef,et al.  Coordinated design of PSS and SVC damping controller using CPSO , 2011, 2011 5th International Power Engineering and Optimization Conference.

[47]  M. Clerc,et al.  The swarm and the queen: towards a deterministic and adaptive particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[48]  Shu-Kai S. Fan,et al.  Hybrid simplex search and particle swarm optimization for the global optimization of multimodal functions , 2004 .

[49]  Siamak Talatahari,et al.  Particle swarm optimizer, ant colony strategy and harmony search scheme hybridized for optimization of truss structures , 2009 .

[50]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[51]  Shengli Song,et al.  Hybrid particle swarm cooperative optimization algorithm and its application to MBC in alumina production , 2008 .

[52]  Francesco Grimaccia,et al.  Development and validation of different hybridization strategies between GA and PSO , 2007, 2007 IEEE Congress on Evolutionary Computation.

[53]  Yu Liu,et al.  Center particle swarm optimization , 2007, Neurocomputing.

[54]  Bijaya K. Panigrahi,et al.  Dynamic economic load dispatch using hybrid swarm intelligence based harmony search algorithm , 2011, Expert Syst. Appl..

[55]  K. Premalatha,et al.  Discrete PSO with GA Operators for Document Clustering , 2009 .

[56]  Li-Yeh Chuang,et al.  Chaotic catfish particle swarm optimization for solving global numerical optimization problems , 2011, Appl. Math. Comput..

[57]  Frans van den Bergh,et al.  An analysis of particle swarm optimizers , 2002 .

[58]  Alex A. Freitas,et al.  A hybrid PSO/ACO algorithm for discovering classification rules in data mining , 2008 .

[59]  Xingsheng Gu,et al.  A dynamic inertia weight particle swarm optimization algorithm , 2008 .

[60]  Yanchun Liang,et al.  An Effective PSO and AIS-Based Hybrid Intelligent Algorithm for Job-Shop Scheduling , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[61]  Azah Mohamed,et al.  Optimal Tuning of Power System Stabilizers Using Modified Particle Swarm Optimization , 2010 .

[62]  Xiaoming Zhang,et al.  Particle Swarm Optimization with Opposite Particles , 2005, MICAI.

[63]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[64]  Ahmed El-Shafie,et al.  Locating the general failure surface of earth slope using particle swarm optimisation , 2012 .

[65]  R. Eberhart,et al.  Fuzzy adaptive particle swarm optimization , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[66]  Hussain Shareef,et al.  A hybrid PSO technique for damping electro-mechanical oscillations in large power system , 2010, 2010 IEEE Student Conference on Research and Development (SCOReD).

[67]  M. Dorigo,et al.  1 Positive Feedback as a Search Strategy , 1991 .

[68]  Ajith Abraham,et al.  A fuzzy adaptive turbulent particle swarm optimisation , 2007 .

[69]  Patrick Siarry,et al.  Particle swarm and ant colony algorithms hybridized for improved continuous optimization , 2007, Appl. Math. Comput..

[70]  一将 白髪,et al.  捕食者被食者の関係を導入したHeterogeneous Particle Swarm Optimization , 2012 .

[71]  Tim Hendtlass,et al.  A Combined Swarm Differential Evolution Algorithm for Optimization Problems , 2001, IEA/AIE.

[72]  P. J. Angeline,et al.  Using selection to improve particle swarm optimization , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[73]  Mohammad Khajehzadeh,et al.  Economic design of retaining wall using particle swarm optimization with passive congregation , 2010 .

[74]  Joseph G. Ecker,et al.  Introduction to Operations Research , 1988, The Mathematical Gazette.

[75]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[76]  Chongzhao Han,et al.  Knowledge-based cooperative particle swarm optimization , 2008, Appl. Math. Comput..

[77]  M. Batouche,et al.  Hybrid particle swarm with differential evolution for multimodal image registration , 2004, 2004 IEEE International Conference on Industrial Technology, 2004. IEEE ICIT '04..

[78]  Ville Tirronen,et al.  Super-fit control adaptation in memetic differential evolution frameworks , 2009, Soft Comput..

[79]  Li-Yeh Chuang,et al.  Catfish particle swarm optimization , 2008, 2008 IEEE Swarm Intelligence Symposium.

[80]  L. Coelho,et al.  A novel chaotic particle swarm optimization approach using Hénon map and implicit filtering local search for economic load dispatch , 2009 .

[81]  Russell C. Eberhart,et al.  Adaptive particle swarm optimization: detection and response to dynamic systems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[82]  Wenjun Zhang,et al.  Dissipative particle swarm optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[83]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[84]  Keith Dickinson,et al.  Introduction to Operations , 2012 .

[85]  D. Y. Sha,et al.  A hybrid particle swarm optimization for job shop scheduling problem , 2006, Comput. Ind. Eng..

[86]  S. Puthusserypady,et al.  A Novel Hybrid Algorithm for Function Optimization: Particle Swarm Assisted Incremental Evolution Strategy , 2007 .

[87]  Pascal Bouvry,et al.  Particle swarm optimization: Hybridization perspectives and experimental illustrations , 2011, Appl. Math. Comput..

[88]  Chu Kiong Loo,et al.  Hybrid particle swarm optimization algorithm with fine tuning operators , 2009, Int. J. Bio Inspired Comput..

[89]  Wenbo Xu,et al.  An improved quantum-behaved particle swarm optimization algorithm with weighted mean best position , 2008, Appl. Math. Comput..

[90]  Ling Wang,et al.  A hybrid particle swarm optimization with a feasibility-based rule for constrained optimization , 2007, Appl. Math. Comput..

[91]  Wang Ling.  Survey on Chaotic Optimization Methods , 2001 .

[92]  Jiang Chuanwen,et al.  A hybrid method of chaotic particle swarm optimization and linear interior for reactive power optimisation , 2005, Math. Comput. Simul..

[93]  Nikhil Padhye.  Topology optimization of compliant mechanism using multi-objective particle swarm optimization , 2008, GECCO '08.

[94]  Xia Li,et al.  A novel particle swarm optimizer hybridized with extremal optimization , 2010, Appl. Soft Comput..

[95]  A. Stacey,et al.  Particle swarm optimization with mutation , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[96]  C. MacNish,et al.  Adaptive particle swarm optimisation for high-dimensional highly convex search spaces , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[97]  Peter J. Angeline,et al.  Evolutionary Optimization Versus Particle Swarm Optimization: Philosophy and Performance Differences , 1998, Evolutionary Programming.

[98]  Ajith Abraham,et al.  Particle Swarm Optimization Using Adaptive Mutation , 2008, 2008 19th International Workshop on Database and Expert Systems Applications.

[99]  Azah Mohamed,et al.  Power system stabilizer design using hybrid multi-objective particle swarm optimization with chaos , 2011 .

[100]  Frans van den Bergh,et al.  A NICHING PARTICLE SWARM OPTIMIZER , 2002 .

[101]  Rehab F. Abdel-Kader.  Genetically Improved PSO Algorithm for Efficient Data Clustering , 2010, 2010 Second International Conference on Machine Learning and Computing.

[102]  Ahmed El-Shafie,et al.  Modified particle swarm optimization for probabilistic slope stability analysis , 2010 .

[103]  Y. Rahmat-Samii,et al.  Particle swarm, genetic algorithm, and their hybrids: optimization of a profiled corrugated horn antenna , 2002, IEEE Antennas and Propagation Society International Symposium (IEEE Cat. No.02CH37313).

[104]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[105]  Shigeru Obayashi,et al.  Development and investigation of efficient GA/PSO-hybrid algorithm applicable to real-world design optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[106]  Chia-Feng Juang,et al.  A hybrid of genetic algorithm and particle swarm optimization for recurrent network design , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[107]  Xiao-Feng Xie,et al.  DEPSO: hybrid particle swarm with differential evolution operator , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[108]  Jiangye Yuan,et al.  A modified particle swarm optimizer with dynamic adaptation , 2007, Appl. Math. Comput..

[109]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[110]  Seyed Hossein Hosseinian,et al.  Generation and reserve dispatch in a competitive market using constrained particle swarm optimization , 2010 .

[111]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[112]  Yong Wang,et al.  Hybridizing particle swarm optimization with differential evolution for constrained numerical and engineering optimization , 2010, Appl. Soft Comput..

[113]  A. Engelbrecht,et al.  A new locally convergent particle swarm optimiser , 2002, IEEE International Conference on Systems, Man and Cybernetics.

[114]  Qingyuan He,et al.  An Improved Particle Swarm Optimization Algorithm with Disturbance Term , 2006, ICIC.

[115]  P. Pirinoli,et al.  A new hybrid genetical-swarm algorithm for electromagnetic optimization , 2004, Proceedings. ICCEA 2004. 2004 3rd International Conference on Computational Electromagnetics and Its Applications, 2004..

[116]  Yi Pan,et al.  An efficient flow-shop scheduling algorithm based on a hybrid particle swarm optimization model , 2009, Expert Syst. Appl..

[117]  Wei Kong,et al.  Hybrid particle swarm optimization and tabu search approach for selecting genes for tumor classification using gene expression data , 2008, Comput. Biol. Chem..

[118]  Ye Tian,et al.  An Improved Particle Swarm Algorithms for Global Optimization , 2010, 2010 International Conference on Machine Vision and Human-machine Interface.

[119]  Christian Posthoff,et al.  Neighborhood Re-structuring in Particle Swarm Optimization , 2005, Australian Conference on Artificial Intelligence.

[120]  A. Shunmugalatha,et al.  Optimum cost of generation for maximum loadability limit of power system using hybrid particle swarm optimization , 2008 .

[121]  Azah Mohamed,et al.  Tuning of power system stabilizers using particle swarm optimization with passive congregation , 2010 .

[122]  Yunlong Zhu,et al.  Global optimization based on hierarchical coevolution model , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[123]  Taher Niknam,et al.  A New Evolutionary Algorithm for Cluster Analysis , 2008 .

[124]  R. Adapa,et al.  A review of selected optimal power flow literature to 1993. I. Nonlinear and quadratic programming approaches , 1999 .

[125]  J R Saunders,et al.  A particle swarm optimizer with passive congregation. , 2004, Bio Systems.