Self regulating particle swarm optimization algorithm

In this paper, we propose a new particle swarm optimization algorithm incorporating the best human learning strategies for finding the optimum solution, referred to as a Self Regulating Particle Swarm Optimization (SRPSO) algorithm. Studies in human cognitive psychology have indicated that the best planners regulate their strategies with respect to the current state and their perception of the best experiences from others. Using these ideas, we propose two learning strategies for the PSO algorithm. The first one uses a self-regulating inertia weight and the second uses the self-perception on the global search direction. The self-regulating inertia weight is employed by the best particle for better exploration and the self-perception of the global search direction is employed by the rest of the particles for intelligent exploitation of the solution space. SRPSO algorithm has been evaluated using the 25 benchmark functions from CEC2005 and a real-world problem for a radar system design. The results have been compared with six state-of-the-art PSO variants like Bare Bones PSO (BBPSO), Comprehensive Learning PSO (CLPSO), etc. The two proposed learning strategies help SRPSO to achieve faster convergence and provide better solutions in most of the problems. Further, a statistical analysis on performance evaluation of the different algorithms on CEC2005 problems indicates that SRPSO is better than other algorithms with a 95% confidence level.

[1]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[2]  P. B. Sujit,et al.  Particle swarm optimization approach for multi-objective composite box-beam design , 2007 .

[3]  Ahmad Bagheri,et al.  HEPSO: High exploration particle swarm optimization , 2014, Inf. Sci..

[4]  Jin Liu,et al.  A particle swarm optimization using local stochastic search and enhancing diversity for continuous optimization , 2014, Neurocomputing.

[5]  Rui Wang,et al.  Exponential inertia weight particle swarm algorithm for dynamics optimization of electromechanical coupling system , 2009, 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems.

[6]  Changhe Li,et al.  A Self-Learning Particle Swarm Optimizer for Global Optimization Problems , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  Narasimhan Sundararajan,et al.  A Sequential Learning Algorithm for Complex-Valued Self-Regulating Resource Allocation Network-CSRAN , 2011, IEEE Transactions on Neural Networks.

[8]  Gao Yue-lin,et al.  A New Particle Swarm Optimization Algorithm with Random Inertia Weight and Evolution Strategy , 2007, 2007 International Conference on Computational Intelligence and Security Workshops (CISW 2007).

[9]  Mohammad Reza Meybodi,et al.  novel multi-swarm algorithm for optimization in dynamic environments based n particle swarm optimization , 2013 .

[10]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[11]  E. Ozcan,et al.  Particle swarm optimization: surfing the waves , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[12]  Feng Zou,et al.  Teaching-learning-based optimization with dynamic group strategy for global optimization , 2014, Inf. Sci..

[13]  Azah Mohamed,et al.  A Survey of the State of the Art in Particle Swarm Optimization , 2012 .

[14]  Siti Mariyam Hj. Shamsuddin,et al.  CAPSO: Centripetal accelerated particle swarm optimization , 2014, Inf. Sci..

[15]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[16]  Swagatam Das,et al.  Behavioral analysis of the leader particle during stagnation in a particle swarm optimization algorithm , 2014, Inf. Sci..

[17]  Sundaram Suresh,et al.  Human cognition inspired particle swarm optimization algorithm , 2014, 2014 IEEE Ninth International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP).

[18]  Liang Gao,et al.  Cellular particle swarm optimization , 2011, Inf. Sci..

[19]  Nor Ashidi Mat Isa,et al.  An adaptive two-layer particle swarm optimization with elitist learning strategy , 2014, Inf. Sci..

[20]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[21]  Riccardo Poli,et al.  Analysis of the publications on the applications of particle swarm optimisation , 2008 .

[22]  Harun Uğuz,et al.  A novel particle swarm optimization algorithm with Levy flight , 2014, Appl. Soft Comput..

[23]  Michael Pressley,et al.  Self-regulated cognition: Interdependence of metacognition, attributions, and self-esteem. , 1990 .

[24]  Jeng-Shyang Pan,et al.  A new fitness estimation strategy for particle swarm optimization , 2013, Inf. Sci..

[25]  Zengqiang Chen,et al.  New Chaotic PSO-Based Neural Network Predictive Control for Nonlinear Process , 2007, IEEE Transactions on Neural Networks.

[26]  张哉根,et al.  Leu-M , 1991 .

[27]  Xu Chen,et al.  A Novel Particle Swarm Optimization Based on the Self-Adaptation Strategy of Acceleration Coefficients , 2009, 2009 International Conference on Computational Intelligence and Security.

[28]  Pascal Bouvry,et al.  Particle swarm optimization: Hybridization perspectives and experimental illustrations , 2011, Appl. Math. Comput..

[29]  Michael N. Vrahatis,et al.  On the computation of all global minimizers through particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[30]  Thomas Kiel Rasmussen,et al.  Hybrid Particle Swarm Optimiser with breeding and subpopulations , 2001 .

[31]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[32]  Nor Ashidi Mat Isa,et al.  Bidirectional teaching and peer-learning particle swarm optimization , 2014, Inf. Sci..

[33]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[34]  Michael G. Epitropakis,et al.  Evolving cognitive and social experience in Particle Swarm Optimization through Differential Evolution: A hybrid approach , 2012, Inf. Sci..

[35]  S.N. Singh,et al.  Fuzzy Adaptive Particle Swarm Optimization for Bidding Strategy in Uniform Price Spot Market , 2007, IEEE Transactions on Power Systems.

[36]  Martin Middendorf,et al.  A hierarchical particle swarm optimizer and its adaptive variant , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[37]  Vijander Singh,et al.  Particle Swarm Optimization Using Gaussian Inertia Weight , 2007 .

[38]  Andries P. Engelbrecht,et al.  Computational Intelligence: An Introduction , 2002 .

[39]  James Kennedy,et al.  Bare bones particle swarms , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[40]  Jun Zhang,et al.  Orthogonal Learning Particle Swarm Optimization , 2011, IEEE Trans. Evol. Comput..

[41]  Ali Husseinzadeh Kashan,et al.  A particle swarm optimizer for grouping problems , 2013, Inf. Sci..

[42]  Chuanhua Zeng A Particle Swarm Optimization Algorithm with Rich Social Cognition , 2009, 2009 Fifth International Conference on Natural Computation.

[43]  Sancho Salcedo-Sanz,et al.  A hybrid evolutionary programming algorithm for spread spectrum radar polyphase codes design , 2007, GECCO '07.

[44]  Zeng Ping,et al.  A novel particle swarm optimization algorithm , 2010, 2010 IEEE International Conference on Software Engineering and Service Sciences.

[45]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[46]  Ying Lin,et al.  Particle Swarm Optimization With an Aging Leader and Challengers , 2013, IEEE Transactions on Evolutionary Computation.

[47]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[48]  James Kennedy,et al.  Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[49]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[50]  S.I. Shaheen,et al.  PSOSA: An Optimized Particle Swarm Technique for Solving the Urban Planning Problem , 2006, 2006 International Conference on Computer Engineering and Systems.

[51]  Kalyan Veeramachaneni,et al.  Fitness-distance-ratio based particle swarm optimization , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[52]  Bo Yang,et al.  Improving particle swarm optimization using multi-layer searching strategy , 2014, Inf. Sci..

[53]  Konstantinos E. Parsopoulos,et al.  UPSO: A Unified Particle Swarm Optimization Scheme , 2019, International Conference of Computational Methods in Sciences and Engineering 2004 (ICCMSE 2004).

[54]  Chukwudi Anyakoha,et al.  A review of particle swarm optimization. Part II: hybridisation, combinatorial, multicriteria and constrained optimization, and indicative applications , 2008, Natural Computing.

[55]  Xiao-Feng Xie,et al.  DEPSO: hybrid particle swarm with differential evolution operator , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[56]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[57]  Paolo Rosso,et al.  An efficient Particle Swarm Optimization approach to cluster short texts , 2014, Inf. Sci..

[58]  Wenbo Xu,et al.  A Diversity-Guided Quantum-Behaved Particle Swarm Optimization Algorithm , 2006, SEAL.

[59]  T. O. Nelson Metamemory: A Theoretical Framework and New Findings , 1990 .

[60]  H. J. Kim,et al.  A sequential learning algorithm for self-adaptive resource allocation network classifier , 2010, Neurocomputing.

[61]  Ponnuthurai N. Suganthan,et al.  A Distance-Based Locally Informed Particle Swarm Model for Multimodal Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[62]  Jun Zhang,et al.  Adaptive Particle Swarm Optimization , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[63]  B. Alatas,et al.  Chaos embedded particle swarm optimization algorithms , 2009 .

[64]  Xiang Yu,et al.  Enhanced comprehensive learning particle swarm optimization , 2014, Appl. Math. Comput..

[65]  Changhe Li,et al.  Particle swarm optimisation with simple and efficient neighbourhood search strategies , 2011 .

[66]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[67]  Hui Wang,et al.  Diversity enhanced particle swarm optimization with neighborhood search , 2013, Inf. Sci..

[68]  Xiaodong Li,et al.  This article has been accepted for inclusion in a future issue. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 Locating and Tracking Multiple Dynamic Optima by a Particle Swarm Model Using Speciation , 2022 .

[69]  Guangqing Bao,et al.  Particle swarm optimization algorithm with asymmetric time varying acceleration coefficients , 2009, 2009 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[70]  Miroslav L. Dukic,et al.  A Method of a Spread-Spectrum Radar Polyphase Code Design , 1990, IEEE J. Sel. Areas Commun..

[71]  Salman Mohagheghi,et al.  Particle Swarm Optimization: Basic Concepts, Variants and Applications in Power Systems , 2008, IEEE Transactions on Evolutionary Computation.

[72]  Chunjuan Ouyang,et al.  An Adaptive Fuzzy Weight PSO Algorithm , 2010, 2010 Fourth International Conference on Genetic and Evolutionary Computing.

[73]  Jeffery D. Weir,et al.  AHPS2: An optimizer using adaptive heterogeneous particle swarms , 2014, Inf. Sci..

[74]  Ziyang Liu,et al.  A multi-swarm cooperative multistage perturbation guiding particle swarm optimizer , 2014, Appl. Soft Comput..

[75]  Hitoshi Iba,et al.  Particle swarm optimization with Gaussian mutation , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[76]  Giovanni Iacca,et al.  Compact Particle Swarm Optimization , 2013, Inf. Sci..

[77]  Zhang Dingxue,et al.  A Modified Particle Swarm Optimization with an Adaptive Acceleration Coefficients , 2009, 2009 Asia-Pacific Conference on Information Processing.

[78]  Ming-Feng Yeh,et al.  Grey particle swarm optimization , 2012, Appl. Soft Comput..

[79]  Rafael Bello,et al.  Particle Swarm Optimization with Random Sampling in Variable Neighbourhoods for Solving Global Minimization Problems , 2012, ANTS.

[80]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[81]  Nor Ashidi Mat Isa,et al.  Teaching and peer-learning particle swarm optimization , 2014, Appl. Soft Comput..

[82]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[83]  Liyan Zhang,et al.  Empirical study of particle swarm optimizer with an increasing inertia weight , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..