Improving particle swarm optimization via adaptive switching asynchronous - synchronous update

Particle swarm optimization (PSO) is a population-based metaheuristic optimization algorithm that solves a problem through iterative operations. Traditional PSO iteration strategies can be categorized into two groups: synchronous (S-PSO) or asynchronous (A-PSO) update. In S-PSO, the performance of the entire swarm is evaluated before the particles’ velocities and positions are updated, whereas in A-PSO, each particle's velocity and position are updated immediately after an individual's performance is evaluated. Previous research claimed that S-PSO is better in exploitation and has fast convergence, whereas A-PSO converges at a slower rate and is stronger at exploration. Exploration and exploitation are important in ensuring good performance for any population-based metaheuristic. In this paper, an adaptive switching PSO (Switch-PSO) algorithm that uses a hybrid update sequence is proposed. The iteration strategy in Switch-PSO is adaptively switched between the two traditional iteration strategies according to the performance of the swarm's best member. The performance of Switch-PSO is compared with existing S-PSO, A-PSO and three state-of-the-art PSO algorithms using CEC2014's benchmark functions. The results show that Switch-PSO achieves superior performance in comparison to the other algorithms. Switch-PSO is then applied for infinite impulse response model identification, where Switch-PSO is found to rank the best among all the algorithms applied.

[1]  Yeung Sam Hung,et al.  A novel switching local evolutionary PSO for quantitative analysis of lateral flow immunoassay , 2014, Expert Syst. Appl..

[2]  Z. Ibrahim,et al.  A Novel Multi-state Particle Swarm Optimization for Discrete Combinatorial Optimization Problems , 2012, 2012 Fourth International Conference on Computational Intelligence, Modelling and Simulation.

[3]  Masoud Shariat Panahi,et al.  An improved PSO algorithm with a territorial diversity-preserving scheme and enhanced exploration-exploitation balance , 2013, Swarm Evol. Comput..

[4]  Zhijian Wu,et al.  A Hybrid Particle Swarm Optimization Algorithm Based on Space Transformation Search and a Modified Velocity Model , 2009, HPCA.

[5]  Wenyuan Liu,et al.  Improved Particle Swarm Optimization Algorithm Based on Social Psychology , 2009, 2009 International Conference on Artificial Intelligence and Computational Intelligence.

[6]  Byung-Il Koh,et al.  Parallel asynchronous particle swarm optimization , 2006, International journal for numerical methods in engineering.

[7]  Wenbo Xu,et al.  Solving Multi-period Financial Planning Problem Via Quantum-Behaved Particle Swarm Algorithm , 2006, ICIC.

[8]  George S. Dulikravich,et al.  Automatic Switching Algorithms in Hybrid Single-Objective Optimization , 2013 .

[9]  Mengjie Zhang,et al.  Particle Swarm Optimization for Coverage Maximization and Energy Conservation in Wireless Sensor Networks , 2010, EvoApplications.

[10]  Amer Draa,et al.  On the performances of the flower pollination algorithm - Qualitative and quantitative analyses , 2015, Appl. Soft Comput..

[11]  Halife Kodaz,et al.  Community detection from biological and social networks: A comparative analysis of metaheuristic algorithms , 2017, Appl. Soft Comput..

[12]  Chao Dong,et al.  Improved PSO Algorithm for Power Distribution Network Expanding Path Optimization , 2009, 2009 International Conference on Web Information Systems and Mining.

[13]  Konstantinos E. Parsopoulos,et al.  Particle swarm optimization with neighborhood-based budget allocation , 2016, Int. J. Mach. Learn. Cybern..

[14]  Salwani Abdullah,et al.  A Survey: Particle Swarm Optimization based Algorithms to solve premature convergence Problem , 2014, J. Comput. Sci..

[15]  Erik Valdemar Cuevas Jiménez,et al.  A Comparison of Evolutionary Computation Techniques for IIR Model Identification , 2014, J. Appl. Math..

[16]  Zidong Wang,et al.  A Hybrid EKF and Switching PSO Algorithm for Joint State and Parameter Estimation of Lateral Flow Immunoassay Models , 2012, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[17]  Winston Khoon Guan Seah,et al.  A performance study on synchronicity and neighborhood size in particle swarm optimization , 2013, Soft Comput..

[18]  Petr Máca,et al.  A Comparison of Selected Modifications of the Particle Swarm Optimization Algorithm , 2014, J. Appl. Math..

[19]  Isaac E. Lagaris,et al.  Particle swarm optimization with deliberate loss of information , 2012, Soft Comput..

[20]  Erik Valdemar Cuevas Jiménez,et al.  A new metaheuristic optimization methodology based on fuzzy logic , 2017, Appl. Soft Comput..

[21]  Jianchao Zeng,et al.  Parallel asynchronous control strategy for target search with swarm robots , 2009, Int. J. Bio Inspired Comput..

[22]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[23]  Fuad E. Alsaadi,et al.  A Novel Switching Delayed PSO Algorithm for Estimating Unknown Parameters of Lateral Flow Immunoassay , 2016, Cognitive Computation.

[24]  Yang Tang,et al.  Parameters identification of unknown delayed genetic regulatory networks by a switching particle swarm optimization algorithm , 2011, Expert Syst. Appl..

[25]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[26]  Yuhui Shi,et al.  Promoting Diversity in Particle Swarm Optimization to Solve Multimodal Problems , 2011, ICONIP.

[27]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[28]  K. Premalatha,et al.  Hybrid PSO and GA for Global Maximization , 2009 .

[29]  Andries Petrus Engelbrecht,et al.  A DNA Sequence Design for DNA Computation Based on Binary Vector Evaluated Particle Swarm Optimization , 2012, Int. J. Unconv. Comput..

[30]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[31]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.

[32]  Siti Zaiton Mohd Hashim,et al.  Training feedforward neural networks using hybrid particle swarm optimization and gravitational search algorithm , 2012, Appl. Math. Comput..

[33]  Archana Sarangi,et al.  An approach to identification of unknown IIR systems using crossover cat swarm optimization , 2016 .

[34]  Changhe Li,et al.  A Clustering Particle Swarm Optimizer for Locating and Tracking Multiple Optima in Dynamic Environments , 2010, IEEE Transactions on Evolutionary Computation.

[35]  Russell C. Eberhart,et al.  Human tremor analysis using particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[36]  Adam P. Piotrowski,et al.  Some metaheuristics should be simplified , 2018, Inf. Sci..

[37]  M Reyes Sierra,et al.  Multi-Objective Particle Swarm Optimizers: A Survey of the State-of-the-Art , 2006 .

[38]  Jaroslaw Sobieszczanski-Sobieski,et al.  A Parallel Particle Swarm Optimization Algorithm Accelerated by Asynchronous Evaluations , 2005 .

[39]  P. Suganthan.  Particle swarm optimiser with neighbourhood operator , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[40]  Ning Wang,et al.  Asynchronous particle swarm optimizer with relearning strategy , 2011, IECON 2011 - 37th Annual Conference of the IEEE Industrial Electronics Society.

[41]  Jie Guo,et al.  An Improved Particle Swarm Optimization with Re-initialization Mechanism , 2009, 2009 International Conference on Intelligent Human-Machine Systems and Cybernetics.

[42]  Changhe Li,et al.  A General Framework of Multipopulation Methods With Clustering in Undetectable Dynamic Environments , 2012, IEEE Transactions on Evolutionary Computation.

[43]  Marizan Mubin,et al.  A random synchronous asynchronous particle swarm optimization algorithm with a new iteration strategy , 2015 .

[44]  Francisco Herrera,et al.  Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power , 2010, Inf. Sci..

[45]  Mohammad Mehdi Ebadzadeh,et al.  A novel particle swarm optimization algorithm with adaptive inertia weight , 2011, Appl. Soft Comput..

[46]  Masafumi Hagiwara,et al.  Balancing Exploitation and Exploration in Particle Swarm Optimization: Velocity-based Reinitialization , 2008 .

[47]  Keiichiro Yasuda,et al.  Cluster-structured Particle Swarm Optimization with interaction , 2009, 2009 ICCAS-SICE.

[48]  Mohd Saberi Mohamad,et al.  An enhancement of binary particle swarm optimization for gene selection in classifying cancer classes , 2013, Algorithms for Molecular Biology.

[49]  Andries Petrus Engelbrecht,et al.  Particle swarm optimization with discrete crossover , 2013, 2013 IEEE Congress on Evolutionary Computation.

[50]  Andries Petrus Engelbrecht,et al.  Fitness function evaluations: A fair stopping condition? , 2014, 2014 IEEE Symposium on Swarm Intelligence.

[51]  Ruhul A. Sarker,et al.  A new genetic algorithm for solving optimization problems , 2014, Eng. Appl. Artif. Intell..

[52]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[53]  Antonina Starita,et al.  Particle swarm optimization for multimodal functions: a clustering approach , 2008 .

[54]  Azah Mohamed,et al.  A Survey of the State of the Art in Particle Swarm Optimization , 2012 .

[55]  Antonio LaTorre,et al.  A comprehensive comparison of large scale global optimizers , 2015, Inf. Sci..

[56]  Victor O. K. Li,et al.  A social spider algorithm for global optimization , 2015, Appl. Soft Comput..

[57]  Ganapati Panda,et al.  IIR system identification using cat swarm optimization , 2011, Expert Syst. Appl..

[58]  Veysel Gazi,et al.  Decentralized asynchronous particle swarm optimization , 2008, 2008 IEEE Swarm Intelligence Symposium.

[59]  Eva Balsa-Canto,et al.  Hybrid optimization method with general switching strategy for parameter estimation , 2008, BMC Systems Biology.

[60]  Winston Khoon Guan Seah,et al.  Random Asynchronous PSO , 2011, The 5th International Conference on Automation, Robotics and Applications.

[61]  Hossein Nezamabadi-pour,et al.  Filter modeling using gravitational search algorithm , 2011, Eng. Appl. Artif. Intell..

[62]  Aurora Trinidad Ramirez Pozo,et al.  Evaluation of asynchronous multi‐swarm particle optimization on several topologies , 2013, Concurr. Comput. Pract. Exp..

[63]  Kamarul Hawari Ghazali,et al.  Improving Vector Evaluated Particle Swarm Optimisation by Incorporating Nondominated Solutions , 2013, TheScientificWorldJournal.

[64]  Zbigniew Michalewicz,et al.  Particle Swarm Optimization for Single Objective Continuous Space Problems: A Review , 2017, Evolutionary Computation.

[65]  Ajith Abraham,et al.  Inertia Weight strategies in Particle Swarm Optimization , 2011, 2011 Third World Congress on Nature and Biologically Inspired Computing.