Heterogeneous comprehensive learning and dynamic multi-swarm particle swarm optimizer with two mutation operators

Abstract In this paper, a heterogeneous comprehensive learning and dynamic multi-swarm particle swarm optimizer with two mutation operators (HCLDMS-PSO) is presented. In addition, a comprehensive learning (CL) strategy with the global optimal experience of the whole population is conducted to generate an exploitation subpopulation exemplar. However, a modified dynamic multi-swarm (DMS) strategy is specially designed to construct the exploration subpopulation exemplar. In the canonical DMS strategy, it is unfavorable for different sub-swarms to use the same linear decreasing inertia weight parameter. We first propose classifying the DMS sub-swarms at the search level and then constructing a novel nonlinear adaptive decreasing inertia weight for different sub-swarms, introducing a non-uniform mutation operator to enhance its exploration capability. Finally, the gbest of the whole population also adopts a Gaussian mutation operator to avoid falling into the local optimum. The particles of the two subpopulations will update their velocity independently without crippling one another to prevent a loss of diversity. The performance of HCLDMS-PSO is compared with those of 8 other PSO variants and 11 evolutionary algorithms on two classical benchmark optimization problems and a real-world engineering problem. Experimental results demonstrate that the HCLDMS-PSO improves the convergence speed, accuracy, and reliability on most optimization problems.

[1]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[2]  Mohammed Azmi Al-Betar,et al.  Natural selection methods for artificial bee colony with new versions of onlooker bee , 2018, Soft Comput..

[3]  Zhongzhi Shi,et al.  MPSO: Modified particle swarm optimization and its applications , 2018, Swarm Evol. Comput..

[4]  Changhe Li,et al.  A Self-Learning Particle Swarm Optimizer for Global Optimization Problems , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[5]  Driss Ouazar,et al.  Hybrid particle swarm optimization and differential evolution for optimal design of water distribution systems , 2012, Advanced Engineering Informatics.

[6]  Seyed Mohammad Mirjalili,et al.  Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm , 2015, Knowl. Based Syst..

[7]  Nor Ashidi Mat Isa,et al.  Particle swarm optimization with increasing topology connectivity , 2014, Eng. Appl. Artif. Intell..

[8]  Narasimhan Sundararajan,et al.  Dynamic mentoring and self-regulation based particle swarm optimization algorithm for solving complex real-world optimization problems , 2016, Inf. Sci..

[9]  Ying Lin,et al.  Particle Swarm Optimization With an Aging Leader and Challengers , 2013, IEEE Transactions on Evolutionary Computation.

[10]  Satvir Singh,et al.  Butterfly optimization algorithm: a novel approach for global optimization , 2018, Soft Computing.

[11]  Alexandros Iosifidis,et al.  On the kernel Extreme Learning Machine classifier , 2015, Pattern Recognit. Lett..

[12]  Mark Johnston,et al.  A novel particle swarm optimisation approach to detecting continuous, thin and smooth edges in noisy images , 2013, Inf. Sci..

[13]  Jun Zhang,et al.  Adaptive Particle Swarm Optimization , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  Jing Jie,et al.  Multi-swarm particle swarm optimization based on mixed search behavior , 2010, 2010 5th IEEE Conference on Industrial Electronics and Applications.

[15]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[16]  Nor Ashidi Mat Isa,et al.  An adaptive two-layer particle swarm optimization with elitist learning strategy , 2014, Inf. Sci..

[17]  Giancarlo Mauri,et al.  Fuzzy Self-Tuning PSO: A settings-free algorithm for global optimization , 2017, Swarm Evol. Comput..

[18]  Xin-She Yang,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010, NICSO.

[19]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[20]  Zheng Li,et al.  Expert Systems With Applications , 2022 .

[21]  Zhijian Wu,et al.  Enhancing particle swarm optimization using generalized opposition-based learning , 2011, Inf. Sci..

[22]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[23]  Antonina Starita,et al.  Particle swarm optimization for multimodal functions: a clustering approach , 2008 .

[24]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[25]  P. N. Suganthan,et al.  A dynamic neighborhood learning based particle swarm optimizer for global numerical optimization , 2012, Inf. Sci..

[26]  Shinn-Ying Ho,et al.  OPSO: Orthogonal Particle Swarm Optimization and Its Application to Task Assignment Problems , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[27]  Lei wen,et al.  The research of PSO algorithms with non-linear time-decreasing inertia weight , 2008, 2008 7th World Congress on Intelligent Control and Automation.

[28]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[29]  Zhi-Hui Zhan,et al.  An Efficient Resource Allocation Scheme Using Particle Swarm Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[30]  P. N. Suganthan,et al.  Ensemble particle swarm optimizer , 2017, Appl. Soft Comput..

[31]  Ponnuthurai N. Suganthan,et al.  A Distance-Based Locally Informed Particle Swarm Model for Multimodal Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[32]  Andrew Lewis,et al.  The Whale Optimization Algorithm , 2016, Adv. Eng. Softw..

[33]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[34]  John Doherty,et al.  Committee-Based Active Learning for Surrogate-Assisted Particle Swarm Optimization of Expensive Problems , 2017, IEEE Transactions on Cybernetics.

[35]  Chunguo Wu,et al.  Particle swarm optimization based on dimensional learning strategy , 2019, Swarm Evol. Comput..

[36]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[37]  Yonggang Chen,et al.  Particle swarm optimizer with two differential mutation , 2017, Appl. Soft Comput..

[38]  Yaochu Jin,et al.  A social learning particle swarm optimization algorithm for scalable optimization , 2015, Inf. Sci..

[39]  Ponnuthurai N. Suganthan,et al.  Heterogeneous comprehensive learning particle swarm optimization with enhanced exploration and exploitation , 2015, Swarm Evol. Comput..

[40]  Jin Wang,et al.  A PSO based Energy Efficient Coverage Control Algorithm for Wireless Sensor Networks , 2018 .

[41]  Narasimhan Sundararajan,et al.  Self regulating particle swarm optimization algorithm , 2015, Inf. Sci..

[42]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[43]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[44]  Alex S. Fukunaga,et al.  Improving the search performance of SHADE using linear population size reduction , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[45]  Kerstin Eder,et al.  Improving XCS performance on overlapping binary problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[46]  Gang Xu,et al.  An adaptive parameter tuning of particle swarm optimization algorithm , 2013, Appl. Math. Comput..