Self-Regulated Particle Swarm Multi-Task Optimization

Population based search techniques have been developed and applied to wide applications for their good performance, such as the optimization of the unmanned aerial vehicle (UAV) path planning problems. However, the search for optimal solutions for an optimization problem is usually expensive. For example, the UAV problem is a large-scale optimization problem with many constraints, which makes it hard to get exact solutions. Especially, it will be time-consuming when multiple UAV problems are waiting to be optimized at the same time. Evolutionary multi-task optimization (EMTO) studies the problem of utilizing the population-based characteristics of evolutionary computation techniques to optimize multiple optimization problems simultaneously, for the purpose of further improving the overall performance of resolving all these problems. EMTO has great potential in solving real-world problems more efficiently. Therefore, in this paper, we develop a novel EMTO algorithm using a classical PSO algorithm, in which the developed knowledge transfer strategy achieves knowledge transfer between task by synthesizing the transferred knowledges from a selected set of component tasks during the updating of the velocities of population. Two knowledge transfer strategies are developed along with two versions of the proposed algorithm. The proposed algorithm is compared with the multifactorial PSO algorithm, the SREMTO algorithm, the popular multifactorial evolutionary algorithm and a classical PSO algorithm on nine popular single-objective MTO problems and six five-task MTO problems, which demonstrates its superiority.

[1]  Jianghan Zhu,et al.  A Hybrid Differential Symbiotic Organisms Search Algorithm for UAV Path Planning , 2021, Sensors.

[2]  Y. Wang,et al.  An empirical study of multifactorial PSO and multifactorial DE , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[3]  Xinye Cai,et al.  Multi-Factorial Evolutionary Algorithm Based on M2M Decomposition , 2017, SEAL.

[4]  Qingfu Zhang,et al.  Evolutionary Multitasking for Multiobjective Continuous Optimization: Benchmark Problems, Performance Metrics and Baseline Results , 2017, ArXiv.

[5]  Tao Zhang,et al.  A Coevolutionary Framework for Constrained Multiobjective Optimization Problems , 2021, IEEE Transactions on Evolutionary Computation.

[6]  Darrell Whitley,et al.  A genetic algorithm tutorial , 1994, Statistics and Computing.

[7]  Yew-Soon Ong,et al.  Multifactorial Evolution: Toward Evolutionary Multitasking , 2016, IEEE Transactions on Evolutionary Computation.

[8]  Hongrun Wu,et al.  Multiple adaptive strategies based particle swarm optimization algorithm , 2020, Swarm Evol. Comput..

[9]  Abhishek Gupta,et al.  Multifactorial Evolutionary Algorithm With Online Transfer Parameter Estimation: MFEA-II , 2020, IEEE Transactions on Evolutionary Computation.

[10]  Vijay Kumar Banga,et al.  Design of fuzzy logic system framework using evolutionary techniques , 2020, Soft Comput..

[11]  Maoguo Gong,et al.  Evolutionary Multitasking Sparse Reconstruction: Framework and Case Study , 2019, IEEE Transactions on Evolutionary Computation.

[12]  Hua Xu,et al.  Evolutionary multitasking in permutation-based combinatorial optimization problems: Realization with TSP, QAP, LOP, and JSP , 2016, 2016 IEEE Region 10 Conference (TENCON).

[13]  Huynh ThiThanh Binh,et al.  Effective Multifactorial Evolutionary Algorithm for Solving the Cluster Shortest Path Tree Problem , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[14]  Yan Liu,et al.  Accelerating Active Learning with Transfer Learning , 2013, 2013 IEEE 13th International Conference on Data Mining.

[15]  K. Tan,et al.  Affine Transformation-Enhanced Multifactorial Optimization for Heterogeneous Problems , 2020, IEEE Transactions on Cybernetics.

[16]  Jasper Snoek,et al.  Multi-Task Bayesian Optimization , 2013, NIPS.

[17]  Pranab K. Muhuri,et al.  Multi-factorial evolutionary algorithm based novel solution approach for multi-objective pollution-routing problem , 2019, Comput. Ind. Eng..

[18]  Chen-Yang Cheng,et al.  Multi-temperature simulated annealing for optimizing mixed-blocking permutation flowshop scheduling problems , 2021, Expert Syst. Appl..

[19]  Hui Song,et al.  Multitasking Multi-Swarm Optimization , 2019, 2019 IEEE Congress on Evolutionary Computation (CEC).

[20]  Maoguo Gong,et al.  Differential Evolutionary Multi-task Optimization , 2019, 2019 IEEE Congress on Evolutionary Computation (CEC).

[21]  Wei Lu,et al.  Adaptive Gradient Multiobjective Particle Swarm Optimization , 2018, IEEE Transactions on Cybernetics.

[22]  Ying Huang,et al.  Multipopulation cooperative particle swarm optimization with a mixed mutation strategy , 2020, Inf. Sci..

[23]  Yew-Soon Ong,et al.  Linearized domain adaptation in evolutionary multitasking , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[24]  Zhi-Wei Ni,et al.  Coevolutionary multitasking for concurrent global optimization: With case studies in complex engineering design , 2017, Eng. Appl. Artif. Intell..

[25]  Xianpeng Wang,et al.  A Multiobjective multifactorial optimization algorithm based on decomposition and dynamic resource allocation strategy , 2020, Inf. Sci..

[26]  Jun Zhang,et al.  Particle Swarm Optimization With a Balanceable Fitness Estimation for Many-Objective Optimization Problems , 2018, IEEE Transactions on Evolutionary Computation.

[27]  Chuan-Kang Ting,et al.  Parting ways and reallocating resources in evolutionary multitasking , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[28]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[29]  Maoguo Gong,et al.  Self-Regulated Evolutionary Multitask Optimization , 2020, IEEE Transactions on Evolutionary Computation.

[30]  Abhishek Gupta,et al.  Cognizant Multitasking in Multiobjective Multifactorial Evolution: MO-MFEA-II , 2020, IEEE Transactions on Cybernetics.

[31]  Yusheng Liu,et al.  A Geometric Structure-Based Particle Swarm Optimization Algorithm for Multiobjective Problems , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[32]  Yew-Soon Ong,et al.  Memetic Computation—Past, Present & Future [Research Frontier] , 2010, IEEE Computational Intelligence Magazine.

[33]  Chuan-Kang Ting,et al.  Evolutionary Manytasking Optimization Based on Symbiosis in Biocoenosis , 2019, AAAI.

[34]  Huynh Thi Thanh Binh,et al.  Evolutionary Algorithm and Multifactorial Evolutionary Algorithm on Clustered Shortest-Path Tree problem , 2020, Inf. Sci..

[35]  Ziying Zhang,et al.  A hybrid method integrating an elite genetic algorithm with tabu search for the quadratic assignment problem , 2020, Inf. Sci..

[36]  Zexuan Zhu,et al.  Toward Adaptive Knowledge Transfer in Multifactorial Evolutionary Computation , 2020, IEEE Transactions on Cybernetics.

[37]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[38]  Giannis Tzimas,et al.  A genetic algorithm for spatiosocial tensor clustering , 2019, Evol. Syst..

[39]  Jun Zhang,et al.  Adaptive Particle Swarm Optimization , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[40]  Zidong Wang,et al.  A Dynamic Neighborhood-Based Switching Particle Swarm Optimization Algorithm , 2020, IEEE Transactions on Cybernetics.

[41]  Yong Zhang,et al.  Multiobjective Particle Swarm Optimization for Feature Selection With Fuzzy Cost , 2020, IEEE Transactions on Cybernetics.

[42]  Heng Zhang,et al.  A particle swarm optimization algorithm for mixed-variable optimization problems , 2021, Swarm Evol. Comput..

[43]  Tao Xiang,et al.  Towards Effective Mutation for Knowledge Transfer in Multifactorial Differential Evolution , 2019, 2019 IEEE Congress on Evolutionary Computation (CEC).

[44]  James C. Bean,et al.  Genetic Algorithms and Random Keys for Sequencing and Optimization , 1994, INFORMS J. Comput..

[45]  Sam Kwong,et al.  Adaptive Granularity Learning Distributed Particle Swarm Optimization for Large-Scale Optimization , 2020, IEEE Transactions on Cybernetics.

[46]  Ying Lin,et al.  Particle Swarm Optimization With an Aging Leader and Challengers , 2013, IEEE Transactions on Evolutionary Computation.

[47]  Zelda B. Zabinsky,et al.  A Numerical Evaluation of Several Stochastic Algorithms on Selected Continuous Global Optimization Test Problems , 2005, J. Glob. Optim..