Multitasking Multi-Swarm Optimization

Multi-task optimization (MTO) is a newly emerging research area in the field of optimization, studying on how to solve multiple optimization problems at the same time so that the processes of solving different but relevant problems could help each other via knowledge transfer to improve the overall performance of solving all problems. Evolutionary MTO (EMTO) employs evolutionary algorithms as the optimizer and treats the candidate solutions that perform commonly well on multiple tasks as the transferable knowledge between these tasks. In this work, we propose a multitasking multi-swarm optimization (MTMSO) algorithm which extends a popular dynamic multi-swarm optimization (DMS-PSO) algorithm into the multitasking scenario. In MTMSO, the whole swarm is randomly partitioned into multiple swarms (i.e., task groups) with each being responsible for solving a specific task, and each swarm is further partitioned into multiple sub-swarms. Within each task group, optimization is performed as per the mechanism of DMS-PSO for solving a specific task. Cross-task knowledge transfer is realized via probabilistic crossover of the personal bests of the particles from different task groups. Both task groups and each group’s sub-swarms are periodically reformed to maintain search diversity. An adaptive local search process, featuring dynamic allocation of the computational resource for each task, is incorporated in the final stage of optimization to improve the quality of the best solution found for each task. The proposed MTMSO algorithm is compared with a single-task conventional PSO and a popular EMTO algorithm on two test suites composing of 9 simple and 10 complex single-objective MTO problems, respectively, which demonstrates its superiority.

[1]  A. Kai Qin,et al.  Rapid and brief communication Uncorrelated heteroscedastic LDAbasedon theweightedpairwise Chernoff criterion , 2004 .

[2]  Qingfu Zhang,et al.  Evolutionary Multitasking for Multiobjective Continuous Optimization: Benchmark Problems, Performance Metrics and Baseline Results , 2017, ArXiv.

[3]  Y. Wang,et al.  An empirical study of multifactorial PSO and multifactorial DE , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[4]  Jing J. Liang,et al.  Two-hidden-layer extreme learning machine for regression and classification , 2016, Neurocomputing.

[5]  Maoguo Gong,et al.  Adaptive multifactorial particle swarm optimisation , 2019, CAAI Trans. Intell. Technol..

[6]  Xiaodong Li,et al.  Initialization methods for large scale global optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[7]  Yew-Soon Ong,et al.  Evolutionary Multitasking: A Computer Science View of Cognitive Multitasking , 2016, Cognitive Computation.

[8]  A. Kai Qin,et al.  Evolutionary feature subspaces generation for ensemble classification , 2018, GECCO.

[9]  Maoguo Gong,et al.  Self-Regulated Evolutionary Multitask Optimization , 2020, IEEE Transactions on Evolutionary Computation.

[10]  Jinghui Zhong,et al.  Surrogate-Assisted Multi-Tasking Memetic Algorithm , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[11]  Jasper Snoek,et al.  Multi-Task Bayesian Optimization , 2013, NIPS.

[12]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer with local search , 2005, 2005 IEEE Congress on Evolutionary Computation.

[13]  Qingfu Zhang,et al.  Multipopulation evolution framework for multifactorial optimization , 2018, GECCO.

[14]  Jing J. Liang,et al.  Performance Evaluation of Multiagent Genetic Algorithm , 2006, Natural Computing.

[15]  Zhi-Wei Ni,et al.  Coevolutionary multitasking for concurrent global optimization: With case studies in complex engineering design , 2017, Eng. Appl. Artif. Intell..

[16]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[17]  Xiaoliang Ma,et al.  Adaptive Memetic Algorithm Based Evolutionary Multi-tasking Single-Objective Optimization , 2017, SEAL.

[18]  Yew-Soon Ong,et al.  Multifactorial Evolution: Toward Evolutionary Multitasking , 2016, IEEE Transactions on Evolutionary Computation.