An empirical study of multifactorial PSO and multifactorial DE

Recently, the notion of Multifactorial Optimization (MFO) has emerged as a promising approach for evolutionary multi-tasking by automatically exploiting the latent synergies between optimization problems, simply through solving them together in an unified representation space [1]. It aims to improve convergence characteristics across multiple optimization problems at once by seamlessly transferring knowledge between them. In [1], the efficacy of MFO has been studied by a specific mode of knowledge transfer in the form of implicit genetic transfer through chromosomal crossover. Here we further explore the generality of MFO when diverse population based search mechanisms are employed. In particular, in this paper, we present the first attempt to conduct MFO with the popular particle swarm optimization and differential evolution search. Two specific multi-tasking paradigms, namely multifactorial particle swarm optimization (MFPSO) and multifactorial differential evolution (MFDE) are proposed. To evaluate the performance of MFPSO and MFDE, comprehensive empirical studies on 9 single objective MFO benchmark problems are provided.

[1]  Shu-Mei Guo,et al.  Enhancing Differential Evolution Utilizing Eigenvector-Based Crossover Operator , 2015, IEEE Transactions on Evolutionary Computation.

[2]  Xiaogang Wang,et al.  Boosted multi-task learning for face verification with applications to web image and video search , 2009, CVPR.

[3]  Y. Ong,et al.  Multifactorial Evolution : Towards Evolutionary Multitasking , 2022 .

[4]  Murat Dundar,et al.  An Improved Multi-task Learning Approach with Applications in Medical Diagnosis , 2008, ECML/PKDD.

[5]  Kristen Grauman,et al.  Learning with Whom to Share in Multi-task Feature Learning , 2011, ICML.

[6]  Thomas Bäck,et al.  Evolutionary computation: comments on the history and current state , 1997, IEEE Trans. Evol. Comput..

[7]  Yew-Soon Ong,et al.  Evolutionary Multitasking: A Computer Science View of Cognitive Multitasking , 2016, Cognitive Computation.

[8]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[9]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[10]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[11]  Zbigniew Michalewicz,et al.  Analysis of Stability, Local Convergence, and Transformation Sensitivity of a Variant of the Particle Swarm Optimization Algorithm , 2016, IEEE Transactions on Evolutionary Computation.

[12]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[13]  Qingfu Zhang,et al.  Evolutionary Multitasking for Multiobjective Continuous Optimization: Benchmark Problems, Performance Metrics and Baseline Results , 2017, ArXiv.

[14]  Qiang Yang,et al.  A Survey of Transfer and Multitask Learning in Bioinformatics , 2011, J. Comput. Sci. Eng..