A Two-Level Transfer Learning Algorithm for Evolutionary Multitasking

Different from conventional single-task optimization, the recently proposed multitasking optimization (MTO) simultaneously deals with multiple optimization tasks with different types of decision variables. MTO explores the underlying similarity and complementarity among the component tasks to improve the optimization process. The well-known multifactorial evolutionary algorithm (MFEA) has been successfully introduced to solve MTO problems based on transfer learning. However, it uses a simple and random inter-task transfer learning strategy, thereby resulting in slow convergence. To deal with this issue, this paper presents a two-level transfer learning (TLTL) algorithm, in which the upper-level implements inter-task transfer learning via chromosome crossover and elite individual learning, and the lower-level introduces intra-task transfer learning based on information transfer of decision variables for an across-dimension optimization. The proposed algorithm fully uses the correlation and similarity among the component tasks to improve the efficiency and effectiveness of MTO. Experimental studies demonstrate the proposed algorithm has outstanding ability of global search and fast convergence rate.

[1]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[2]  J. H. Zar,et al.  Significance Testing of the Spearman Rank Correlation Coefficient , 1972 .

[3]  C. Robert Cloninger,et al.  Multifactorial inheritance with cultural transmission and assortative mating. II. a general model of combined polygenic and cultural inheritance. , 1979, American journal of human genetics.

[4]  Zhao Wang,et al.  Enhancing evolutionary multifactorial optimization based on particle swarm optimization , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[5]  Lei Zhou,et al.  Evolutionary multitasking in combinatorial search spaces: A case study in capacitated vehicle routing problem , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[6]  Chelsea C. White,et al.  Multiobjective A* , 1991, JACM.

[7]  Yew-Soon Ong,et al.  Genetic transfer or population diversification? Deciphering the secret ingredients of evolutionary multitask optimization , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[8]  Yiwen Sun,et al.  Three-dimensional Gabor feature extraction for hyperspectral imagery classification using a memetic framework , 2015, Inf. Sci..

[9]  Qingfu Zhang,et al.  On Tchebycheff Decomposition Approaches for Multiobjective Evolutionary Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[10]  Fang Liu,et al.  MOEA/D with Baldwinian learning inspired by the regularity property of continuous multiobjective problem , 2014, Neurocomputing.

[11]  Zexuan Zhu,et al.  Wrapper–Filter Feature Selection Algorithm Using a Memetic Framework , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  Fang Liu,et al.  A Multiobjective Evolutionary Algorithm Based on Decision Variable Analyses for Multiobjective Optimization Problems With Large-Scale Variables , 2016, IEEE Transactions on Evolutionary Computation.

[13]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[14]  Y. Wang,et al.  An empirical study of multifactorial PSO and multifactorial DE , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[15]  Qingfu Zhang,et al.  Evolutionary Multitasking for Multiobjective Continuous Optimization: Benchmark Problems, Performance Metrics and Baseline Results , 2017, ArXiv.

[16]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[17]  M W Feldman,et al.  Cultural versus biological inheritance: phenotypic transmission from parents to children. (A theory of the effect of parental phenotypes on children's phenotypes). , 1973, American journal of human genetics.

[18]  Liang Feng,et al.  Insights on Transfer Optimization: Because Experience is the Best Teacher , 2018, IEEE Transactions on Emerging Topics in Computational Intelligence.

[19]  Yew-Soon Ong,et al.  Multifactorial Evolution: Toward Evolutionary Multitasking , 2016, IEEE Transactions on Evolutionary Computation.

[20]  Fang Liu,et al.  MOEA/D with uniform decomposition measurement for many-objective problems , 2014, Soft Computing.

[21]  Yew-Soon Ong,et al.  Evolutionary Multitasking: A Computer Science View of Cognitive Multitasking , 2016, Cognitive Computation.

[22]  Qingfu Zhang,et al.  Global path planning of wheeled robots using multi-objective memetic algorithms , 2015, Integr. Comput. Aided Eng..

[23]  Fang Liu,et al.  MOEA/D with opposition-based learning for multiobjective optimization problem , 2014, Neurocomputing.

[24]  Yew-Soon Ong,et al.  Concurrently searching branches in software tests generation through multitask evolution , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[25]  Yiwen Sun,et al.  Global path planning of mobile robots using a memetic algorithm , 2015, Int. J. Syst. Sci..

[26]  Fang Liu,et al.  MOEA/D with biased weight adjustment inspired by user preference and its application on multi-objective reservoir flood control problem , 2016, Soft Comput..

[27]  Chi-Keong Goh,et al.  Multiproblem Surrogates: Transfer Evolutionary Multiobjective Optimization of Computationally Expensive Problems , 2019, IEEE Transactions on Evolutionary Computation.

[28]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[29]  Zhen Ji,et al.  DNA Sequence Compression Using Adaptive Particle Swarm Optimization-Based Memetic Algorithm , 2011, IEEE Transactions on Evolutionary Computation.

[30]  Andries Petrus Engelbrecht,et al.  Self-adaptive Differential Evolution , 2005, CIS.

[31]  Fang Liu,et al.  MOEA/D with Adaptive Weight Adjustment , 2014, Evolutionary Computation.

[32]  R. Lewontin ‘The Selfish Gene’ , 1977, Nature.

[33]  Yew-Soon Ong,et al.  Evolutionary multitasking in bi-level optimization , 2015 .

[34]  Hua Xu,et al.  Evolutionary multitasking in permutation-based combinatorial optimization problems: Realization with TSP, QAP, LOP, and JSP , 2016, 2016 IEEE Region 10 Conference (TENCON).

[35]  Hitoshi Iba,et al.  Enhancing differential evolution performance with local search for high dimensional function optimization , 2005, GECCO '05.

[36]  M. Feldman,et al.  Gene-culture coevolutionary theory. , 1996, Trends in ecology & evolution.

[37]  Zhen Ji,et al.  A multi-objective memetic algorithm based on locality-sensitive hashing for one-to-many-to-one dynamic pickup-and-delivery problem , 2016, Inf. Sci..

[38]  Chuan-Kang Ting,et al.  Parting ways and reallocating resources in evolutionary multitasking , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[39]  Jacek M. Zurada,et al.  An Evolutionary Transfer Reinforcement Learning Framework for Multiagent Systems , 2017, IEEE Transactions on Evolutionary Computation.

[40]  Yew-Soon Ong,et al.  Linearized domain adaptation in evolutionary multitasking , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[41]  Kay Chen Tan,et al.  A Multi-Facet Survey on Memetic Computation , 2011, IEEE Transactions on Evolutionary Computation.