Self-Regulated Evolutionary Multitask Optimization

Evolutionary multitask optimization (EMTO) is a newly emerging research area in the field of evolutionary computation. It investigates how to solve multiple optimization problems (tasks) at the same time via evolutionary algorithms (EAs) to improve on the performance of solving each task independently, assuming if some component tasks are related then the useful knowledge (e.g., promising candidate solutions) acquired during the process of solving one task may assist in (and also benefit from) solving the other tasks. In EMTO, task relatedness is typically unknown in advance and needs to be captured via EA’s population. Since the population of an EA can only cover a subregion of the solution space and keeps evolving during the search, thus captured task relatedness is local and dynamic. The multifactorial EA (MFEA) is one of the most representative EMTO techniques, inspired by the bio-cultural model of multifactorial inheritance, which transmits both biological and cultural traits from the parents to the offspring. MFEA has succeeded in solving various multitask optimization (MTO) problems. However, the intensity of knowledge transfer in MFEA is determined via its algorithmic configuration without considering the degree of task relatedness, which may prevent the effective sharing and utilization of the useful knowledge acquired in related tasks. To address this issue, we propose a self-regulated EMTO (SREMTO) algorithm to automatically adapt the intensity of cross-task knowledge transfer to different and varying degrees of relatedness between different tasks as the search proceeds so that the useful knowledge in common for solving related tasks can be captured, shared, and utilized to a great extent. We compare SREMTO with MFEA and its variants as well as the single-task optimization counterpart of SREMTO on two MTO test suites, which demonstrates the superiority of SREMTO.

[1]  Yingke Chen,et al.  A Group-based Approach to Improve Multifactorial Evolutionary Algorithm , 2018, IJCAI.

[2]  C. Robert Cloninger,et al.  Multifactorial inheritance with cultural transmission and assortative mating. II. a general model of combined polygenic and cultural inheritance. , 1979, American journal of human genetics.

[3]  Yew-Soon Ong,et al.  Concurrently searching branches in software tests generation through multitask evolution , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[4]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[5]  Liang Feng,et al.  The Boon of Gene-Culture Interaction for Effective Evolutionary Multitasking , 2016, ACALCI.

[6]  Xiaoliang Ma,et al.  Adaptive Memetic Algorithm Based Evolutionary Multi-tasking Single-Objective Optimization , 2017, SEAL.

[7]  Yew-Soon Ong,et al.  Genetic transfer or population diversification? Deciphering the secret ingredients of evolutionary multitask optimization , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[8]  Hua Xu,et al.  Evolutionary multitasking in permutation-based combinatorial optimization problems: Realization with TSP, QAP, LOP, and JSP , 2016, 2016 IEEE Region 10 Conference (TENCON).

[9]  Thomas Bäck,et al.  Evolutionary computation: comments on the history and current state , 1997, IEEE Trans. Evol. Comput..

[10]  Lei Zhou,et al.  A study of similarity measure between tasks for multifactorial evolutionary algorithm , 2018, GECCO.

[11]  Y. Wang,et al.  An empirical study of multifactorial PSO and multifactorial DE , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[12]  Yew-Soon Ong,et al.  Landscape synergy in evolutionary multitasking , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[13]  Lei Zhou,et al.  Evolutionary multitasking in combinatorial search spaces: A case study in capacitated vehicle routing problem , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[14]  Jasper Snoek,et al.  Multi-Task Bayesian Optimization , 2013, NIPS.

[15]  Qingfu Zhang,et al.  Multipopulation evolution framework for multifactorial optimization , 2018, GECCO.

[16]  Yew-Soon Ong,et al.  Linearized domain adaptation in evolutionary multitasking , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[17]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[18]  Chuan-Kang Ting,et al.  Evolutionary many-tasking based on biocoenosis through symbiosis: A framework and benchmark problems , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[19]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[20]  Andy J. Keane,et al.  Meta-Lamarckian learning in memetic algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[21]  James E. Baker,et al.  Reducing Bias and Inefficienry in the Selection Algorithm , 1987, ICGA.

[22]  Jing J. Liang,et al.  Performance Evaluation of Multiagent Genetic Algorithm , 2006, Natural Computing.

[23]  James C. Bean,et al.  Genetic Algorithms and Random Keys for Sequencing and Optimization , 1994, INFORMS J. Comput..

[24]  Ping Chen,et al.  An Evolutionary Multitasking Algorithm for Cloud Computing Service Composition , 2018, SERVICES.

[25]  Chuan-Kang Ting,et al.  Parting ways and reallocating resources in evolutionary multitasking , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[26]  Yew-Soon Ong,et al.  Multifactorial Evolution: Toward Evolutionary Multitasking , 2016, IEEE Transactions on Evolutionary Computation.

[27]  Qingfu Zhang,et al.  Evolutionary Multitasking for Multiobjective Continuous Optimization: Benchmark Problems, Performance Metrics and Baseline Results , 2017, ArXiv.