Toward Adaptive Knowledge Transfer in Multifactorial Evolutionary Computation

A multifactorial evolutionary algorithm (MFEA) is a recently proposed algorithm for evolutionary multitasking, which optimizes multiple optimization tasks simultaneously. With the design of knowledge transfer among different tasks, MFEA has demonstrated the capability to outperform its single-task counterpart in terms of both convergence speed and solution quality. In MFEA, the knowledge transfer across tasks is realized via the crossover between solutions that possess different skill factors. This crossover is thus essential to the performance of MFEA. However, we note that the present MFEA and most of its existing variants only employ a single crossover for knowledge transfer, and fix it throughout the evolutionary search process. As different crossover operators have a unique bias in generating offspring, the appropriate configuration of crossover for knowledge transfer in MFEA is necessary toward robust search performance, for solving different problems. Nevertheless, to the best of our knowledge, there is no effort being conducted on the adaptive configuration of crossovers in MFEA for knowledge transfer, and this article thus presents an attempt to fill this gap. In particular, here, we first investigate how different types of crossover affect the knowledge transfer in MFEA on both single-objective (SO) and multiobjective (MO) continuous optimization problems. Furthermore, toward robust and efficient multitask optimization performance, we propose a new MFEA with adaptive knowledge transfer (MFEA-AKT), in which the crossover operator employed for knowledge transfer is self-adapted based on the information collected along the evolutionary search process. To verify the effectiveness of the proposed method, comprehensive empirical studies on both SO and MO multitask benchmarks have been conducted. The experimental results show that the proposed MFEA-AKT is able to identify the appropriate knowledge transfer crossover for different optimization problems and even at different optimization stages along the search, which thus leads to superior or competitive performances when compared to the MFEAs with fixed knowledge transfer crossover operators.

[1]  Ponnuthurai N. Suganthan,et al.  Ensemble and Arithmetic Recombination-Based Speciation Differential Evolution for Multimodal Optimization , 2016, IEEE Transactions on Cybernetics.

[2]  Kalyanmoy Deb,et al.  Self-adaptive simulated binary crossover for real-parameter optimization , 2007, GECCO '07.

[3]  K. K. Sahu,et al.  Normalization: A Preprocessing Stage , 2015, ArXiv.

[4]  Paolo Palazzari,et al.  A new crossover operator for genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[5]  Chuan-Kang Ting,et al.  Parting ways and reallocating resources in evolutionary multitasking , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[6]  Emanuel Falkenauer,et al.  The worth of the uniform [uniform crossover] , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[7]  Lei Zhou,et al.  Evolutionary multitasking in combinatorial search spaces: A case study in capacitated vehicle routing problem , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[8]  Liang Feng,et al.  The Boon of Gene-Culture Interaction for Effective Evolutionary Multitasking , 2016, ACALCI.

[9]  Kay Chen Tan,et al.  Multiobjective Multifactorial Optimization in Evolutionary Multitasking , 2017, IEEE Transactions on Cybernetics.

[10]  Alden H. Wright,et al.  Genetic Algorithms for Real Parameter Optimization , 1990, FOGA.

[11]  Zbigniew Michalewicz,et al.  A Note on Usefulness of Geometrical Crossover for Numerical Optimization Problems , 1996, Evolutionary Programming.

[12]  Terry Jones,et al.  Crossover, Macromutationand, and Population-Based Search , 1995, ICGA.

[13]  Qingfu Zhang,et al.  Evolutionary Multitasking for Multiobjective Continuous Optimization: Benchmark Problems, Performance Metrics and Baseline Results , 2017, ArXiv.

[14]  Yew-Soon Ong,et al.  Evolutionary Multitasking: A Computer Science View of Cognitive Multitasking , 2016, Cognitive Computation.

[15]  Shih-Chia Huang,et al.  An Evolutionary Multiobjective Carpool Algorithm Using Set-Based Operator Based on Simulated Binary Crossover , 2019, IEEE Transactions on Cybernetics.

[16]  Gilbert Syswerda,et al.  Uniform Crossover in Genetic Algorithms , 1989, ICGA.

[17]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[18]  Tianyou Chai,et al.  Generalized Multitasking for Evolutionary Optimization of Expensive Problems , 2019, IEEE Transactions on Evolutionary Computation.

[19]  Francisco Herrera,et al.  A taxonomy for the crossover operator for real‐coded genetic algorithms: An experimental study , 2003, Int. J. Intell. Syst..

[20]  Heinz Mühlenbein,et al.  Fuzzy Recombination for the Breeder Genetic Algorithm , 1995, ICGA.

[21]  Kay Chen Tan,et al.  Multiple Exponential Recombination for Differential Evolution , 2017, IEEE Transactions on Cybernetics.

[22]  Lalit M. Patnaik,et al.  Genetic algorithms: a survey , 1994, Computer.

[23]  Abhishek Gupta,et al.  Multifactorial Evolutionary Algorithm With Online Transfer Parameter Estimation: MFEA-II , 2020, IEEE Transactions on Evolutionary Computation.

[24]  Yew-Soon Ong,et al.  Landscape synergy in evolutionary multitasking , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[25]  Josh C. Bongard,et al.  A probabilistic functional crossover operator for genetic programming , 2010, GECCO '10.

[26]  Oliver Kramer,et al.  Self-adaptive partially mapped crossover , 2007, GECCO '07.

[27]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.

[28]  Ezequiel A. Di Paolo,et al.  An efficient genetic algorithm with uniform crossover for air traffic control , 2009, Comput. Oper. Res..

[29]  Hua Xu,et al.  Evolutionary multitasking in permutation-based combinatorial optimization problems: Realization with TSP, QAP, LOP, and JSP , 2016, 2016 IEEE Region 10 Conference (TENCON).

[30]  Maoguo Gong,et al.  Evolutionary Multitasking With Dynamic Resource Allocating Strategy , 2019, IEEE Transactions on Evolutionary Computation.

[31]  Kalyanmoy Deb,et al.  Self-Adaptive Genetic Algorithms with Simulated Binary Crossover , 2001, Evolutionary Computation.

[32]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization , 2014 .

[33]  Kusum Deep,et al.  New Variations of Order Crossover for Travelling Salesman Problem , 2011, Int. J. Comb. Optim. Probl. Informatics.

[34]  LiHui,et al.  Multiobjective optimization problems with complicated Pareto sets, MOEA/D and NSGA-II , 2009 .

[35]  Yingke Chen,et al.  A Group-based Approach to Improve Multifactorial Evolutionary Algorithm , 2018, IJCAI.

[36]  Lawrence W. Robinson,et al.  Improved Base-Stock Approximations for Independent Stochastic Lead Times with Order Crossover , 2005, Manuf. Serv. Oper. Manag..

[37]  Yew-Soon Ong,et al.  Evolutionary multitasking in bi-level optimization , 2015 .

[38]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[39]  Chuan-Kang Ting,et al.  Evolutionary many-tasking based on biocoenosis through symbiosis: A framework and benchmark problems , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[40]  Yew-Soon Ong,et al.  Linearized domain adaptation in evolutionary multitasking , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[41]  Yew-Soon Ong,et al.  Multifactorial Evolution: Toward Evolutionary Multitasking , 2016, IEEE Transactions on Evolutionary Computation.

[42]  T. V. Geetha,et al.  A Survey on Crossover Operators , 2016, ACM Comput. Surv..

[43]  J. Feder,et al.  Geometrical crossover and self-similarity of DLA and viscous fingering clusters , 1989 .

[44]  Nicolas Durand,et al.  Genetic crossover operator for partially separable functions , 1998 .

[45]  X. Yao,et al.  Analysing crossover operators by search step size , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[46]  Yew-Soon Ong,et al.  Genetic transfer or population diversification? Deciphering the secret ingredients of evolutionary multitask optimization , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[47]  David E. Goldberg,et al.  AllelesLociand the Traveling Salesman Problem , 1985, ICGA.

[48]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.