Evolutionary Multitasking via Explicit Autoencoding

Evolutionary multitasking (EMT) is an emerging research topic in the field of evolutionary computation. In contrast to the traditional single-task evolutionary search, EMT conducts evolutionary search on multiple tasks simultaneously. It aims to improve convergence characteristics across multiple optimization problems at once by seamlessly transferring knowledge among them. Due to the efficacy of EMT, it has attracted lots of research attentions and several EMT algorithms have been proposed in the literature. However, existing EMT algorithms are usually based on a common mode of knowledge transfer in the form of implicit genetic transfer through chromosomal crossover. This mode cannot make use of multiple biases embedded in different evolutionary search operators, which could give better search performance when properly harnessed. Keeping this in mind, this paper proposes an EMT algorithm with explicit genetic transfer across tasks, namely EMT via autoencoding, which allows the incorporation of multiple search mechanisms with different biases in the EMT paradigm. To confirm the efficacy of the proposed EMT algorithm with explicit autoencoding, comprehensive empirical studies have been conducted on both the single- and multi-objective multitask optimization problems.

[1]  Witold Pedrycz,et al.  Transfer Boosting With Synthetic Instances for Class Imbalanced Object Recognition , 2018, IEEE Transactions on Cybernetics.

[2]  Kay Chen Tan,et al.  Multiobjective Multifactorial Optimization in Evolutionary Multitasking , 2017, IEEE Transactions on Cybernetics.

[3]  Bing Xue,et al.  Common subtrees in related problems: A novel transfer learning approach for genetic programming , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[4]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[5]  Yew-Soon Ong,et al.  Multifactorial Evolution: Toward Evolutionary Multitasking , 2016, IEEE Transactions on Evolutionary Computation.

[6]  Chuan-Kang Ting,et al.  Parting ways and reallocating resources in evolutionary multitasking , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[7]  Thomas Bäck,et al.  Evolutionary computation: comments on the history and current state , 1997, IEEE Trans. Evol. Comput..

[8]  Qingfu Zhang,et al.  Evolutionary Multitasking for Multiobjective Continuous Optimization: Benchmark Problems, Performance Metrics and Baseline Results , 2017, ArXiv.

[9]  Liang Feng,et al.  Autoencoding Evolutionary Search With Learning Across Heterogeneous Problems , 2017, IEEE Transactions on Evolutionary Computation.

[10]  Kay Chen Tan,et al.  A hybrid multi-objective evolutionary algorithm for solving truck and trailer vehicle routing problems , 2006, Eur. J. Oper. Res..

[11]  Kenneth A. De Jong,et al.  Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents , 2000, Evolutionary Computation.

[12]  Jason Weston,et al.  Joint Learning of Words and Meaning Representations for Open-Text Semantic Parsing , 2012, AISTATS.

[13]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[14]  Yew-Soon Ong,et al.  Linearized domain adaptation in evolutionary multitasking , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[15]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[16]  Maoguo Gong,et al.  Evolutionary multi-task learning for modular extremal learning machine , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[17]  Larry J. Eshelman,et al.  Biases in the Crossover Landscape , 1989, ICGA.

[18]  Pablo Moscato,et al.  Handbook of Memetic Algorithms , 2011, Studies in Computational Intelligence.

[19]  Qingfu Zhang,et al.  On Tchebycheff Decomposition Approaches for Multiobjective Evolutionary Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[20]  Sam Kwong,et al.  Genetic algorithms: concepts and applications [in engineering design] , 1996, IEEE Trans. Ind. Electron..

[21]  Maoguo Gong,et al.  A Multiobjective Cooperative Coevolutionary Algorithm for Hyperspectral Sparse Unmixing , 2017, IEEE Transactions on Evolutionary Computation.

[22]  Shengxiang Yang,et al.  Evolutionary Dynamic Multiobjective Optimization: Benchmarks and Algorithm Comparisons , 2017, IEEE Transactions on Cybernetics.

[23]  Yew-Soon Ong,et al.  Landscape synergy in evolutionary multitasking , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[24]  Bing Xue,et al.  Cross-Domain Reuse of Extracted Knowledge in Genetic Programming for Image Classification , 2017, IEEE Transactions on Evolutionary Computation.

[25]  Ivor W. Tsang,et al.  Memetic Search With Interdomain Learning: A Realization Between CVRP and CARP , 2015, IEEE Transactions on Evolutionary Computation.

[26]  Zhen Ji,et al.  A multi-objective memetic algorithm based on locality-sensitive hashing for one-to-many-to-one dynamic pickup-and-delivery problem , 2016, Inf. Sci..

[27]  Yoshua Bengio,et al.  Domain Adaptation for Large-Scale Sentiment Classification: A Deep Learning Approach , 2011, ICML.

[28]  Qingfu Zhang,et al.  Entropy-Based Termination Criterion for Multiobjective Evolutionary Algorithms , 2016, IEEE Transactions on Evolutionary Computation.

[29]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[30]  Yew-Soon Ong,et al.  Evolutionary Multitasking: A Computer Science View of Cognitive Multitasking , 2016, Cognitive Computation.

[31]  Kaisa Miettinen,et al.  On initial populations of a genetic algorithm for continuous optimization problems , 2007, J. Glob. Optim..

[32]  Jun Zhang,et al.  Differential Evolution with an Evolution Path: A DEEP Evolutionary Algorithm , 2015, IEEE Transactions on Cybernetics.

[33]  Yiwen Sun,et al.  Global path planning of mobile robots using a memetic algorithm , 2015, Int. J. Syst. Sci..

[34]  Xin Yao,et al.  Memetic Algorithm With Extended Neighborhood Search for Capacitated Arc Routing Problems , 2009, IEEE Transactions on Evolutionary Computation.

[35]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[36]  Chuan-Kang Ting,et al.  Evolutionary many-tasking based on biocoenosis through symbiosis: A framework and benchmark problems , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[37]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[38]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[39]  Zexuan Zhu,et al.  A novel differential evolution algorithm with a self-adaptation parameter control method by differential evolution , 2018, Soft Comput..

[40]  Lei Zhou,et al.  Evolutionary multitasking in combinatorial search spaces: A case study in capacitated vehicle routing problem , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).