Evolutionary Transfer Optimization - A New Frontier in Evolutionary Computation Research

The evolutionary algorithm (EA) is a nature-inspired population-based search method that works on Darwinian principles of natural selection. Due to its strong search capability and simplicity of implementation, EA has been successfully applied to solve many complex optimization problems, which cannot be easily solved by traditional exact mathematical approaches, such as linear programming, quadratic programming, and convex optimization. Despite its great success, it is worth noting that traditional EA solvers start the search from scratch by assuming zero prior knowledge about the task at hand. However, as problems seldom exist in isolation, solving one problem may yield useful information for solving other related problems. There has been growing interest in conducting research on evolutionary transfer optimization (ETO) in recent years: a paradigm that integrates EA solvers with knowledge learning and transfer across related domains to achieve better optimization efficiency and performance. This paper provides an overview of existing works of ETO based on the type of problems being solved by these methods, which are ETO for Optimization in Uncertain Environment, ETO for Multitask Optimization, ETO for Complex Optimization, ETO for Multi/Many-Objective Optimization, and ETO for Machine Learning Applications. The paper also highlights some of the challenges faced in this emerging research field of computational intelligence and discusses some promising future research directions in ETO. It is hoped that the study presented in this paper can help to inspire the development of more advanced ETO methods and applications.

[1]  Jun Zhang,et al.  A Level-Based Learning Swarm Optimizer for Large-Scale Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[2]  Kay Chen Tan,et al.  An Effective Knowledge Transfer Approach for Multiobjective Multitasking Optimization , 2020, IEEE Transactions on Cybernetics.

[3]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[4]  Yingke Chen,et al.  A Group-based Approach to Improve Multifactorial Evolutionary Algorithm , 2018, IJCAI.

[5]  Wentong Cai,et al.  Multifactorial Genetic Programming for Symbolic Regression Problems , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[6]  Olac Fuentes,et al.  Knowledge Transfer in Deep convolutional Neural Nets , 2007, Int. J. Artif. Intell. Tools.

[7]  Raffaello D'Andrea,et al.  Transfer learning for vision-based tactile sensing , 2018, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[8]  Liang Feng,et al.  Evolutionary multitasking across single and multi-objective formulations for improved problem solving , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[9]  Ata Kabán,et al.  Toward Large-Scale Continuous EDA: A Random Matrix Theory Perspective , 2013, Evolutionary Computation.

[10]  Min Jiang,et al.  A Fast Dynamic Evolutionary Multiobjective Algorithm via Manifold Transfer Learning , 2020, IEEE Transactions on Cybernetics.

[11]  Yaochu Jin,et al.  Knowledge incorporation in evolutionary computation , 2005 .

[12]  Alexander V. Terekhov,et al.  Knowledge Transfer in Deep Block-Modular Neural Networks , 2015, Living Machines.

[13]  Jinghui Zhong,et al.  A Preliminary Study of Knowledge Transfer in Multi-Classification Using Gene Expression Programming , 2020, Frontiers in Neuroscience.

[14]  Dursun Delen,et al.  Predicting breast cancer survivability: a comparison of three data mining methods , 2005, Artif. Intell. Medicine.

[15]  Abir Chaabani,et al.  Transfer of learning with the co-evolutionary decomposition-based algorithm-II: a realization on the bi-level production-distribution planning system , 2018, Applied Intelligence.

[16]  Xin Yao,et al.  A Survey on Evolutionary Computation Approaches to Feature Selection , 2016, IEEE Transactions on Evolutionary Computation.

[17]  Thomas Wolf,et al.  Transfer Learning in Natural Language Processing , 2019, NAACL.

[18]  Ricardo H. C. Takahashi,et al.  A preliminary comparison of tree encoding schemes for evolutionary algorithms , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[19]  A. Juan,et al.  A Rich Vehicle Routing Problem : Survey , 2016 .

[20]  Kay Chen Tan,et al.  Multiobjective Deep Belief Networks Ensemble for Remaining Useful Life Estimation in Prognostics , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Francisco Herrera,et al.  Simultaneously Evolving Deep Reinforcement Learning Models using Multifactorial optimization , 2020, 2020 IEEE Congress on Evolutionary Computation (CEC).

[22]  Shengxiang Yang,et al.  Evolutionary Computation for Dynamic Optimization Problems , 2015, GECCO.

[23]  Mengjie Zhang,et al.  Reusing Extracted Knowledge in Genetic Programming to Solve Complex Texture Image Classification Problems , 2016, PAKDD.

[24]  Alexandros Karatzoglou,et al.  Deep Learning for Recommender Systems , 2017, RecSys.

[25]  Bing Xue,et al.  Cross-Domain Reuse of Extracted Knowledge in Genetic Programming for Image Classification , 2017, IEEE Transactions on Evolutionary Computation.

[26]  Mengjie Zhang,et al.  Generalisation and domain adaptation in GP with gradient descent for symbolic regression , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[27]  Jonathan Baxter,et al.  A Model of Inductive Bias Learning , 2000, J. Artif. Intell. Res..

[28]  Qiang Yang,et al.  Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence (AAAI-10) Adaptive Transfer Learning , 2022 .

[29]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[30]  Andreas Christmann,et al.  Support vector machines , 2008, Data Mining and Knowledge Discovery Handbook.

[31]  Kun Zhang,et al.  Transfer Learning with Label Noise , 2017, 1707.09724.

[32]  Dong Yu,et al.  Automatic Speech Recognition: A Deep Learning Approach , 2014 .

[33]  Abhishek Gupta,et al.  Cognizant Multitasking in Multiobjective Multifactorial Evolution: MO-MFEA-II , 2020, IEEE Transactions on Cybernetics.

[34]  David Wallace,et al.  Dynamic multi-objective optimization with evolutionary algorithms: a forward-looking approach , 2006, GECCO.

[35]  Liang Feng,et al.  Autoencoding Evolutionary Search With Learning Across Heterogeneous Problems , 2017, IEEE Transactions on Evolutionary Computation.

[36]  Xiaodong Li,et al.  A Competitive Divide-and-Conquer Algorithm for Unconstrained Large-Scale Black-Box Optimization , 2016, ACM Trans. Math. Softw..

[37]  George B. Dantzig,et al.  Linear Programming 1: Introduction , 1997 .

[38]  Mengjie Zhang,et al.  Evolving Deep Convolutional Neural Networks for Image Classification , 2017, IEEE Transactions on Evolutionary Computation.

[39]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[40]  Ling Shao,et al.  Transfer Learning for Visual Categorization: A Survey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[41]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[42]  Tianyou Chai,et al.  Multitasking Multiobjective Evolutionary Operational Indices Optimization of Beneficiation Processes , 2019, IEEE Transactions on Automation Science and Engineering.

[43]  Abhishek Gupta,et al.  Multifactorial Evolutionary Algorithm With Online Transfer Parameter Estimation: MFEA-II , 2020, IEEE Transactions on Evolutionary Computation.

[44]  Yew-Soon Ong,et al.  Landscape synergy in evolutionary multitasking , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[45]  Gabriela Ochoa,et al.  Adaptive Evolutionary Algorithms and Extensions to the HyFlex Hyper-heuristic Framework , 2012, PPSN.

[46]  Xin Yao,et al.  What are dynamic optimization problems? , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[47]  Anastasios Sextos,et al.  Multi-objective optimum selection of ground motion records with genetic algorithms , 2018 .

[48]  Maoguo Gong,et al.  Evolutionary Multitasking With Dynamic Resource Allocating Strategy , 2019, IEEE Transactions on Evolutionary Computation.

[49]  Julius Kunze,et al.  Transfer Learning for Speech Recognition on a Budget , 2017, Rep4NLP@ACL.

[50]  Xiaodong Li,et al.  Cooperative Co-Evolution With Differential Grouping for Large Scale Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[51]  Barry Smyth,et al.  Case-Based Reasoning in Scheduling: Reusing Solution Components. , 1996 .

[52]  Yew-Soon Ong,et al.  Multifactorial Evolution: Toward Evolutionary Multitasking , 2016, IEEE Transactions on Evolutionary Computation.

[53]  Ralf Salomon,et al.  Evolutionary algorithms and gradient search: similarities and differences , 1998, IEEE Trans. Evol. Comput..

[54]  Chi-Keong Goh,et al.  Multiproblem Surrogates: Transfer Evolutionary Multiobjective Optimization of Computationally Expensive Problems , 2019, IEEE Transactions on Evolutionary Computation.

[55]  Ivor W. Tsang,et al.  Memes as building blocks: a case study on evolutionary optimization + transfer learning for routing problems , 2015, Memetic Comput..

[56]  Gary G. Yen,et al.  Transfer Learning-Based Dynamic Multiobjective Optimization Algorithms , 2016, IEEE Transactions on Evolutionary Computation.

[57]  Maoguo Gong,et al.  Evolutionary Multitasking Sparse Reconstruction: Framework and Case Study , 2019, IEEE Transactions on Evolutionary Computation.

[58]  Xiaodong Li,et al.  Cooperative Co-evolution with delta grouping for large scale non-separable function optimization , 2010, IEEE Congress on Evolutionary Computation.

[59]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.

[60]  Jiancheng Lv,et al.  Automatically Designing CNN Architectures Using Genetic Algorithm for Image Classification , 2018, ArXiv.

[61]  Yew-Soon Ong,et al.  Curbing Negative Influences Online for Seamless Transfer Evolutionary Optimization , 2019, IEEE Transactions on Cybernetics.

[62]  Kay Chen Tan,et al.  Multiobjective Multifactorial Optimization in Evolutionary Multitasking , 2017, IEEE Transactions on Cybernetics.

[63]  Xiaodong Li,et al.  Cooperatively Coevolving Particle Swarms for Large Scale Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[64]  Ivor W. Tsang,et al.  Memetic Search With Interdomain Learning: A Realization Between CVRP and CARP , 2015, IEEE Transactions on Evolutionary Computation.

[65]  Xiaogang Wang,et al.  Structure Learning for Deep Neural Networks Based on Multiobjective Optimization , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[66]  Yiwen Sun,et al.  A Two-Level Transfer Learning Algorithm for Evolutionary Multitasking , 2020, Frontiers in Neuroscience.

[67]  Shai Ben-David,et al.  A notion of task relatedness yielding provable multiple-task learning guarantees , 2008, Machine Learning.

[68]  Tapabrata Ray,et al.  A Surrogate Assisted Approach for Single-Objective Bilevel Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[69]  Lai Soon Lee,et al.  Optimised crossover genetic algorithm for capacitated vehicle routing problem , 2012 .

[70]  Chuan-Kang Ting,et al.  Evolutionary many-tasking based on biocoenosis through symbiosis: A framework and benchmark problems , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[71]  Yew-Soon Ong,et al.  Linearized domain adaptation in evolutionary multitasking , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[72]  Michael L. Littman,et al.  Online Linear Regression and Its Application to Model-Based Reinforcement Learning , 2007, NIPS.

[73]  Uday Kumar Chakraborty,et al.  An analysis of Gray versus binary encoding in genetic search , 2003, Inf. Sci..

[74]  Min Jiang,et al.  Knee Point-Based Imbalanced Transfer Learning for Dynamic Multiobjective Optimization , 2020, IEEE Transactions on Evolutionary Computation.

[75]  Lei Zhou,et al.  Evolutionary Multitasking via Explicit Autoencoding , 2019, IEEE Transactions on Cybernetics.

[76]  Liang Feng,et al.  Insights on Transfer Optimization: Because Experience is the Best Teacher , 2018, IEEE Transactions on Emerging Topics in Computational Intelligence.

[77]  Mengjie Zhang,et al.  Reusing Building Blocks of Extracted Knowledge to Solve Complex, Large-Scale Boolean Problems , 2014, IEEE Transactions on Evolutionary Computation.

[78]  Roberto Santana,et al.  Structural transfer using EDAs: An application to multi-marker tagging SNP selection , 2012, 2012 IEEE Congress on Evolutionary Computation.

[79]  Zexuan Zhu,et al.  A Two stage Adaptive Knowledge Transfer Evolutionary Multi-tasking Based on Population Distribution for Multi/Many-Objective Optimization , 2020, ArXiv.

[80]  Gan Ruan,et al.  When and How to Transfer Knowledge in Dynamic Multi-objective Optimization , 2019, 2019 IEEE Symposium Series on Computational Intelligence (SSCI).

[81]  Panagiotis G. Ipeirotis,et al.  Quality management on Amazon Mechanical Turk , 2010, HCOMP '10.

[82]  Lei Zhou,et al.  A study of similarity measure between tasks for multifactorial evolutionary algorithm , 2018, GECCO.

[83]  Yew-Soon Ong,et al.  Memetic Computation , 2019, Adaptation, Learning, and Optimization.

[84]  Abhishek Gupta,et al.  Explicit Evolutionary Multitasking for Combinatorial Optimization: A Case Study on Capacitated Vehicle Routing Problem , 2020, IEEE Transactions on Cybernetics.

[85]  Jing Gao,et al.  On handling negative transfer and imbalanced distributions in multiple source transfer learning , 2014, SDM.

[86]  Jean-Baptiste Mouret,et al.  Quality diversity for multi-task optimization , 2020, GECCO.

[87]  Edwin Hsing-Mean Sha,et al.  Solving dynamic vehicle routing problem via evolutionary search with learning capability , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[88]  Zdenek Dostl Optimal Quadratic Programming Algorithms: With Applications to Variational Inequalities , 2009 .

[89]  Sushil J. Louis,et al.  Learning with case-injected genetic algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[90]  Vincenzo Maniscalco,et al.  Tree-Based Genetic Algorithm with Binary Encoding for QoS Routing , 2013, 2013 Seventh International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing.

[91]  Tianyou Chai,et al.  Generalized Multitasking for Evolutionary Optimization of Expensive Problems , 2019, IEEE Transactions on Evolutionary Computation.