Evolution of biocoenosis through symbiosis with fitness approximation for many-tasking optimization

Memetic computing is a blooming research area, which treats memes as the fundamental building blocks of information transfer. Evolutionary multitasking is an emerging topic in memetic computation, which applies evolutionary algorithm to optimize multiple tasks at a time. A famous class of algorithms for evolutionary multitasking is the multi-factorial evolutionary algorithm (MFEA). Nevertheless, current MFEAs only consider problems with small number of tasks, resulting in a lack of effective information transfer strategy. This study proposes a framework for evolutionary multitasking, called the evolution of biocoenosis through symbiosis with fitness approximation (EBSFA). The EBSFA incorporates evolution of biocoenosis through symbiosis (EBS) with fitness approximation to ameliorate the information transfer. The improvement of EBSFA is three-fold, including (1) the adaptive control of information transfer among tasks, (2) the selection of individuals from the universal offspring pool for evaluation based on fitness approximation, and (3) an ensemble method for improving the accuracy of fitness approximation through k nearest neighbors. Experimental analysis verifies the effectiveness and efficiency of the proposed EBSFA, by comparison with an advanced single-tasking method, the covariance matrix adaptation evolution strategy (CMAES), an illustrious multitasking optimization method, the MFEA-II, and an evolutionary many-tasking method, the EBS on a set of many-tasking benchmark problems. The results show that EBSFA can gain nice solution quality and fast convergence speed. Further analysis validates the effectiveness of the proposed components on improving the information transfer.

[1]  Daniele Loiacono,et al.  Speeding-Up Expensive Evaluations in High-Level Synthesis Using Solution Modeling and Fitness Inheritance , 2010 .

[2]  Wei Shyy,et al.  Response surface and neural network techniques for rocket engine injector optimization , 1999 .

[3]  Rung-Tzuo Liaw,et al.  Multifactorial Genetic Fuzzy Data Mining for Building Membership Functions , 2020, 2020 IEEE Congress on Evolutionary Computation (CEC).

[4]  Shane Strasser,et al.  Factored Evolutionary Algorithms , 2017, IEEE Transactions on Evolutionary Computation.

[5]  Yew-Soon Ong,et al.  Evolutionary multitasking in bi-level optimization , 2015 .

[6]  R. H. Myers,et al.  Response Surface Methodology: Process and Product Optimization Using Designed Experiments , 1995 .

[7]  Gianluca Palermo,et al.  Improving evolutionary exploration to area-time optimization of FPGA designs , 2008, J. Syst. Archit..

[8]  Thomas J. Santner,et al.  Design and analysis of computer experiments , 1998 .

[9]  Martin Pelikan,et al.  Fitness Inheritance in the Bayesian Optimization Algorithm , 2004, GECCO.

[10]  Qingfu Zhang,et al.  Behavioral study of the surrogate model-aware evolutionary search framework , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[11]  Robert E. Smith,et al.  Fitness inheritance in genetic algorithms , 1995, SAC '95.

[12]  Yew-Soon Ong,et al.  Curse and Blessing of Uncertainty in Evolutionary Algorithm Using Approximation , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[13]  Chuan-Kang Ting,et al.  Parting ways and reallocating resources in evolutionary multitasking , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[14]  Aimin Zhou,et al.  A Multioperator Search Strategy Based on Cheap Surrogate Models for Evolutionary Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[15]  Abhishek Gupta,et al.  Cognizant Multitasking in Multiobjective Multifactorial Evolution: MO-MFEA-II , 2020, IEEE Transactions on Cybernetics.

[16]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[17]  Yew-Soon Ong,et al.  Concurrently searching branches in software tests generation through multitask evolution , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[18]  David E. Goldberg,et al.  Efficiency Enhancement of Probabilistic Model Building Genetic Algorithms , 2004, ArXiv.

[19]  Chuan-Kang Ting,et al.  Evolutionary many-tasking based on biocoenosis through symbiosis: A framework and benchmark problems , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[20]  W. Carpenter,et al.  A comparison of polynomial approximations and artificial neural nets as response surfaces , 1993 .

[21]  Hisao Ishibuchi,et al.  Analysis of evolutionary multi-tasking as an island model , 2018, GECCO.

[22]  Abhishek Gupta,et al.  Multifactorial Evolutionary Algorithm With Online Transfer Parameter Estimation: MFEA-II , 2020, IEEE Transactions on Evolutionary Computation.

[23]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[24]  Rommel G. Regis,et al.  Evolutionary Programming for High-Dimensional Constrained Expensive Black-Box Optimization Using Radial Basis Functions , 2014, IEEE Transactions on Evolutionary Computation.

[25]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[26]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[27]  D. Goldberg,et al.  Don't evaluate, inherit , 2001 .

[28]  David E. Goldberg,et al.  Efficiency enhancement of genetic algorithms via building-block-wise fitness estimation , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[29]  Helio J. C. Barbosa,et al.  A study on fitness inheritance for enhanced efficiency in real-coded genetic algorithms , 2012, 2012 IEEE Congress on Evolutionary Computation.

[30]  Nikolaus Hansen,et al.  The CMA Evolution Strategy: A Comparing Review , 2006, Towards a New Evolutionary Computation.

[31]  Rohitash Chandra,et al.  Evolutionary Multi-task Learning for Modular Training of Feedforward Neural Networks , 2016, ICONIP.

[32]  Yaochu Jin,et al.  Surrogate-assisted evolutionary computation: Recent advances and future challenges , 2011, Swarm Evol. Comput..

[33]  Chuan-Kang Ting,et al.  Evolutionary Manytasking Optimization Based on Symbiosis in Biocoenosis , 2019, AAAI.

[34]  David E. Goldberg,et al.  Evaluation relaxation using substructural information and linear estimation , 2006, GECCO '06.

[35]  Chuan-Kang Ting,et al.  Enhancing covariance matrix adaptation evolution strategy through fitness inheritance , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[36]  Yew-Soon Ong,et al.  Landscape synergy in evolutionary multitasking , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[37]  Lei Zhou,et al.  Evolutionary multitasking in combinatorial search spaces: A case study in capacitated vehicle routing problem , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[38]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[39]  Yew-Soon Ong,et al.  Multifactorial Evolution: Toward Evolutionary Multitasking , 2016, IEEE Transactions on Evolutionary Computation.

[40]  Mohammad Reza Farmani,et al.  Multidisciplinary design of a small satellite launch vehicle using particle swarm optimization , 2011 .

[41]  Chang Wook Ahn,et al.  Entropy-based efficiency enhancement techniques for evolutionary algorithms , 2012, Inf. Sci..

[42]  Fred H. Lesh,et al.  Multi-dimensional least-squares polynomial curve fitting , 1959, CACM.

[43]  Carl E. Rasmussen,et al.  In Advances in Neural Information Processing Systems , 2011 .