Multiobjective Multitasking Optimization Based on Incremental Learning

Multiobjective multitasking optimization (MTO) is an emerging research topic in the field of evolutionary computation. In contrast to multiobjective optimization, MTO solves multiple optimization tasks simultaneously. MTO aims to improve the overall performance of multiple tasks through knowledge transfer among tasks. Recently, MTO has attracted the attention of many researchers, and several algorithms have been proposed in the literature. However, one of the crucial issues, finding useful knowledge, has been rarely studied. Keeping this in mind, this article proposes an MTO algorithm based on incremental learning (EMTIL). Specifically, the transferred solutions (the form of knowledge) will be selected by incremental classifiers, which are capable of finding valuable solutions for knowledge transfer. The training data are generated by the knowledge transfer at each generation. Furthermore, the search space of the tasks will be explored by the proposed mapping (among tasks) approach, which helps these tasks to escape from their local Pareto Fronts. Empirical studies have been conducted on 15 MTO problems to assess the effectiveness of EMTIL. The experimental results demonstrate that EMTIL works more effectively for MTO compared to the existing algorithms.

[1]  Edwin V. Bonilla,et al.  Multi-task Gaussian Process Prediction , 2007, NIPS.

[2]  Qingfu Zhang,et al.  Evolutionary Multitasking for Multiobjective Continuous Optimization: Benchmark Problems, Performance Metrics and Baseline Results , 2017, ArXiv.

[3]  Lei Zhou,et al.  Evolutionary Multitasking via Explicit Autoencoding , 2019, IEEE Transactions on Cybernetics.

[4]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[5]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[6]  Mengjie Zhang,et al.  Extracting and using building blocks of knowledge in learning classifier systems , 2012, GECCO '12.

[7]  Shengli Xie,et al.  Optimal WCDMA network planning by multiobjective evolutionary algorithm with problem-specific genetic operation , 2014, Knowledge and Information Systems.

[8]  Hisao Ishibuchi,et al.  Behavior of Multiobjective Evolutionary Algorithms on Many-Objective Knapsack Problems , 2015, IEEE Transactions on Evolutionary Computation.

[9]  Bo Jiang,et al.  Sequence Based Prediction of DNA-Binding Proteins Based on Hybrid Feature Selection Using Random Forest and Gaussian Naïve Bayes , 2014, PloS one.

[10]  Xun Xu,et al.  From cloud computing to cloud manufacturing , 2012 .

[11]  Maoguo Gong,et al.  Evolutionary Multitasking With Dynamic Resource Allocating Strategy , 2019, IEEE Transactions on Evolutionary Computation.

[12]  Wenfeng Li,et al.  A discrete multi-objective fireworks algorithm for flowshop scheduling with sequence-dependent setup times , 2019, Swarm Evol. Comput..

[13]  G. Golub,et al.  Updating formulae and a pairwise algorithm for computing sample variances , 1979 .

[14]  Maoguo Gong,et al.  Self-Regulated Evolutionary Multitask Optimization , 2020, IEEE Transactions on Evolutionary Computation.

[15]  Liang Feng,et al.  Insights on Transfer Optimization: Because Experience is the Best Teacher , 2018, IEEE Transactions on Emerging Topics in Computational Intelligence.

[16]  Yew-Soon Ong,et al.  Multifactorial Evolution: Toward Evolutionary Multitasking , 2016, IEEE Transactions on Evolutionary Computation.

[17]  Rohitash Chandra,et al.  Evolutionary Multi-task Learning for Modular Training of Feedforward Neural Networks , 2016, ICONIP.

[18]  Yew-Soon Ong,et al.  Genetic transfer or population diversification? Deciphering the secret ingredients of evolutionary multitask optimization , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[19]  Lei Zhou,et al.  Evolutionary multitasking in combinatorial search spaces: A case study in capacitated vehicle routing problem , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[20]  Daniel L. Silver,et al.  Machine Lifelong Learning: Challenges and Benefits for Artificial General Intelligence , 2011, AGI.

[21]  Kay Chen Tan,et al.  Multiobjective Multifactorial Optimization in Evolutionary Multitasking , 2017, IEEE Transactions on Cybernetics.

[22]  A. Shamsai,et al.  Multi-objective Optimization , 2017, Encyclopedia of Machine Learning and Data Mining.

[23]  Vincent A. Cicirello,et al.  The Permutation in a Haystack Problem and the Calculus of Search Landscapes , 2016, IEEE Transactions on Evolutionary Computation.

[24]  T. Miranda Lakshmi,et al.  A Genetic Bankrupt Ratio Analysis Tool Using a Genetic Algorithm to Identify Influencing Financial Ratios , 2016, IEEE Transactions on Evolutionary Computation.

[25]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[26]  Hung Hum,et al.  Is Naïve Bayes a Good Classifier for Document Classification , 2011 .

[27]  Raymond Chiong,et al.  Solving the energy-efficient job shop scheduling problem: a multi-objective genetic algorithm with enhanced local search for minimizing the total weighted tardiness and total energy consumption , 2016 .

[28]  Yew-Soon Ong,et al.  Linearized domain adaptation in evolutionary multitasking , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[29]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[30]  Abhishek Gupta,et al.  Multifactorial Evolutionary Algorithm With Online Transfer Parameter Estimation: MFEA-II , 2020, IEEE Transactions on Evolutionary Computation.

[31]  Hua Xu,et al.  Evolutionary multitasking in permutation-based combinatorial optimization problems: Realization with TSP, QAP, LOP, and JSP , 2016, 2016 IEEE Region 10 Conference (TENCON).

[32]  Raouf Boutaba,et al.  Cloud computing: state-of-the-art and research challenges , 2010, Journal of Internet Services and Applications.

[33]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[34]  Vangelis Metsis,et al.  Spam Filtering with Naive Bayes - Which Naive Bayes? , 2006, CEAS.

[35]  Jasbir S. Arora,et al.  Survey of multi-objective optimization methods for engineering , 2004 .

[36]  Maoguo Gong,et al.  Evolutionary Multitasking Sparse Reconstruction: Framework and Case Study , 2019, IEEE Transactions on Evolutionary Computation.

[37]  Tianyou Chai,et al.  Generalized Multitasking for Evolutionary Optimization of Expensive Problems , 2019, IEEE Transactions on Evolutionary Computation.

[38]  Yew-Soon Ong,et al.  Evolutionary Multitasking: A Computer Science View of Cognitive Multitasking , 2016, Cognitive Computation.

[39]  Vincent Lemaire,et al.  Learning with few examples: An empirical study on leading classifiers , 2011, The 2011 International Joint Conference on Neural Networks.

[40]  Joseph C. Griffis,et al.  Voxel-based Gaussian naïve Bayes classification of ischemic stroke lesions in individual T1-weighted MRI scans , 2016, Journal of Neuroscience Methods.

[41]  Bing Liu,et al.  Lifelong machine learning: a paradigm for continuous learning , 2017, Frontiers of Computer Science.

[42]  Bing Xue,et al.  Cross-Domain Reuse of Extracted Knowledge in Genetic Programming for Image Classification , 2017, IEEE Transactions on Evolutionary Computation.

[43]  Rich Caruana,et al.  Multitask Learning , 1998, Encyclopedia of Machine Learning and Data Mining.