Evolutionary Dynamic Multi-objective Optimization via Regression Transfer Learning

Dynamic multi-objective optimization problems (DMOPs) remain a challenge to be settled, because of conflicting objective functions change over time. In recent years, transfer learning has been proven to be a kind of effective approach in solving DMOPs. In this paper, a novel transfer learning based dynamic multi-objective optimization algorithm (DMOA) is proposed called regression transfer learning prediction based DMOA (RTLP-DMOA). The algorithm aims to generate an excellent initial population to accelerate the evolutionary process and improve the evolutionary performance in solving DMOPs. When an environmental change is detected, a regression transfer learning prediction model is constructed by reusing the historical population, which can predict objective values. Then, with the assistance of this prediction model, some high-quality solutions with better predicted objective values are selected as the initial population, which can improve the performance of the evolutionary process. We compare the proposed algorithm with three state-of-the-art algorithms on benchmark functions. Experimental results indicate that the proposed algorithm can significantly enhance the performance of static multi-objective optimization algorithms and is competitive in convergence and diversity.

[1]  Witold Pedrycz,et al.  Multidirectional Prediction Approach for Dynamic Multiobjective Optimization Problems , 2019, IEEE Transactions on Cybernetics.

[2]  Shengxiang Yang,et al.  A Similarity-Based Cooperative Co-Evolutionary Algorithm for Dynamic Interval Multiobjective Optimization Problems , 2020, IEEE Transactions on Evolutionary Computation.

[3]  Min Jiang,et al.  Embodied concept formation and reasoning via neural-symbolic integration , 2010, Neurocomputing.

[4]  Min Jiang,et al.  An NP-complete fragment of fibring logic , 2015, Annals of Mathematics and Artificial Intelligence.

[5]  Fan Zhang,et al.  Fuzzy neural network based dynamic path planning , 2012, 2012 International Conference on Machine Learning and Cybernetics.

[6]  Kay Chen Tan,et al.  A Competitive-Cooperative Coevolutionary Paradigm for Dynamic Multiobjective Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[7]  Min Jiang,et al.  Integration of Global and Local Metrics for Domain Adaptation Learning Via Dimensionality Reduction , 2017, IEEE Transactions on Cybernetics.

[8]  Yanming Yang,et al.  Multi-objective memetic algorithm based on request prediction for dynamic pickup-and-delivery problems , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[9]  Kalyanmoy Deb,et al.  Dynamic multiobjective optimization problems: test cases, approximations, and applications , 2004, IEEE Transactions on Evolutionary Computation.

[10]  Bin Gu,et al.  Incremental Support Vector Learning for Ordinal Regression , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[12]  Min Jiang,et al.  Dynamic Multi-objective Estimation of Distribution Algorithm based on Domain Adaptation and Nonparametric Estimation , 2018, Inf. Sci..

[13]  Qiang Yang,et al.  Boosting for transfer learning , 2007, ICML '07.

[14]  Yang Tang,et al.  High-Dimensional Robust Multi-Objective Optimization for Order Scheduling: A Decision Variable Classification Approach , 2019, IEEE Transactions on Industrial Informatics.

[15]  D. Basak,et al.  Support Vector Regression , 2008 .

[16]  Peter Stone,et al.  Boosting for Regression Transfer , 2010, ICML.

[17]  Xin Yao,et al.  Dynamic Multi-objective Optimization: A Survey of the State-of-the-Art , 2013 .

[18]  Qingfu Zhang,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 RM-MEDA: A Regularity Model-Based Multiobjective Estimation of , 2022 .

[19]  R. K. Ursem.  Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[20]  Gary G. Yen,et al.  Transfer Learning-Based Dynamic Multiobjective Optimization Algorithms , 2016, IEEE Transactions on Evolutionary Computation.

[21]  Shengxiang Yang,et al.  A Steady-State and Generational Evolutionary Algorithm for Dynamic Multiobjective Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[22]  Kay Chen Tan,et al.  Evolutionary Dynamic Multiobjective Optimization Via Kalman Filter Prediction , 2016, IEEE Transactions on Cybernetics.

[23]  Peng Hao,et al.  Transfer learning using computational intelligence: A survey , 2015, Knowl. Based Syst..

[24]  Jürgen Branke,et al.  Memory enhanced evolutionary algorithms for changing optimization problems , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[25]  Xin Yao,et al.  Dynamic Multiobjectives Optimization With a Changing Number of Objectives , 2016, IEEE Transactions on Evolutionary Computation.

[26]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[27]  Xing Gao,et al.  Solving Dynamic Multi-objective Optimization Problems Using Incremental Support Vector Machine , 2019, 2019 IEEE Congress on Evolutionary Computation (CEC).

[28]  Qingfu Zhang,et al.  A Population Prediction Strategy for Evolutionary Dynamic Multiobjective Optimization , 2014, IEEE Transactions on Cybernetics.