Transfer Learning-Based Dynamic Multiobjective Optimization Algorithms

One of the major distinguishing features of the dynamic multiobjective optimization problems (DMOPs) is that optimization objectives will change over time, thus tracking the varying Pareto-optimal front becomes a challenge. One of the promising solutions is reusing “experiences” to construct a prediction model via statistical machine learning approaches. However, most existing methods neglect the nonindependent and identically distributed nature of data to construct the prediction model. In this paper, we propose an algorithmic framework, called transfer learning-based dynamic multiobjective evolutionary algorithm (EA), which integrates transfer learning and population-based EAs to solve the DMOPs. This approach exploits the transfer learning technique as a tool to generate an effective initial population pool via reusing past experience to speed up the evolutionary process, and at the same time any population-based multiobjective algorithms can benefit from this integration without any extensive modifications. To verify this idea, we incorporate the proposed approach into the development of three well-known EAs, nondominated sorting genetic algorithm II, multiobjective particle swarm optimization, and the regularity model-based multiobjective estimation of distribution algorithm. We employ 12 benchmark functions to test these algorithms as well as compare them with some chosen state-of-the-art designs. The experimental results confirm the effectiveness of the proposed design for DMOPs.

[1]  Phillip D. Stroud,et al.  Kalman-extended genetic algorithm for search in nonstationary environments with noisy fitness evaluations , 2001, IEEE Trans. Evol. Comput..

[2]  Min Jiang,et al.  Embodied concept formation and reasoning via neural-symbolic integration , 2010, Neurocomputing.

[3]  Kay Chen Tan,et al.  A Competitive-Cooperative Coevolutionary Paradigm for Dynamic Multiobjective Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[4]  Gary G. Yen,et al.  Cultural-based particle swarm for dynamic optimisation problems , 2012, Int. J. Syst. Sci..

[5]  Concha Bielza,et al.  Multiobjective Estimation of Distribution Algorithm Based on Joint Modeling of Objectives and Variables , 2014, IEEE Transactions on Evolutionary Computation.

[6]  Jun Xu,et al.  Power Portfolio Optimization in Deregulated Electricity Markets With Risk Management , 2004, IEEE Transactions on Power Systems.

[7]  Qingfu Zhang,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 RM-MEDA: A Regularity Model-Based Multiobjective Estimation of , 2022 .

[8]  Kay Chen Tan,et al.  Dynamic Evolutionary Multi-objective Optimization , 2009 .

[9]  Le Song,et al.  A Hilbert Space Embedding for Distributions , 2007, Discovery Science.

[10]  T. Jansen,et al.  Populations can be Essential in Dynamic Optimisation , 2015, GECCO.

[11]  Jürgen Branke,et al.  Memory enhanced evolutionary algorithms for changing optimization problems , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[12]  Ingo Steinwart,et al.  On the Influence of the Kernel on the Consistency of Support Vector Machines , 2002, J. Mach. Learn. Res..

[13]  Bin Li,et al.  Multi-strategy ensemble evolutionary algorithm for dynamic multi-objective optimization , 2010, Memetic Comput..

[14]  A. Engelbrecht,et al.  Benchmark Functions for CEC 2015 Special Session and Competition on Dynamic Multi-objective Optimization , 2015 .

[15]  Anabela Simões,et al.  Prediction in evolutionary algorithms for dynamic environments , 2014, Soft Comput..

[16]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[17]  Kay Chen Tan,et al.  Solving the IEEE CEC 2015 Dynamic Benchmark Problems Using Kalman Filter Based Dynamic Multiobjective Evolutionary Algorithm , 2016 .

[18]  Terence C. Fogarty,et al.  A Genetic Algorithm with Variable Range of Local Search for Tracking Changing Environments , 1996, PPSN.

[19]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[20]  Kalyanmoy Deb,et al.  Dynamic multiobjective optimization problems: test cases, approximations, and applications , 2004, IEEE Transactions on Evolutionary Computation.

[21]  C.A. Coello Coello,et al.  MOPSO: a proposal for multiple objective particle swarm optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[22]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[23]  Lamjed Ben Said,et al.  A dynamic multi-objective evolutionary algorithm using a change severity-based adaptive population management strategy , 2015, Soft Computing.

[24]  Bernhard Schölkopf,et al.  A Kernel Method for the Two-Sample-Problem , 2006, NIPS.

[25]  R. Lyndon While,et al.  A faster algorithm for calculating hypervolume , 2006, IEEE Transactions on Evolutionary Computation.

[26]  Duc-Cuong Dang,et al.  Populations Can Be Essential in Tracking Dynamic Optima , 2016, Algorithmica.

[27]  Shengxiang Yang,et al.  Evolutionary dynamic optimization: A survey of the state of the art , 2012, Swarm Evol. Comput..

[28]  Jürgen Branke,et al.  A Multi-population Approach to Dynamic Optimization Problems , 2000 .

[29]  Fan Zhang,et al.  Fuzzy neural network based dynamic path planning , 2012, 2012 International Conference on Machine Learning and Cybernetics.

[30]  Claudio Rossi,et al.  Tracking Moving Optima Using Kalman-Based Predictions , 2008, Evolutionary Computation.

[31]  Min Jiang,et al.  Integration of Global and Local Metrics for Domain Adaptation Learning Via Dimensionality Reduction , 2017, IEEE Transactions on Cybernetics.

[32]  Xin Yao,et al.  Dynamic Multi-objective Optimization: A Survey of the State-of-the-Art , 2013 .

[33]  Carlos Cruz,et al.  Optimization in dynamic environments: a survey on problems, methods and measures , 2011, Soft Comput..

[34]  Peter A. N. Bosman Learning and Anticipation in Online Dynamic Optimization , 2007, Evolutionary Computation in Dynamic and Uncertain Environments.

[35]  Qingfu Zhang,et al.  A Population Prediction Strategy for Evolutionary Dynamic Multiobjective Optimization , 2014, IEEE Transactions on Cybernetics.

[36]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2003, ICTAI.

[37]  Yong Wang,et al.  A regularity model-based multiobjective estimation of distribution algorithm with reducing redundant cluster operator , 2012, Appl. Soft Comput..

[38]  Kay Chen Tan,et al.  Evolutionary Dynamic Multiobjective Optimization Via Kalman Filter Prediction , 2016, IEEE Transactions on Cybernetics.

[39]  C. Coello,et al.  Improving PSO-based Multi-Objective Optimization using Crowding , Mutation and �-Dominance , 2005 .

[40]  Koby Crammer,et al.  A theory of learning from different domains , 2010, Machine Learning.

[41]  Bing Xue,et al.  Cross-Domain Reuse of Extracted Knowledge in Genetic Programming for Image Classification , 2017, IEEE Transactions on Evolutionary Computation.

[42]  Ivor W. Tsang,et al.  Memetic Search With Interdomain Learning: A Realization Between CVRP and CARP , 2015, IEEE Transactions on Evolutionary Computation.

[43]  Rama Chellappa,et al.  Visual Domain Adaptation: A survey of recent advances , 2015, IEEE Signal Processing Magazine.

[44]  Carlos A. Coello Coello,et al.  Improving PSO-Based Multi-objective Optimization Using Crowding, Mutation and epsilon-Dominance , 2005, EMO.

[45]  Changle Zhou,et al.  An Infant Development-inspired Approach to Robot Hand-eye Coordination , 2014 .

[46]  Enrique Alba,et al.  AbYSS: Adapting Scatter Search to Multiobjective Optimization , 2008, IEEE Transactions on Evolutionary Computation.

[47]  Min Jiang,et al.  Robotic Free Writing of Chinese Characters via Human-Robot Interactions , 2014, Int. J. Humanoid Robotics.

[48]  Shengxiang Yang,et al.  A hybrid immigrants scheme for genetic algorithms in dynamic environments , 2007, Int. J. Autom. Comput..

[49]  Lamjed Ben Said,et al.  Dynamic Multi-objective Optimization Using Evolutionary Algorithms: A Survey , 2017, Recent Advances in Evolutionary Multi-objective Optimization.

[50]  Shengxiang Yang,et al.  Genetic Algorithms with Memory- and Elitism-Based Immigrants in Dynamic Environments , 2008, Evolutionary Computation.

[51]  Kalyanmoy Deb,et al.  Dynamic Multi-objective Optimization and Decision-Making Using Modified NSGA-II: A Case Study on Hydro-thermal Power Scheduling , 2007, EMO.

[52]  Mario Cámara Sola,et al.  Parallel processing for dynamic multi-objetive optimization , 2010 .

[53]  Gary G. Yen,et al.  Dynamic Evolutionary Algorithm With Variable Relocation , 2009, IEEE Transactions on Evolutionary Computation.

[54]  Koby Crammer,et al.  Analysis of Representations for Domain Adaptation , 2006, NIPS.

[55]  B. Scholkopf,et al.  Fisher discriminant analysis with kernels , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).

[56]  Changhe Li,et al.  A Clustering Particle Swarm Optimizer for Locating and Tracking Multiple Optima in Dynamic Environments , 2010, IEEE Transactions on Evolutionary Computation.

[57]  Helen G. Cobb,et al.  An Investigation into the Use of Hypermutation as an Adaptive Operator in Genetic Algorithms Having Continuous, Time-Dependent Nonstationary Environments , 1990 .

[58]  Mengjie Zhang,et al.  Reusing Building Blocks of Extracted Knowledge to Solve Complex, Large-Scale Boolean Problems , 2014, IEEE Transactions on Evolutionary Computation.

[59]  Changhe Li,et al.  Fast Multi-Swarm Optimization for Dynamic Optimization Problems , 2008, 2008 Fourth International Conference on Natural Computation.

[60]  Shengxiang Yang,et al.  Genetic algorithms with adaptive immigrants for dynamic environments , 2013, 2013 IEEE Congress on Evolutionary Computation.

[61]  John J. Grefenstette,et al.  Genetic Algorithms for Changing Environments , 1992, PPSN.