An Improved NSGAII Algorithm Based on Site-Directed Mutagenesis Method for Multi-Objective Optimization

Evolutionary algorithms have been greatly uti-lized in Multi-objective optimization problems. Existing studies on multi-objective evolutional algorithms (MOEAs) rarely consider the evolutionary environment which may influence the selection and mutation of the individuals in the evolutionary process. Therefore, with consideration of the evolutionary environment of human intervention, this paper proposes a novel site-directed mutagenesis method for MOEA to generate offspring based on reinforcement learning. In the evolutionary process, reinforcement learning is utilized to simulate the site-directed mutagenesis of human intervention, where key genes affecting the current status are identified through Q-learning agent in the mutation stage. The mutation stage is further applied in NSGAII and the new algorithms are named as RL-NSGAII. Different benchmark problems are used to verify the performance of the proposed algorithms through a large number of experiments. Compared with NSGAII, RL-NSGAII has advantages in the convergence speed of Pareto front and has outstanding performance in the diversity and stability of the solution set for both the two-objective and multi-objective benchmark problems.

[1]  Gexiang Zhang,et al.  A Many-Objective Evolutionary Algorithm With Enhanced Mating and Environmental Selections , 2015, IEEE Transactions on Evolutionary Computation.

[2]  Diptarka Dasgupta,et al.  Microbial CYP450: An Insight into Its Molecular/Catalytic Mechanism, Production and Industrial Application , 2018, Principles and Applications of Fermentation Technology.

[3]  Shengxiang Yang,et al.  A Strength Pareto Evolutionary Algorithm Based on Reference Direction for Multiobjective and Many-Objective Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[4]  Kalyanmoy Deb,et al.  Muiltiobjective Optimization Using Nondominated Sorting in Genetic Algorithms , 1994, Evolutionary Computation.

[5]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[6]  P. Gerlee Directional variation in evolution: consequences for the fitness landscape metaphor , 2015, bioRxiv.

[7]  Kalyanmoy Deb,et al.  Investigating the Effect of Imbalance Between Convergence and Diversity in Evolutionary Multiobjective Algorithms , 2017, IEEE Transactions on Evolutionary Computation.

[8]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[9]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[10]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[11]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[12]  Aurélie Coulon,et al.  Dispersal asymmetries and deleterious mutations influence metapopulation persistence and range dynamics , 2015, Evolutionary Ecology.

[13]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[14]  Yuren Zhou,et al.  A Vector Angle-Based Evolutionary Algorithm for Unconstrained Many-Objective Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[15]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[16]  C. Coello,et al.  Years of Evolutionary Multi-Objective Optimization : What Has Been Done and What Remains To Be Done , 2006 .

[17]  Antonio J. Nebro,et al.  jMetal: A Java framework for multi-objective optimization , 2011, Adv. Eng. Softw..