An adaptive weight vector guided evolutionary algorithm for preference-based multi-objective optimization

Abstract Recently, multi-objective evolutionary algorithms (MOEAs) have been widely explored and applied to many real-world problems. Particularly, preference-based MOEAs are among the mostly studied. Several preference-based optimization algorithms have already been proposed in literature. However, most existing studies focus on how to locate the region of interest (ROI) and how to control the size of ROI, and overlook the relationship between preference information and distribution of the final solutions. Given that the distribution of the final solutions is also an important factor, in this paper, we propose a new preference-based MOEAs called MOEA/D-AWV using an adaptive weight vector generation strategy (AWV). The weight vectors are generated adaptively by the decision maker’s preference, and finally guide the solutions to converge to a preferred distribution. Solutions will converge to the reference point as close as possible with the AWV strategy, which will lead to the loss of diversity. In order to prevent the search process from being trapped at local optima, we propose an adaptive parameter tuning scheme (APT) to maintain diversity during the search process. In addition, since the distribution of weight vectors should adapt to the changes of decision makers’ preference, the APT scheme can help algorithm find desired results in different scenarios. Compared with five state-of-the-art preference-based MOEAs on 23 test instances, MOEA/D-AWV achieves the best performance. Especially, in many-objective optimization problems with high-dimensional objective space, our proposed MOEA/D-AWV still shows a competitive performance.

[1]  David A. Van Veldhuizen,et al.  Evolutionary Computation and Convergence to a Pareto Front , 1998 .

[2]  Markus Olhofer,et al.  Reference vector based a posteriori preference articulation for evolutionary multiobjective optimization , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[3]  Thomas Bäck,et al.  Preference-based multiobjective optimization using truncated expected hypervolume improvement , 2016, 2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD).

[4]  Xuesong Yan,et al.  Contaminant source identification of water distribution networks using cultural algorithm , 2017, Concurr. Comput. Pract. Exp..

[5]  Ian Griffin,et al.  A Comparative Study of Progressive Preference Articulation Techniques for Multiobjective Optimisation , 2007, EMO.

[6]  Ponnuthurai N. Suganthan,et al.  Optimal reactive power dispatch with uncertainties in load demand and renewable energy sources adopting scenario-based approach , 2019, Appl. Soft Comput..

[7]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.

[8]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[9]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[10]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[11]  Qingfu Zhang,et al.  Multiobjective optimization Test Instances for the CEC 2009 Special Session and Competition , 2009 .

[12]  Carlos A. Coello Coello,et al.  Handling preferences in evolutionary multiobjective optimization: a survey , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[13]  Ali Wagdy Mohamed,et al.  Real-parameter unconstrained optimization based on enhanced fitness-adaptive differential evolution algorithm with novel mutation , 2017, Soft Computing.

[14]  Shuai Wang,et al.  Integrating Weight Assignment Strategies With NSGA-II for Supporting User Preference Multiobjective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[15]  John E. Dennis,et al.  Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems , 1998, SIAM J. Optim..

[16]  Julius Zilinskas,et al.  A preference-based multi-objective evolutionary algorithm R-NSGA-II with stochastic local search , 2016, Central European Journal of Operations Research.

[17]  Jinhua Zheng,et al.  A preference-based multi-objective evolutionary algorithm using preference selection radius , 2017, Soft Comput..

[18]  Tao Zhang,et al.  Evolutionary Many-Objective Optimization: A Comparative Study of the State-of-the-Art , 2018, IEEE Access.

[19]  Xiaodong Li,et al.  Reference point based multi-objective optimization through decomposition , 2012, 2012 IEEE Congress on Evolutionary Computation.

[20]  Qingfu Zhang,et al.  Comparison between MOEA/D and NSGA-III on a set of novel many and multi-objective benchmark problems with challenging difficulties , 2019, Swarm Evol. Comput..

[21]  Xuesong Yan,et al.  Modified NSGA-III for sensor placement in water distribution system , 2020, Inf. Sci..

[22]  Francisco Herrera,et al.  Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power , 2010, Inf. Sci..

[23]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[24]  Bernhard Sendhoff,et al.  A Reference Vector Guided Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[25]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[26]  Marco Laumanns,et al.  Scalable multi-objective optimization test problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[27]  Jinhua Zheng,et al.  Decomposing the user-preference in multiobjective optimization , 2016, Soft Comput..

[28]  Peter J. Fleming,et al.  Preference-Inspired Coevolutionary Algorithms for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[29]  Qingfu Zhang,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 RM-MEDA: A Regularity Model-Based Multiobjective Estimation of , 2022 .

[30]  Alex S. Fukunaga,et al.  Success-history based parameter adaptation for Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[31]  Qingfu Zhang,et al.  Decomposition-Based Algorithms Using Pareto Adaptive Scalarizing Methods , 2016, IEEE Transactions on Evolutionary Computation.

[32]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[33]  Marouane Kessentini,et al.  Preference Incorporation in Evolutionary Multiobjective Optimization , 2015 .

[34]  Xiaodong Li,et al.  On decomposition methods in interactive user-preference based optimization , 2017, Appl. Soft Comput..

[35]  Maoguo Gong,et al.  A multiobjective box-covering algorithm for fractal modularity on complex networks , 2017, Appl. Soft Comput..

[36]  Dun-Wei Gong,et al.  Evolutionary algorithms with preference polyhedron for interval multi-objective optimization problems , 2013, Inf. Sci..

[37]  Xuesong Yan,et al.  Spark-based intelligent parameter inversion method for prestack seismic data , 2019, Neural Computing and Applications.

[38]  Tao Zhang,et al.  Localized Weighted Sum Method for Many-Objective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[39]  Kalyanmoy Deb,et al.  Reference point based multi-objective optimization using evolutionary algorithms , 2006, GECCO.

[40]  Lothar Thiele,et al.  A Preference-Based Evolutionary Algorithm for Multi-Objective Optimization , 2009, Evolutionary Computation.

[41]  Bo Zhang,et al.  Balancing Convergence and Diversity in Decomposition-Based Many-Objective Optimizers , 2016, IEEE Transactions on Evolutionary Computation.

[42]  Carlos A. Coello Coello,et al.  g-dominance: Reference point based dominance for multiobjective metaheuristics , 2009, Eur. J. Oper. Res..

[43]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[44]  Ponnuthurai Nagaratnam Suganthan,et al.  $I_{\rm SDE}$ +—An Indicator for Multi and Many-Objective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[45]  Heng Zhang,et al.  External archive matching strategy for MOEA/D , 2018, Soft Comput..

[46]  Xin Yao,et al.  Integration of Preferences in Decomposition Multiobjective Optimization , 2017, IEEE Transactions on Cybernetics.

[47]  Marouane Kessentini,et al.  Chapter Four - Preference Incorporation in Evolutionary Multiobjective Optimization: A Survey of the State-of-the-Art , 2015, Adv. Comput..

[48]  Qingfu Zhang,et al.  Interactive MOEA/D for multi-objective decision making , 2011, GECCO '11.

[49]  Xiao-Liang Shen,et al.  A hybrid particle swarm optimization algorithm using adaptive learning strategy , 2018, Inf. Sci..

[50]  Kalyanmoy Deb,et al.  Integrating User Preferences into Evolutionary Multi-Objective Optimization , 2005 .

[51]  Lily Rachmawati,et al.  Preference Incorporation in Multi-objective Evolutionary Algorithms: A Survey , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[52]  Wei Li,et al.  A self-feedback strategy differential evolution with fitness landscape analysis , 2018, Soft Comput..

[53]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[54]  Khaled Ghédira,et al.  The r-Dominance: A New Dominance Relation for Interactive Evolutionary Multicriteria Decision Making , 2010, IEEE Transactions on Evolutionary Computation.

[55]  Xiaodong Li,et al.  Integrating user preferences and decomposition methods for many-objective optimization , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).