MOEA/D with Adaptive Weight Adjustment

Recently, MOEA/D (multi-objective evolutionary algorithm based on decomposition) has achieved great success in the field of evolutionary multi-objective optimization and has attracted a lot of attention. It decomposes a multi-objective optimization problem (MOP) into a set of scalar subproblems using uniformly distributed aggregation weight vectors and provides an excellent general algorithmic framework of evolutionary multi-objective optimization. Generally, the uniformity of weight vectors in MOEA/D can ensure the diversity of the Pareto optimal solutions, however, it cannot work as well when the target MOP has a complex Pareto front (PF; i.e., discontinuous PF or PF with sharp peak or low tail). To remedy this, we propose an improved MOEA/D with adaptive weight vector adjustment (MOEA/D-AWA). According to the analysis of the geometric relationship between the weight vectors and the optimal solutions under the Chebyshev decomposition scheme, a new weight vector initialization method and an adaptive weight vector adjustment strategy are introduced in MOEA/D-AWA. The weights are adjusted periodically so that the weights of subproblems can be redistributed adaptively to obtain better uniformity of solutions. Meanwhile, computing efforts devoted to subproblems with duplicate optimal solution can be saved. Moreover, an external elite population is introduced to help adding new subproblems into real sparse regions rather than pseudo sparse regions of the complex PF, that is, discontinuous regions of the PF. MOEA/D-AWA has been compared with four state of the art MOEAs, namely the original MOEA/D, Adaptive-MOEA/D, -MOEA/D, and NSGA-II on 10 widely used test problems, two newly constructed complex problems, and two many-objective problems. Experimental results indicate that MOEA/D-AWA outperforms the benchmark algorithms in terms of the IGD metric, particularly when the PF of the MOP is complex.

[1]  Xin Yao,et al.  Decomposition-Based Memetic Algorithm for Multiobjective Capacitated Arc Routing Problem , 2011, IEEE Transactions on Evolutionary Computation.

[2]  Chen Chen,et al.  Multi-objective Immune Algorithm with Preference-Based Selection for Reservoir Flood Control Operation , 2015, Water Resources Management.

[3]  Kalyanmoy Deb,et al.  Non-linear Dimensionality Reduction Procedures for Certain Large-Dimensional Multi-objective Optimization Problems: Employing Correntropy and a Novel Maximum Variance Unfolding , 2007, EMO.

[4]  Martin J. Oates,et al.  The Pareto Envelope-Based Selection Algorithm for Multi-objective Optimisation , 2000, PPSN.

[5]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[6]  David E. Goldberg,et al.  Genetic Algorithms, Tournament Selection, and the Effects of Noise , 1995, Complex Syst..

[7]  Tapabrata Ray,et al.  A Pareto Corner Search Evolutionary Algorithm and Dimensionality Reduction in Many-Objective Optimization Problems , 2011, IEEE Transactions on Evolutionary Computation.

[8]  Qingfu Zhang,et al.  Objective Reduction in Many-Objective Optimization: Linear and Nonlinear Algorithms , 2013, IEEE Transactions on Evolutionary Computation.

[9]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.

[10]  John A. W. McCall,et al.  A Novel Smart Multi-Objective Particle Swarm Optimisation Using Decomposition , 2010, PPSN.

[11]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[12]  Hisao Ishibuchi,et al.  Behavior of Multiobjective Evolutionary Algorithms on Many-Objective Knapsack Problems , 2015, IEEE Transactions on Evolutionary Computation.

[13]  Kalyanmoy Deb,et al.  A Fast and Effective Method for Pruning of Non-dominated Solutions in Many-Objective Problems , 2006, PPSN.

[14]  Hisao Ishibuchi,et al.  Evolutionary many-objective optimization: A short review , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[15]  Feng Zou,et al.  Multiobjective Memetic Estimation of Distribution Algorithm Based on an Incremental Tournament Local Searcher , 2014, TheScientificWorldJournal.

[16]  Yiu-ming Cheung,et al.  T-MOEA/D: MOEA/D with Objective Transform in Multi-objective Problems , 2010, 2010 International Conference of Information Science and Management Engineering.

[17]  K. Deb,et al.  On Finding Pareto-Optimal Solutions Through Dimensionality Reduction for Certain Large-Dimensional Multi-Objective Optimization Problems , 2022 .

[18]  A. Messac,et al.  The normalized normal constraint method for generating the Pareto frontier , 2003 .

[19]  Marco Laumanns,et al.  SPEA2: Improving the Strength Pareto Evolutionary Algorithm For Multiobjective Optimization , 2002 .

[20]  Hui Li,et al.  On the differential evolution schemes in MOEA/D , 2010, 2010 Sixth International Conference on Natural Computation.

[21]  Bo Zhang,et al.  Balancing Convergence and Diversity in Decomposition-Based Many-Objective Optimizers , 2016, IEEE Transactions on Evolutionary Computation.

[22]  Maoguo Gong,et al.  ADAPTIVE RANKS CLONE AND k‐NEAREST NEIGHBOR LIST–BASED IMMUNE MULTI‐OBJECTIVE OPTIMIZATION , 2010, Comput. Intell..

[23]  Kok Kiong Tan,et al.  A hybrid estimation of distribution algorithm for solving the multi-objective multiple traveling salesman problem , 2012, 2012 IEEE Congress on Evolutionary Computation.

[24]  Swagatam Das,et al.  SYNTHESIS OF DIFFERENCE PATTERNS FOR MONOPULSE ANTENNAS WITH OPTIMAL COMBINATION OF ARRAY-SIZE AND NUMBER OF SUBARRAYS --- A MULTI-OBJECTIVE OPTIMIZATION APPROACH , 2010, Progress In Electromagnetics Research B.

[25]  Saúl Zapotecas Martínez,et al.  A multi-objective particle swarm optimizer based on decomposition , 2011, GECCO '11.

[26]  Kaisa Miettinen,et al.  A new hybrid mutation operator for multiobjective optimization with differential evolution , 2011, Soft Comput..

[27]  Feng Zhiwei The Research on Multiple-impulse Correction Submunition Multi-objective Optimization Based on MOEA/D , 2010 .

[28]  Qingfu Zhang,et al.  MOEA/D with NBI-style Tchebycheff approach for portfolio management , 2010, IEEE Congress on Evolutionary Computation.

[29]  Qingfu Zhang,et al.  Enhancing MOEA/D with guided mutation and priority update for multi-objective optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[30]  Hisao Ishibuchi,et al.  Simultaneous use of different scalarizing functions in MOEA/D , 2010, GECCO '10.

[31]  Peter J. Fleming,et al.  Genetic Algorithms for Multiobjective Optimization: FormulationDiscussion and Generalization , 1993, ICGA.

[32]  Cai Dai,et al.  A New Multiobjective Evolutionary Algorithm Based on Decomposition of the Objective Space for Multiobjective Optimization , 2014, J. Appl. Math..

[33]  Jie Zhang,et al.  Multiobjective optimization by decomposition with Pareto-adaptive weight vectors , 2011, ICNC.

[34]  Martin J. Oates,et al.  PESA-II: region-based selection in evolutionary multiobjective optimization , 2001 .

[35]  Jiang Siwei,et al.  Multiobjective optimization by decomposition with Pareto-adaptive weight vectors , 2011, 2011 Seventh International Conference on Natural Computation.

[36]  Xiangyu Wang,et al.  A Multiobjective Genetic Algorithm Based on a Discrete Selection Procedure , 2015 .

[37]  Hisao Ishibuchi,et al.  Evolutionary many-objective optimization , 2008, 2008 3rd International Workshop on Genetic and Evolving Systems.

[38]  Swagatam Das,et al.  LINEAR ANTENNA ARRAY SYNTHESIS WITH CONSTRAINED MULTI-OBJECTIVE DIFFERENTIAL EVOLUTION , 2010, Progress In Electromagnetics Research B.

[39]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[40]  Fang Liu,et al.  MOEA/D with opposition-based learning for multiobjective optimization problem , 2014, Neurocomputing.

[41]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[42]  David W. Corne,et al.  Multiple objective optimisation applied to route planning , 2011, GECCO '11.

[43]  Kalyanmoy Deb,et al.  Muiltiobjective Optimization Using Nondominated Sorting in Genetic Algorithms , 1994, Evolutionary Computation.

[44]  Qingfu Zhang,et al.  Multi-objective mobile agent-based Sensor Network Routing using MOEA/D , 2010, IEEE Congress on Evolutionary Computation.

[45]  Kalyanmoy Deb,et al.  Self-Adaptive Genetic Algorithms with Simulated Binary Crossover , 2001, Evolutionary Computation.

[46]  Qingfu Zhang,et al.  Expensive Multiobjective Optimization by MOEA/D With Gaussian Process Model , 2010, IEEE Transactions on Evolutionary Computation.

[47]  J. Dennis,et al.  NORMAL-BOUNDARY INTERSECTION: AN ALTERNATE METHOD FOR GENERATING PARETO OPTIMAL POINTS IN MULTICRITERIA OPTIMIZATION PROBLEMS , 1996 .

[48]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[49]  Qingfu Zhang,et al.  The performance of a new version of MOEA/D on CEC09 unconstrained MOP test instances , 2009, 2009 IEEE Congress on Evolutionary Computation.

[50]  C. A. Coello Coello,et al.  Evolutionary multi-objective optimization: a historical view of the field , 2006, IEEE Computational Intelligence Magazine.

[51]  Alex A. Freitas,et al.  Evolutionary Computation , 2002 .

[52]  Hai-Lin Liu,et al.  A Novel Weight Design in Multi-objective Evolutionary Algorithm , 2010, 2010 International Conference on Computational Intelligence and Security.

[53]  David W. Corne,et al.  Approximating the Nondominated Front Using the Pareto Archived Evolution Strategy , 2000, Evolutionary Computation.

[54]  Hisao Ishibuchi,et al.  Adaptation of Scalarizing Functions in MOEA/D: An Adaptive Scalarizing Function-Based Multiobjective Evolutionary Algorithm , 2009, EMO.

[55]  Xin Yao,et al.  A clustering-ranking method for many-objective optimization , 2015, Appl. Soft Comput..

[56]  Li-Chen Fu,et al.  A two-phase evolutionary algorithm for multiobjective mining of classification rules , 2010, IEEE Congress on Evolutionary Computation.

[57]  Hui Li,et al.  An Adaptive Evolutionary Multi-Objective Approach Based on Simulated Annealing , 2011, Evolutionary Computation.

[58]  Qingfu Zhang,et al.  MOEA/D for flowshop scheduling problems , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[59]  Xin Yao,et al.  Parallel Problem Solving from Nature PPSN VI , 2000, Lecture Notes in Computer Science.

[60]  David E. Goldberg,et al.  A niched Pareto genetic algorithm for multiobjective optimization , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[61]  John E. Dennis,et al.  Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems , 1998, SIAM J. Optim..

[62]  Qingfu Zhang,et al.  Multiobjective Combinatorial Optimization by Using Decomposition and Ant Colony , 2012 .

[63]  G. A. Vijayalakshmi Pai,et al.  Metaheuristic multi-objective optimization of constrained futures portfolios for effective risk management , 2014, Swarm Evol. Comput..