Self-Organizing Map-Based Weight Design for Decomposition-Based Many-Objective Evolutionary Algorithm

Many-objective optimization problems (MaOPs), in which the number of objectives is greater than three, are undoubtedly more challenging compared with the bi- and tri-objective optimization problems. Currently, the decomposition-based evolutionary algorithms have shown promising performance in dealing with MaOPs. Nevertheless, these algorithms need to design the weight vectors, which has significant effects on the performance of the algorithms. In particular, when the Pareto front of problems is incomplete, these algorithms cannot obtain a set of uniformly distribution solutions by using the conventional weight design methods. In the literature, it is well-known that the self-organizing map (SOM) can preserve the topological properties of the input data by using the neighborhood function, and its display is more uniform than the probability density of the input data. This phenomenon is advantageous to generate a set of uniformly distributed weight vectors based on the distribution of the individuals. Therefore, we will propose a novel weight design method based on SOM, which can be integrated with most of the decomposition-based algorithms for solving MaOPs. In this paper, we choose the existing state-of-the-art decomposition-based algorithms as examples for such integration. This integrated algorithms are then compared with some state-of-the-art algorithms on eleven redundancy problems and eight nonredundancy problems, respectively. The experimental results show the effectiveness of the proposed approach.

[1]  Daisuke Sasaki,et al.  Visualization and Data Mining of Pareto Solutions Using Self-Organizing Map , 2003, EMO.

[2]  José M. Molina López,et al.  Effective Evolutionary Algorithms for Many-Specifications Attainment: Application to Air Traffic Control Tracking Filters , 2009, IEEE Transactions on Evolutionary Computation.

[3]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[4]  Patrick M. Reed,et al.  Borg: An Auto-Adaptive Many-Objective Evolutionary Computing Framework , 2013, Evolutionary Computation.

[5]  Marco Raugi,et al.  A filter based neuron model for adaptive incremental learning of self-organizing maps , 2011, Neurocomputing.

[6]  Juha Vesanto,et al.  SOM-based data visualization methods , 1999, Intell. Data Anal..

[7]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[8]  Ujjwal Maulik,et al.  A Survey of Multiobjective Evolutionary Algorithms for Data Mining: Part I , 2014, IEEE Transactions on Evolutionary Computation.

[9]  Yiu-ming Cheung,et al.  Objective Extraction for Many-Objective Optimization Problems: Algorithm and Test Problems , 2016, IEEE Transactions on Evolutionary Computation.

[10]  Lothar Thiele,et al.  Multiobjective Optimization Using Evolutionary Algorithms - A Comparative Case Study , 1998, PPSN.

[11]  Esa Alhoniemi,et al.  Clustering of the self-organizing map , 2000, IEEE Trans. Neural Networks Learn. Syst..

[12]  Hai-Lin Liu,et al.  A Novel Weight Design in Multi-objective Evolutionary Algorithm , 2010, 2010 International Conference on Computational Intelligence and Security.

[13]  Qingfu Zhang,et al.  An Evolutionary Many-Objective Optimization Algorithm Based on Dominance and Decomposition , 2015, IEEE Transactions on Evolutionary Computation.

[14]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[15]  Xin Yao,et al.  Many-Objective Evolutionary Algorithms , 2015, ACM Comput. Surv..

[16]  Frederico G. Guimarães,et al.  A comparison of dominance criteria in many-objective optimization problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[17]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[18]  Tapabrata Ray,et al.  A Pareto Corner Search Evolutionary Algorithm and Dimensionality Reduction in Many-Objective Optimization Problems , 2011, IEEE Transactions on Evolutionary Computation.

[19]  Fang Liu,et al.  MOEA/D with Adaptive Weight Adjustment , 2014, Evolutionary Computation.

[20]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[21]  Y. F. Li,et al.  Feature encoding for unsupervised segmentation of color images , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[22]  Xiaoli Wang,et al.  MOEA/D with Adaptive Weight Vector Design , 2015, 2015 11th International Conference on Computational Intelligence and Security (CIS).

[23]  Jiang Siwei,et al.  Multiobjective optimization by decomposition with Pareto-adaptive weight vectors , 2011, 2011 Seventh International Conference on Natural Computation.

[24]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[25]  Kay Chen Tan,et al.  A multiobjective evolutionary algorithm using dynamic weight design method , 2012 .

[26]  Erkki Oja,et al.  Engineering applications of the self-organizing map , 1996, Proc. IEEE.

[27]  Yiu-ming Cheung,et al.  Rival-Model Penalized Self-Organizing Map , 2007, IEEE Transactions on Neural Networks.

[28]  Dominik R. Dersch,et al.  Asymptotic level density in topological feature maps , 1995, IEEE Trans. Neural Networks.

[29]  Carlos A. Coello Coello,et al.  On the Influence of the Number of Objectives on the Hardness of a Multiobjective Optimization Problem , 2011, IEEE Transactions on Evolutionary Computation.

[30]  Shengli Xie,et al.  On Solving WCDMA Network Planning Using Iterative Power Control Scheme and Evolutionary Multiobjective Algorithm [Application Notes] , 2014, IEEE Computational Intelligence Magazine.

[31]  Tapabrata Ray,et al.  Six-Sigma Robust Design Optimization Using a Many-Objective Decomposition-Based Evolutionary Algorithm , 2015, IEEE Transactions on Evolutionary Computation.

[32]  Mario Köppen,et al.  Many-Objective Particle Swarm Optimization by Gradual Leader Selection , 2007, ICANNGA.

[33]  Hui Li,et al.  An Adaptive Evolutionary Multi-Objective Approach Based on Simulated Annealing , 2011, Evolutionary Computation.

[34]  Xin Yao,et al.  Corner Sort for Pareto-Based Many-Objective Optimization , 2014, IEEE Transactions on Cybernetics.

[35]  Shengli Xie,et al.  Optimal WCDMA network planning by multiobjective evolutionary algorithm with problem-specific genetic operation , 2014, Knowledge and Information Systems.

[36]  Arthur Flexer,et al.  On the use of self-organizing maps for clustering and visualization , 1999, Intell. Data Anal..

[37]  Hisao Ishibuchi,et al.  Behavior of Multiobjective Evolutionary Algorithms on Many-Objective Knapsack Problems , 2015, IEEE Transactions on Evolutionary Computation.

[38]  Peter J. Fleming,et al.  Generalized Decomposition , 2013, EMO.

[39]  Qingfu Zhang,et al.  A Self-Organizing Multiobjective Evolutionary Algorithm , 2016, IEEE Transactions on Evolutionary Computation.

[40]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point Based Nondominated Sorting Approach, Part II: Handling Constraints and Extending to an Adaptive Approach , 2014, IEEE Transactions on Evolutionary Computation.

[41]  Qingfu Zhang,et al.  Decomposition of a Multiobjective Optimization Problem Into a Number of Simple Multiobjective Subproblems , 2014, IEEE Transactions on Evolutionary Computation.

[42]  Shengxiang Yang,et al.  A Grid-Based Evolutionary Algorithm for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[43]  John E. Dennis,et al.  Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems , 1998, SIAM J. Optim..

[44]  Nicola Beume,et al.  An EMO Algorithm Using the Hypervolume Measure as Selection Criterion , 2005, EMO.

[45]  Marco Laumanns,et al.  SPEA2: Improving the Strength Pareto Evolutionary Algorithm For Multiobjective Optimization , 2002 .

[46]  Dirk Thierens,et al.  The balance between proximity and diversity in multiobjective evolutionary algorithms , 2003, IEEE Trans. Evol. Comput..

[47]  Lishan Kang,et al.  A New Evolutionary Algorithm for Solving Many-Objective Optimization Problems , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[48]  Hisao Ishibuchi,et al.  Performance of Decomposition-Based Many-Objective Algorithms Strongly Depends on Pareto Front Shapes , 2017, IEEE Transactions on Evolutionary Computation.

[49]  Xiao Zhi Gao,et al.  Self-organizing multiobjective optimization based on decomposition with neighborhood ensemble , 2016, Neurocomputing.

[50]  Tapabrata Ray,et al.  A Decomposition-Based Evolutionary Algorithm for Many Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[51]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[52]  Hisao Ishibuchi,et al.  Pareto Fronts of Many-Objective Degenerate Test Problems , 2016, IEEE Transactions on Evolutionary Computation.

[53]  Teuvo Kohonen,et al.  The self-organizing map , 1990, Neurocomputing.

[54]  Sanaz Mostaghim,et al.  Using ε-Dominance for Hidden and Degenerated Pareto-Fronts , 2015, 2015 IEEE Symposium Series on Computational Intelligence.