On the Norm of Dominant Difference for Many-Objective Particle Swarm Optimization

Recent studies in multiobjective particle swarm optimization (PSO) have the tendency to employ Pareto-based technique, which has a certain effect. However, they will encounter difficulties in their scalability upon many-objective optimization problems (MaOPs) due to the poor discriminability of Pareto optimality, which will affect the selection of leaders, thereby deteriorating the effectiveness of the algorithm. This paper presents a new scheme of discriminating the solutions in objective space. Based on the properties of Pareto optimality, we propose the dominant difference of a solution, which can demonstrate its dominance in every dimension. By investigating the norm of dominant difference among the entire population, the discriminability between the candidates that are difficult to obtain in the objective space is obtained indirectly. By integrating it into PSO, we gained a novel algorithm named many-objective PSO based on the norm of dominant difference (MOPSO/DD) for dealing with MaOPs. Moreover, we design a Lp-norm-based density estimator which makes MOPSO/DD not only have good convergence and diversity but also have lower complexity. Experiments on benchmark problems demonstrate that our proposal is competitive with respect to the state-of-the-art MOPSOs and multiobjective evolutionary algorithms.

[1]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[2]  Carlos A. Coello Coello,et al.  MOPSOhv: A new hypervolume-based multi-objective particle swarm optimizer , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[3]  Jun Zhang,et al.  DECAL: Decomposition-Based Coevolutionary Algorithm for Many-Objective Optimization , 2019, IEEE Transactions on Cybernetics.

[4]  Lishan Kang,et al.  A New Evolutionary Algorithm for Solving Many-Objective Optimization Problems , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[5]  Teresa Bernarda Ludermir,et al.  Many Objective Particle Swarm Optimization , 2016, Inf. Sci..

[6]  Yujia Wang,et al.  Particle swarm optimization with preference order ranking for multi-objective optimization , 2009, Inf. Sci..

[7]  Mengjie Zhang,et al.  PSO for feature construction and binary classification , 2013, GECCO '13.

[8]  Khaled Ghédira,et al.  The r-Dominance: A New Dominance Relation for Interactive Evolutionary Multicriteria Decision Making , 2010, IEEE Transactions on Evolutionary Computation.

[9]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[10]  Heike Trautmann,et al.  On the properties of the R2 indicator , 2012, GECCO '12.

[11]  Xiaoyan Sun,et al.  Indicator-based set evolution particle swarm optimization for many-objective problems , 2016, Soft Comput..

[12]  Yuhui Shi,et al.  Particle Swarm Optimization With Interswarm Interactive Learning Strategy , 2016, IEEE Transactions on Cybernetics.

[13]  Yuping Wang,et al.  A new multi-objective particle swarm optimization algorithm based on decomposition , 2015, Inf. Sci..

[14]  Saúl Zapotecas Martínez,et al.  A multi-objective particle swarm optimizer based on decomposition , 2011, GECCO '11.

[15]  Lucas Bradstreet,et al.  A Fast Way of Calculating Exact Hypervolumes , 2012, IEEE Transactions on Evolutionary Computation.

[16]  Aurora Trinidad Ramirez Pozo,et al.  Measuring the convergence and diversity of CDAS Multi-Objective Particle Swarm Optimization Algorithms: A study of many-objective problems , 2012, Neurocomputing.

[17]  John A. W. McCall,et al.  D2MOPSO: MOPSO Based on Decomposition and Dominance with Archiving Using Crowding Distance in Objective and Solution Spaces , 2014, Evolutionary Computation.

[18]  Hisao Ishibuchi,et al.  Performance of Decomposition-Based Many-Objective Algorithms Strongly Depends on Pareto Front Shapes , 2017, IEEE Transactions on Evolutionary Computation.

[19]  Li Li,et al.  An improved decomposition-based multiobjective evolutionary algorithm with a better balance of convergence and diversity , 2017, Appl. Soft Comput..

[20]  Gaoping Wang,et al.  Fuzzy-Dominance and Its Application in Evolutionary Many Objective Optimization , 2007, 2007 International Conference on Computational Intelligence and Security Workshops (CISW 2007).

[21]  Hisao Ishibuchi,et al.  Review of coevolutionary developments of evolutionary multi-objective and many-objective algorithms and test problems , 2014, 2014 IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making (MCDM).

[22]  Hisao Ishibuchi,et al.  Reference Point Specification in Inverted Generational Distance for Triangular Linear Pareto Front , 2018, IEEE Transactions on Evolutionary Computation.

[23]  Wang Hu,et al.  Many-Objective Particle Swarm Optimization Using Two-Stage Strategy and Parallel Cell Coordinate System , 2017, IEEE Transactions on Cybernetics.

[24]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[25]  U. Aickelin,et al.  Parallel Problem Solving from Nature - PPSN VIII , 2004, Lecture Notes in Computer Science.

[26]  Marcus Gallagher,et al.  Sampling Techniques and Distance Metrics in High Dimensional Continuous Landscape Analysis: Limitations and Improvements , 2014, IEEE Transactions on Evolutionary Computation.

[27]  Ashutosh Tiwari,et al.  Multi-level and multi-objective design optimisation of a MEMS bandpass filter , 2017, Appl. Soft Comput..

[28]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[29]  Steven Skiena,et al.  The Algorithm Design Manual , 2020, Texts in Computer Science.

[30]  Yuren Zhou,et al.  Ranking Vectors by Means of the Dominance Degree Matrix , 2017, IEEE Transactions on Evolutionary Computation.

[31]  Jun Zhang,et al.  An External Archive-Guided Multiobjective Particle Swarm Optimization Algorithm , 2017, IEEE Transactions on Cybernetics.

[32]  Xin Yao,et al.  Diversity Assessment in Many-Objective Optimization , 2017, IEEE Transactions on Cybernetics.

[33]  H. T. Kung,et al.  On the Average Number of Maxima in a Set of Vectors and Applications , 1978, JACM.

[34]  Li Li,et al.  Research on hydropower station optimal scheduling considering ecological water demand , 2013, 2013 IEEE Symposium on Computational Intelligence for Engineering Solutions (CIES).

[35]  Hasan Selim,et al.  A Multi-objective, simulation-based optimization framework for supply chains with premium freights , 2017, Expert Syst. Appl..

[36]  Bo Guo,et al.  An enhanced preference-inspired co-evolutionary algorithm using orthogonal design and an ε-dominance archiving strategy , 2016 .

[37]  Dunwei Gong,et al.  A Set-Based Genetic Algorithm for Interval Many-Objective Optimization Problems , 2018, IEEE Transactions on Evolutionary Computation.

[38]  Shengxiang Yang,et al.  A Grid-Based Evolutionary Algorithm for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[39]  Qingfu Zhang,et al.  An Evolutionary Many-Objective Optimization Algorithm Based on Dominance and Decomposition , 2015, IEEE Transactions on Evolutionary Computation.

[40]  Carlos A. Coello Coello,et al.  Study of preference relations in many-objective optimization , 2009, GECCO.

[41]  Carlos A. Coello Coello,et al.  Using the Averaged Hausdorff Distance as a Performance Measure in Evolutionary Multiobjective Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[42]  Ye Tian,et al.  PlatEMO: A MATLAB Platform for Evolutionary Multi-Objective Optimization [Educational Forum] , 2017, IEEE Computational Intelligence Magazine.

[43]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[44]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[45]  Jiannong Cao,et al.  Multiple Populations for Multiple Objectives: A Coevolutionary Technique for Solving Multiobjective Optimization Problems , 2013, IEEE Transactions on Cybernetics.

[46]  Marco Laumanns,et al.  Scalable multi-objective optimization test problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[47]  Yuren Zhou,et al.  A Scalar Projection and Angle-Based Evolutionary Algorithm for Many-Objective Optimization Problems , 2019, IEEE Transactions on Cybernetics.

[48]  Jun Zhang,et al.  Genetic Learning Particle Swarm Optimization , 2016, IEEE Transactions on Cybernetics.

[49]  Jun Zhang,et al.  Particle Swarm Optimization With a Balanceable Fitness Estimation for Many-Objective Optimization Problems , 2018, IEEE Transactions on Evolutionary Computation.

[50]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[51]  Charu C. Aggarwal,et al.  On the Surprising Behavior of Distance Metrics in High Dimensional Spaces , 2001, ICDT.

[52]  Alexander G. Loukianov,et al.  Particle Swarm Optimization for Discrete-Time Inverse Optimal Control of a Doubly Fed Induction Generator , 2013, IEEE Transactions on Cybernetics.

[53]  Hisao Ishibuchi,et al.  Behavior of Multiobjective Evolutionary Algorithms on Many-Objective Knapsack Problems , 2015, IEEE Transactions on Evolutionary Computation.

[54]  Yaochu Jin,et al.  A Many-Objective Evolutionary Algorithm Using A One-by-One Selection Strategy , 2017, IEEE Transactions on Cybernetics.

[55]  Xin Yao,et al.  Two_Arch2: An Improved Two-Archive Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[56]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[57]  Enrique Alba,et al.  SMPSO: A new PSO-based metaheuristic for multi-objective optimization , 2009, 2009 IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making(MCDM).

[58]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation) , 2006 .

[59]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[60]  Xin Yao,et al.  Stochastic Ranking Algorithm for Many-Objective Optimization Based on Multiple Indicators , 2016, IEEE Transactions on Evolutionary Computation.

[61]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[62]  Li Li,et al.  Multi-objective particle swarm optimization based on global margin ranking , 2017, Inf. Sci..

[63]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[64]  C.A. Coello Coello,et al.  MOPSO: a proposal for multiple objective particle swarm optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).