A Grid-Based Evolutionary Algorithm for Many-Objective Optimization

Balancing convergence and diversity plays a key role in evolutionary multiobjective optimization (EMO). Most current EMO algorithms perform well on problems with two or three objectives, but encounter difficulties in their scalability to many-objective optimization. This paper proposes a grid-based evolutionary algorithm (GrEA) to solve many-objective optimization problems. Our aim is to exploit the potential of the grid-based approach to strengthen the selection pressure toward the optimal direction while maintaining an extensive and uniform distribution among solutions. To this end, two concepts-grid dominance and grid difference-are introduced to determine the mutual relationship of individuals in a grid environment. Three grid-based criteria, i.e., grid ranking, grid crowding distance, and grid coordinate point distance, are incorporated into the fitness of individuals to distinguish them in both the mating and environmental selection processes. Moreover, a fitness adjustment strategy is developed by adaptively punishing individuals based on the neighborhood and grid dominance relations in order to avoid partial overcrowding as well as guide the search toward different directions in the archive. Six state-of-the-art EMO algorithms are selected as the peer algorithms to validate GrEA. A series of extensive experiments is conducted on 52 instances of nine test problems taken from three test suites. The experimental results show the effectiveness and competitiveness of the proposed GrEA in balancing convergence and diversity. The solution set obtained by GrEA can achieve a better coverage of the Pareto front than that obtained by other algorithms on most of the tested problems. Additionally, a parametric study reveals interesting insights of the division parameter in a grid and also indicates useful values for problems with different characteristics.

[1]  Xin Yao,et al.  Performance Scaling of Multi-objective Evolutionary Algorithms , 2003, EMO.

[2]  Qingfu Zhang,et al.  Framework for Many-Objective Test Problems with Both Simple and Complicated Pareto-Set Shapes , 2011, EMO.

[3]  Carlos A. Coello Coello,et al.  Two novel approaches for many-objective optimization , 2010, IEEE Congress on Evolutionary Computation.

[4]  Dr. Zbigniew Michalewicz,et al.  How to Solve It: Modern Heuristics , 2004 .

[5]  Carlos A. Coello Coello,et al.  On the Influence of the Number of Objectives on the Hardness of a Multiobjective Optimization Problem , 2011, IEEE Transactions on Evolutionary Computation.

[6]  José M. Molina López,et al.  Effective Evolutionary Algorithms for Many-Specifications Attainment: Application to Air Traffic Control Tracking Filters , 2009, IEEE Transactions on Evolutionary Computation.

[7]  Jing J. Liang,et al.  Problem Definitions for Performance Assessment of Multi-objective Optimization Algorithms , 2007 .

[8]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[9]  Kittipong Boonlong,et al.  Compressed-Objective Genetic Algorithm , 2006, PPSN.

[10]  Tapabrata Ray,et al.  A Pareto Corner Search Evolutionary Algorithm and Dimensionality Reduction in Many-Objective Optimization Problems , 2011, IEEE Transactions on Evolutionary Computation.

[11]  Jinhua Zheng,et al.  Spread Assessment for Evolutionary Multi-Objective Optimization , 2009, EMO.

[12]  Qingfu Zhang,et al.  Objective Reduction in Many-Objective Optimization: Linear and Nonlinear Algorithms , 2013, IEEE Transactions on Evolutionary Computation.

[13]  David W. Corne,et al.  Techniques for highly multiobjective optimisation: some nondominated points are better than others , 2007, GECCO '07.

[14]  Jinhua Zheng,et al.  Enhancing Diversity for Average Ranking Method in Evolutionary Many-Objective Optimization , 2010, PPSN.

[15]  Kiyoshi Tanaka,et al.  Improved S-CDAs using crossover controlling the number of crossed genes for many-objective optimization , 2011, GECCO '11.

[16]  Nicola Beume,et al.  Pareto-, Aggregation-, and Indicator-Based Methods in Many-Objective Optimization , 2007, EMO.

[17]  David W. Corne,et al.  Quantifying the Effects of Objective Space Dimension in Evolutionary Multiobjective Optimization , 2007, EMO.

[18]  Kiyoshi Tanaka,et al.  Adaptive Objective Space Partitioning Using Conflict Information for Many-Objective Optimization , 2011, EMO.

[19]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.

[20]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[21]  Gary G. Yen,et al.  Dynamic multiobjective evolutionary algorithm: adaptive cell-based rank and density estimation , 2003, IEEE Trans. Evol. Comput..

[22]  Peter J. Fleming,et al.  On the Evolutionary Optimization of Many Conflicting Objectives , 2007, IEEE Transactions on Evolutionary Computation.

[23]  H. Kita,et al.  Failure of Pareto-based MOEAs: does non-dominated really mean near to optimal? , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[24]  Sanaz Mostaghim,et al.  Distance Based Ranking in Many-Objective Particle Swarm Optimization , 2008, PPSN.

[25]  Carlos A. Coello Coello,et al.  Study of preference relations in many-objective optimization , 2009, GECCO.

[26]  Xiaodong Li,et al.  Using a distance metric to guide PSO algorithms for many-objective optimization , 2009, GECCO.

[27]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[28]  Jonathan E. Fieldsend,et al.  Visualisation and ordering of many-objective populations , 2010, IEEE Congress on Evolutionary Computation.

[29]  Marco Laumanns,et al.  SPEA2: Improving the Strength Pareto Evolutionary Algorithm For Multiobjective Optimization , 2002 .

[30]  Hong Li,et al.  A modification to MOEA/D-DE for multiobjective optimization problems with complicated Pareto sets , 2012, Inf. Sci..

[31]  Hisao Ishibuchi,et al.  Many-Objective Test Problems to Visually Examine the Behavior of Multiobjective Evolution in a Decision Space , 2010, PPSN.

[32]  J. Branke,et al.  Guidance in evolutionary multi-objective optimization , 2001 .

[33]  Mario Köppen,et al.  Substitute Distance Assignments in NSGA-II for Handling Many-objective Optimization Problems , 2007, EMO.

[34]  P. Reed,et al.  Managing population and drought risks using many‐objective water portfolio planning under uncertainty , 2009 .

[35]  Jinhua Zheng,et al.  A grid-based fitness strategy for evolutionary many-objective optimization , 2010, GECCO '10.

[36]  Evan J. Hughes,et al.  Evolutionary many-objective optimisation: many once or one many? , 2005, 2005 IEEE Congress on Evolutionary Computation.

[37]  Mitsuo Gen,et al.  Specification of Genetic Search Directions in Cellular Multi-objective Genetic Algorithms , 2001, EMO.

[38]  Kalyanmoy Deb,et al.  Evaluating the -Domination Based Multi-Objective Evolutionary Algorithm for a Quick Computation of Pareto-Optimal Solutions , 2005, Evolutionary Computation.

[39]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[40]  Martin J. Oates,et al.  The Pareto Envelope-Based Selection Algorithm for Multi-objective Optimisation , 2000, PPSN.

[41]  Lily Rachmawati,et al.  Dynamic resizing for grid-based archiving in evolutionary multi objective optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[42]  Frank Neumann,et al.  On the Effects of Adding Objectives to Plateau Functions , 2009, IEEE Transactions on Evolutionary Computation.

[43]  Soon-Thiam Khu,et al.  An Investigation on Preference Order Ranking Scheme for Multiobjective Evolutionary Optimization , 2007, IEEE Transactions on Evolutionary Computation.

[44]  Kalyanmoy Deb,et al.  Running performance metrics for evolutionary multi-objective optimizations , 2002 .

[45]  Marco Laumanns,et al.  Combining Convergence and Diversity in Evolutionary Multiobjective Optimization , 2002, Evolutionary Computation.

[46]  Rolf Drechsler,et al.  Robust Multi-Objective Optimization in High Dimensional Spaces , 2007, EMO.

[47]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[48]  Yuren Zhou,et al.  Convergence analysis of a self-adaptive multi-objective evolutionary algorithm based on grids , 2007, Inf. Process. Lett..

[49]  Murat Köksalan,et al.  A Territory Defining Multiobjective Evolutionary Algorithms and Preference Incorporation , 2010, IEEE Transactions on Evolutionary Computation.

[50]  Kiyoshi Tanaka,et al.  Adaptive ∈-ranking on MNK-Landscapes , 2009, 2009 IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making(MCDM).

[51]  Evan J. Hughes,et al.  Many-objective directed evolutionary line search , 2011, GECCO '11.

[52]  Peter J. Fleming,et al.  Preference-Driven Co-evolutionary Algorithms Show Promise for Many-Objective Optimisation , 2011, EMO.

[53]  Hisao Ishibuchi,et al.  Evolutionary many-objective optimization by NSGA-II and MOEA/D with large populations , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[54]  Hisao Ishibuchi,et al.  Evolutionary many-objective optimization: A short review , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[55]  E. Hughes Multiple single objective Pareto sampling , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[56]  Marco Farina,et al.  A fuzzy definition of "optimality" for many-criteria optimization problems , 2004, IEEE Trans. Syst. Man Cybern. Part A.

[57]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[58]  Bernhard Sendhoff,et al.  A systems approach to evolutionary multiobjective structural optimization and beyond , 2009, IEEE Computational Intelligence Magazine.

[59]  David W. Corne,et al.  Approximating the Nondominated Front Using the Pareto Archived Evolution Strategy , 2000, Evolutionary Computation.

[60]  O. Teytaud How entropy-theorems can show that approximating high-dim Pareto-fronts is too hard , 2006 .

[61]  Dirk Thierens,et al.  The balance between proximity and diversity in multiobjective evolutionary algorithms , 2003, IEEE Trans. Evol. Comput..

[62]  Lishan Kang,et al.  A New Evolutionary Algorithm for Solving Many-Objective Optimization Problems , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[63]  Tobias Friedrich,et al.  An Efficient Algorithm for Computing Hypervolume Contributions , 2010, Evolutionary Computation.

[64]  Daisuke Sasaki,et al.  Visualization and Data Mining of Pareto Solutions Using Self-Organizing Map , 2003, EMO.

[65]  Patrick M. Reed,et al.  Diagnostic Assessment of Search Controls and Failure Modes in Many-Objective Evolutionary Optimization , 2012, Evolutionary Computation.

[66]  Peter J. Fleming,et al.  Diversity Management in Evolutionary Many-Objective Optimization , 2011, IEEE Transactions on Evolutionary Computation.

[67]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[68]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[69]  Carlos A. Coello Coello,et al.  Pareto-adaptive -dominance , 2007, Evolutionary Computation.

[70]  Peter J. Fleming,et al.  Many-Objective Optimization: An Engineering Design Perspective , 2005, EMO.

[71]  Hisao Ishibuchi,et al.  A many-objective test problem for visually examining diversity maintenance behavior in a decision space , 2011, GECCO '11.

[72]  Jouni Lampinen,et al.  Ranking-Dominance and Many-Objective Optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[73]  Marco Laumanns,et al.  A Tutorial on Evolutionary Multiobjective Optimization , 2004, Metaheuristics for Multiobjective Optimisation.

[74]  David W. Corne,et al.  Properties of an adaptive archiving algorithm for storing nondominated vectors , 2003, IEEE Trans. Evol. Comput..

[75]  Kiyoshi Tanaka,et al.  Space partitioning with adaptive ε-ranking and substitute distance assignments: a comparative study on many-objective mnk-landscapes , 2009, GECCO '09.

[76]  Thomas Bäck,et al.  Combining Aggregation with Pareto Optimization: A Case Study in Evolutionary Molecular Design , 2009, EMO.

[77]  R. Lyndon While,et al.  A faster algorithm for calculating hypervolume , 2006, IEEE Transactions on Evolutionary Computation.