Manifold dimension reduction based clustering for multi-objective evolutionary algorithm

Real world optimization problems always possess multiple objectives which are conflict in nature. Multi-objective evolutionary algorithms (MOEAs), which provide a group of solutions in region of Pareto front, increasingly draw researchers attention for their excellent performance. In this regard, solutions with a wide diversity would be more favored as they give decision makers more choices to evaluate upon their problems. Based on the insight of investigating the evolution, the Pareto front often lies in a manifold space, not Euclidian space. However, most MOEAs utilize Euclidian distance as a sole mechanism to keep a wide range of diversity for solutions, which is not suitable somewhat from this aspect. To this end, manifold dimension reduction algorithm which has the ability to map solutions in the same front of objective space into Euclidian space is adapted in further. And then, general clustering algorithm are utilized. At the end, we use this technology to replace the crowding distance technology in NSGA-II to choose individuals when there is not enough slots in mating selection process. Based on a range of experiments over benchmark problems against state-of-the-art, it is fully expected benefit of performance improvement will be more significant when applied in many objectives optimization problems. This will be pursuit in our future study.

[1]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[2]  Sam Kwong,et al.  A general framework for evolutionary multiobjective optimization via manifold learning , 2014, Neurocomputing.

[3]  David S. Todd,et al.  MULTIPLE CRITERIA GENETIC ALGORITHMS IN ENGINEERING DESIGN AND OPERATION , 1997 .

[4]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[5]  Kazuhiro Nakahashi,et al.  Aerodynamic Shape Optimization of Supersonic Wings by Adaptive Range Multiobjective Genetic Algorithms , 2001, EMO.

[6]  Gary G. Yen,et al.  Ranking many-objective Evolutionary Algorithms using performance metrics ensemble , 2013, 2013 IEEE Congress on Evolutionary Computation.

[7]  Piotr Czyzżak,et al.  Pareto simulated annealing—a metaheuristic technique for multiple‐objective combinatorial optimization , 1998 .

[8]  Xin Yao,et al.  Many-Objective Evolutionary Algorithms , 2015, ACM Comput. Surv..

[9]  Zhang Yi,et al.  A Local Non-Negative Pursuit Method for Intrinsic Manifold Structure Preservation , 2014, AAAI.

[10]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[11]  G. J. Mitchell,et al.  Principles and procedures of statistics: A biometrical approach , 1981 .

[12]  Joshua B. Tenenbaum,et al.  The Isomap Algorithm and Topological Stability , 2002, Science.

[13]  Kalyanmoy Deb,et al.  Mechanical Component Design for Multiple Objectives Using Elitist Non-dominated Sorting GA , 2000, PPSN.

[14]  Mikhail Belkin,et al.  Towards a theoretical foundation for Laplacian-based manifold methods , 2005, J. Comput. Syst. Sci..

[15]  Qingfu Zhang,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 RM-MEDA: A Regularity Model-Based Multiobjective Estimation of , 2022 .

[16]  Kilian Q. Weinberger,et al.  Unsupervised Learning of Image Manifolds by Semidefinite Programming , 2004, CVPR.

[17]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[18]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[19]  Mikhail Belkin,et al.  Convergence of Laplacian Eigenmaps , 2006, NIPS.

[20]  Jiancheng Lv,et al.  Manifold Alignment Based on Sparse Local Structures of More Corresponding Pairs , 2013, IJCAI.

[21]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[22]  Ulrike von Luxburg,et al.  From Graphs to Manifolds - Weak and Strong Pointwise Consistency of Graph Laplacians , 2005, COLT.

[23]  Mikhail Belkin,et al.  Consistency of spectral clustering , 2008, 0804.0678.

[24]  Deniz Erdogmus,et al.  Locally Defined Principal Curves and Surfaces , 2011, J. Mach. Learn. Res..

[25]  John A. W. McCall,et al.  Multi-objective Optimisation of Cancer Chemotherapy Using Evolutionary Algorithms , 2001, EMO.

[26]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[27]  Peter J. Fleming,et al.  Multiobjective optimization and multiple constraint handling with evolutionary algorithms. II. Application example , 1998, IEEE Trans. Syst. Man Cybern. Part A.

[28]  Gary G. Yen,et al.  Performance Metric Ensemble for Multiobjective Evolutionary Algorithms , 2014, IEEE Transactions on Evolutionary Computation.

[29]  R. Tsai,et al.  Reconstruction of damaged corneas by transplantation of autologous limbal epithelial cells. , 2000, The New England journal of medicine.

[30]  H. Ishibuchi,et al.  Multi-objective genetic algorithm and its applications to flowshop scheduling , 1996 .

[31]  C.S. Chang,et al.  Genetic algorithm based bicriterion optimisation for traction substations in DC railway system , 1995, Proceedings of 1995 IEEE International Conference on Evolutionary Computation.

[32]  A. Singer From graph to manifold Laplacian: The convergence rate , 2006 .

[33]  Hujun Yin,et al.  Learning Nonlinear Principal Manifolds by Self-Organising Maps , 2008 .

[34]  James H. Torrie,et al.  Principles and procedures of statistics: a biometrical approach (2nd ed) , 1980 .

[35]  Jason R. Schott Fault Tolerant Design Using Single and Multicriteria Genetic Algorithm Optimization. , 1995 .

[36]  Marco Laumanns,et al.  Scalable multi-objective optimization test problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[37]  Xuelong Li,et al.  A Class of Manifold Regularized Multiplicative Update Algorithms for Image Clustering , 2015, IEEE Transactions on Image Processing.

[38]  Zhang Yi,et al.  Manifold-Based Learning and Synthesis , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).