Combining Aspiration Level Methods in Multi-objective Programming and Sequential Approximate Optimization using Computational Intelligence

Since Pareto optimal solutions in multi-objective optimization are not unique but makes a set, decision maker (DM) needs to select one of them as a final decision. In this event, DM tries to find a solution making a well balance among multiple objectives. Aspiration level methods support DM to do this in an interactive way, and are very simple, easy and intuitive for DMs. Their effectiveness has been observed through various fields of practical problems. One of authors proposed the satisficing trade-off method early in '80s, and applied it to several kinds of practical problems. On the other hand, in many engineering design problems, the explicit form of objective function can not be given in terms of design variables. Given the value of design variables, under this circumstance, the value of objective function is obtained by some simulation analysis or experiments. Usually, these analyses are computationary expensive. In order to make the number of analyses as few as possible, several methods for sequential approximate optimization which make optimization in parallel with model prediction has been proposed. In this paper, we form a coalition between aspiration level methods and sequential approximate optimization methods in order to get a final solution for multi-objective engineering problems in a reasonable number of analyses. In particular, we apply mu-nu-SVM which was developed by the authors on the basis of goal programming. The effectiveness of the proposed method was shown through some numerical experiments.

[1]  Bernhard Schölkopf,et al.  New Support Vector Algorithms , 2000, Neural Computation.

[2]  Hirotaka Nakayama,et al.  Support Vector Regression Based on Goal Programming and Multi-objective Programming , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[3]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[4]  椹木 義一,et al.  Theory of multiobjective optimization , 1985 .

[5]  Hirotaka Nakayama,et al.  Simulation-Based Optimization Using Computational Intelligence , 2002 .

[6]  F. Glover,et al.  Simple but powerful goal programming models for discriminant problems , 1981 .

[7]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[8]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[9]  R. K. Ursem.  Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[10]  Hirotaka Nakayama,et al.  Aspiration Level Approach to Interactive Multi-Objective Programming and Its Applications , 1995 .

[11]  Yaochu Jin,et al.  A comprehensive survey of fitness approximation in evolutionary computation , 2005, Soft Comput..

[12]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[13]  Aravind Srinivasan,et al.  Innovization: innovating design principles through optimization , 2006, GECCO.

[14]  Hirotaka Nakayama,et al.  Satisficing Trade-off Method for Multiobjective Programming , 1984 .

[15]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[16]  Peter J. Fleming,et al.  Genetic Algorithms for Multiobjective Optimization: FormulationDiscussion and Generalization , 1993, ICGA.

[17]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[18]  Min Yoon,et al.  A role of total margin in support vector machines , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[19]  Hirotaka Nakayama,et al.  Generating Support Vector Machines Using Multi-Objective Optimization and Goal Programming , 2006, Multi-Objective Machine Learning.

[20]  C. Fonseca,et al.  GENETIC ALGORITHMS FOR MULTI-OBJECTIVE OPTIMIZATION: FORMULATION, DISCUSSION, AND GENERALIZATION , 1993 .

[21]  Hirotaka Nakayama.  Trade-off analysis using parametric optimization techniques , 1992 .

[22]  Hirotaka Nakayama,et al.  Optimization for Black-box Objective Functions , 2006 .