Multi-objective optimization based on meta-modeling by using support vector regression

Practical engineering design problems have a black-box objective function whose forms are not explicitly known in terms of design variables. In those problems, it is very important to make the number of function evaluations as few as possible in finding an optimal solution. So, in this paper, we propose a multi-objective optimization method based on meta-modeling predicting a form of each objective function by using support vector regression. In addition, we discuss a way how to select additional experimental data for sequentially revising a form of objective function. Finally, we illustrate the effectiveness of the proposed method through some numerical examples.

[1]  Yaochu Jin,et al.  Multi-Objective Machine Learning , 2006, Studies in Computational Intelligence.

[2]  Yaochu Jin,et al.  A comprehensive survey of fitness approximation in evolutionary computation , 2005, Soft Comput..

[3]  Hirotaka Nakayama,et al.  Support Vector Regression Based on Goal Programming and Multi-objective Programming , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[4]  Hirotaka Nakayama,et al.  Theory of Multiobjective Optimization , 1985 .

[5]  Hirotaka Nakayama,et al.  A Computational Intelligence Approach to Optimization with Unknown Objective Functions , 2001, ICANN.

[6]  Bernhard Schölkopf,et al.  New Support Vector Algorithms , 2000, Neural Computation.

[7]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[8]  Hirotaka Nakayama,et al.  Generating Support Vector Machines Using Multi-Objective Optimization and Goal Programming , 2006, Multi-Objective Machine Learning.

[9]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[10]  Hirotaka Nakayama,et al.  Total Margin Algorithms in Support Vector Machines , 2004, IEICE Trans. Inf. Syst..

[11]  Bernhard Schölkopf,et al.  Learning with kernels , 2001 .

[12]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[13]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[14]  Hirotaka Nakayama,et al.  Multiple criteria decision making with generalized DEA and an aspiration level method , 2004, Eur. J. Oper. Res..

[15]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[16]  C. Fonseca,et al.  GENETIC ALGORITHMS FOR MULTI-OBJECTIVE OPTIMIZATION: FORMULATION, DISCUSSION, AND GENERALIZATION , 1993 .

[17]  Hirotaka Nakayama,et al.  Sequential Approximation Method in Multi-objective Optimization by Using Computational Intelligence , 2007 .

[18]  Michael T. M. Emmerich,et al.  Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels , 2006, IEEE Transactions on Evolutionary Computation.

[19]  Hirotaka Nakayama,et al.  Simulation-Based Optimization Using Computational Intelligence , 2002 .

[20]  Liang Shi,et al.  Multiobjective GA optimization using reduced models , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[21]  Manfred Grauer,et al.  Interactive Decision Analysis , 1984 .

[22]  P. Pardalos,et al.  Optimization and optimal control , 2003 .

[23]  Hirotaka Nakayama,et al.  Optimization for Black-box Objective Functions , 2006 .

[24]  Hirotaka Nakayama,et al.  Generation of efficient frontiers in multi-objective optimization problems by generalized data envelopment analysis , 2001, Eur. J. Oper. Res..

[25]  Hirotaka Nakayama,et al.  Satisficing Trade-off Method for Multiobjective Programming , 1984 .

[26]  Peter J. Fleming,et al.  Genetic Algorithms for Multiobjective Optimization: FormulationDiscussion and Generalization , 1993, ICGA.

[27]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[28]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[29]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.