Fuzzy Clustering Based Hierarchical Metamodeling For Space Reduction and Design Optimization

For computation-intensive design problems, metamodeling techniques are commonly used to reduce the computational expense during optimization; however, they often have difficulty or even fail to model an unknown system in a large design space, especially when the number of available samples is limited. This paper proposes an intuitive method to systematically reduce the design space to a relatively small region. This method entails three main elements: 1) constructing surrogate approximations using either response surface or kriging models to capture unknown systems in the original large space; 2) calculating many inexpensive points from the obtained surrogate model, clustering these points using the Fuzzy c-means clustering method, and choosing an attractive cluster and its corresponding reduced design space; 3) progressively generating sample points to construct kriging models and identify the design optimum within the reduced design space. The proposed method is illustrated using the well-known six-hump camel back problem. The method is then applied to a constrained, highly nonlinear optimization problem and a real design problem. After comparing with other methods, it is found that the proposed method can intuitively capture promising design regions and can efficiently identify the global or near-global design optimum with the presence of highly nonlinear constraints. The effect of using either response surface or kriging models in the original design space is also compared and discussed. Limitations of the proposed method are illustrated.

[1]  G. Matheron Principles of geostatistics , 1963 .

[2]  George E. P. Box,et al.  Evolutionary Operation: A Statistical Method for Process Improvement , 1969 .

[3]  P. C. Gehlen,et al.  Computer Experiments , 1996 .

[4]  Ronald L. Iman,et al.  Risk methodology for geologic disposal of radioactive waste: small sample sensitivity analysis techniques for computer models, with an application to risk assessment , 1980 .

[5]  A. R. Zinsmeister,et al.  Statistics for Experimenters: An Introduction to Design, Data Analysis, and Model Building, by G. E. P. Box, W. G. Hunter, and J. S. Hunter , 1981 .

[6]  G. W. Milligan,et al.  Methodology Review: Clustering Methods , 1987 .

[7]  Jerome Sacks,et al.  Designs for Computer Experiments , 1989 .

[8]  Jerome Sacks,et al.  Computer Experiments for Quality Control by Parameter Design , 1990 .

[9]  Henry P. Wynn,et al.  Screening, predicting, and computer experiments , 1992 .

[10]  Dimitar Filev,et al.  Generation of Fuzzy Rules by Mountain Clustering , 1994, J. Intell. Fuzzy Syst..

[11]  André Hardy,et al.  An examination of procedures for determining the number of clusters in a data set , 1994 .

[12]  Stephen L. Chiu,et al.  Fuzzy Model Identification Based on Cluster Estimation , 1994, J. Intell. Fuzzy Syst..

[13]  J. Renaud,et al.  Approximation in nonhierarchic system optimization , 1994 .

[14]  Douglas C. Montgomery,et al.  Response Surface Methodology: Process and Product Optimization Using Designed Experiments , 1995 .

[15]  Achille Messac,et al.  Physical programming - Effective optimization for computational design , 1996 .

[16]  David Serafini Software for managing approximate models in multidisciplinary optimization , 1996 .

[17]  Cristina H. Amon,et al.  An engineering design methodology with multistage Bayesian surrogates and optimal sampling , 1996 .

[18]  John E. Renaud,et al.  Concurrent Subspace Optimization Using Design Variable Sharing in a Distributed Computing Environment , 1996 .

[19]  V. Markine,et al.  Refinements in the multi-point approximation method to reduce the effects of noisy structural responses , 1996 .

[20]  T Haftka Raphael,et al.  Multidisciplinary aerospace design optimization: survey of recent developments , 1996 .

[21]  Farrokh Mistree,et al.  Statistical Experimentation Methods for Achieving Affordable Concurrent Systems Design , 1997 .

[22]  Virginia Torczon,et al.  Numerical Optimization Using Computer Experiments , 1997 .

[23]  N. M. Alexandrov,et al.  A trust-region framework for managing the use of approximation models in optimization , 1997 .

[24]  Raphael T. Haftka,et al.  Optimization and Experiments: A Survey , 1998 .

[25]  L. Watson,et al.  Trust Region Augmented Lagrangian Methods for Sequential Response Surface Approximation and Optimization , 1998 .

[26]  J. Renaud,et al.  New Adaptive Move-Limit Management Strategy for Approximate Optimization, Part 2 , 1998 .

[27]  M. Natalia On Managing the Use of Surrogates in General Nonlinear Optimization and MDO , 1998 .

[28]  Timothy M. Mauery,et al.  COMPARISON OF RESPONSE SURFACE AND KRIGING MODELS FOR MULTIDISCIPLINARY DESIGN OPTIMIZATION , 1998 .

[29]  Donald R. Jones,et al.  Global versus local search in constrained optimization of computer models , 1998 .

[30]  A. J. Booker,et al.  A rigorous framework for optimization of expensive functions by surrogates , 1998 .

[31]  L. Watson,et al.  Reasonable Design Space Approach to Response Surface Approximation , 1999 .

[32]  Farrokh Mistree,et al.  Statistical Approximations for Multidisciplinary Design Optimization: The Problem of Size , 1999 .

[33]  T. Simpson,et al.  Efficient Pareto Frontier Exploration using Surrogate Approximations , 2000 .

[34]  T. Simpson,et al.  Comparative studies of metamodeling techniques under multiple modeling criteria , 2000 .

[35]  John R. Rice,et al.  An Agent-Based Netcentric Framework for Multidisciplinary Problem Solving Environments (MPSE) , 2000, Int. J. Comput. Eng. Sci..

[36]  W. K. Anderson,et al.  First-Order Model Management With Variable-Fidelity Physics Applied to Multi-Element Airfoil Optimization , 2000 .

[37]  Timothy W. Simpson,et al.  Metamodels for Computer-based Engineering Design: Survey and recommendations , 2001, Engineering with Computers.

[38]  G. Gary Wang,et al.  ADAPTIVE RESPONSE SURFACE METHOD - A GLOBAL OPTIMIZATION SCHEME FOR APPROXIMATION-BASED DESIGN PROBLEMS , 2001 .

[39]  Timothy W. Simpson,et al.  Sampling Strategies for Computer Experiments: Design and Analysis , 2001 .

[40]  Bernard Yannou,et al.  Metamodeling of Combined Discrete/Continuous Responses , 2001 .

[41]  L. Watson,et al.  Adaptive Experimental Design for Construction of Response Surface Approximations , 2001 .

[42]  Bernard Grossman,et al.  Variable Complexity Response Surface Design of an HSCT Con guration , 2003 .

[43]  G. G. Wang,et al.  Adaptive Response Surface Method Using Inherited Latin Hypercube Design Points , 2003 .