Dimension Reduction for Aerodynamic Design Optimization

The search for an optimal design in a high-dimensional design space of a multivariate problem requires a sample size proportional or even exponential to the number of variables of the problem. This ‘curse of dimensionality’ places a computational burden on the cost of optimization, especially when the problem uses expensive high fidelity simulations and may force one to try to reduce the dimensions of a problem. Traditional variable screening techniques reduce the dimensionality of the problem by removing variables that seem irrelevant to the design problem. This practice fails when all the variables are equally relevant in the problem or when some variables are relevant only in some parts of the design space. The present work describes a dimension reduction method called generative topographic mapping based on non-linear latent models which transform a high-dimensional data set into a low-dimensional latent space, without removing any variables. It is first illustrated on a two dimensional Branin function and then applied to a thirty-dimensional airfoil problem. The method is then compared with a global optimizer (a genetic algorithm), other dimension reduction methods (principle component analysis and Gaussian process latent variable models) and with Kriging surrogate models. The method improves when the initial sample used for dimension reduction is filtered to contain only good designs.

[1]  H. Zha,et al.  Principal manifolds and nonlinear dimensionality reduction via tangent space alignment , 2004, SIAM J. Sci. Comput..

[2]  David J. J. Toal,et al.  Geometric Filtration Using Proper Orthogonal Decomposition for Aerodynamic Design Optimization , 2010 .

[3]  Aaron Hertzmann,et al.  Style-based inverse kinematics , 2004, SIGGRAPH 2004.

[4]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[5]  Roman Rosipal,et al.  Overview and Recent Advances in Partial Least Squares , 2005, SLSFS.

[6]  Clemens Elster,et al.  Screening by conference designs , 1995 .

[7]  Samuel Kaski,et al.  Dimensionality reduction by random mapping: fast similarity computation for clustering , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[8]  Eric O. Postma,et al.  Dimensionality Reduction: A Comparative Review , 2008 .

[9]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[10]  T. Hastie Principal Curves and Surfaces , 1984 .

[11]  Neil D. Lawrence,et al.  Gaussian Process Latent Variable Models for Visualisation of High Dimensional Data , 2003, NIPS.

[12]  R. H. Myers,et al.  Response Surface Methodology: Process and Product Optimization Using Designed Experiments , 1995 .

[13]  A. Ralston A first course in numerical analysis , 1965 .

[14]  D. Donoho,et al.  Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[15]  Jack P. C. Kleijnen,et al.  Searching for important factors in simulation models with many factors: Sequential bifurcation , 1997 .

[16]  Kilian Q. Weinberger,et al.  Learning a kernel matrix for nonlinear dimensionality reduction , 2004, ICML.

[17]  Richard Bellman,et al.  Adaptive Control Processes: A Guided Tour , 1961, The Mathematical Gazette.

[18]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[19]  Tony R. Martinez,et al.  Iterative Non-linear Dimensionality Reduction with Manifold Sculpting , 2007, NIPS.

[20]  M. Kramer Nonlinear principal component analysis using autoassociative neural networks , 1991 .

[21]  Jerome Sacks,et al.  Choosing the Sample Size of a Computer Experiment: A Practical Guide , 2009, Technometrics.

[22]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[23]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[24]  Andy J. Keane,et al.  Engineering Design via Surrogate Modelling - A Practical Guide , 2008 .

[25]  David J. Fleet,et al.  3D People Tracking with Gaussian Process Dynamical Models , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[26]  I K Fodor,et al.  A Survey of Dimension Reduction Techniques , 2002 .

[27]  Andy J. Keane,et al.  Visualization methodologies in aircraft design , 2004 .

[28]  D. Mackay,et al.  Bayesian neural networks and density networks , 1995 .

[29]  Richard Durbin,et al.  An analogue approach to the travelling salesman problem using an elastic net method , 1987, Nature.

[30]  Ann B. Lee,et al.  Geometric diffusions as a tool for harmonic analysis and structure definition of data: diffusion maps. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[31]  David J. Fleet,et al.  Gaussian Process Dynamical Models , 2005, NIPS.

[32]  Neil D. Lawrence,et al.  Probabilistic Non-linear Principal Component Analysis with Gaussian Process Latent Variable Models , 2005, J. Mach. Learn. Res..

[33]  Jeanny Hérault,et al.  Curvilinear component analysis: a self-organizing neural network for nonlinear mapping of data sets , 1997, IEEE Trans. Neural Networks.

[34]  Christopher M. Bishop,et al.  GTM: The Generative Topographic Mapping , 1998, Neural Computation.

[35]  F. Guibault,et al.  Optimized Nonuniform Rational B-Spline Geometrical Representation for Aerodynamic Design of Wings , 2001 .

[36]  Max D. Morris,et al.  Factorial sampling plans for preliminary computational experiments , 1991 .

[37]  Samuel Kaski,et al.  Self organization of a massive document collection , 2000, IEEE Trans. Neural Networks Learn. Syst..

[38]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[39]  I. Jolliffe Principal Component Analysis , 2002 .

[40]  Joaquin Quiñonero Candela,et al.  Local distance preservation in the GP-LVM through back constraints , 2006, ICML.

[41]  Ronald L. Iman,et al.  Risk methodology for geologic disposal of radioactive waste: small sample sensitivity analysis techniques for computer models, with an application to risk assessment , 1980 .