Multifidelity Optimization for Variable-Complexity Design

Surrogate-based-optimization methods provide a means to minimize expensive highfidelity models at reduced computational cost. The methods are useful in problems for which two models of the same physical system exist: a high-fidelity model which is accurate and expensive, and a low-fidelity model which is less costly but less accurate. A number of model management techniques have been developed and shown to work well for the case in which both models are defined over the same design space. However, many systems exist with variable fidelity models for which the design variables are defined over different spaces, and a mapping is required between the spaces. Previous work showed that two mapping methods, corrected space mapping and POD mapping, used in conjunction with a trust-region model management method, provide improved performance over conventional non-surrogate-based optimization methods for unconstrained problems. This paper extends that work to constrained problems. Three constraint-management methods are demonstrated with each of the mapping methods: Lagrangian minimization, an sequential quadratic programming-like surrogate method, and MAESTRO. The methods are demonstrated on a fixed-complexity analytical test problem and a variable-complexity wing design problem. The SQP-like method consistently outperformed optimization in the high-fidelity space and the other variable complexity methods. Corrected space mapping performed slightly better on average than POD mapping. On the wing design problem, the combination of the SQP-like method and corrected space mapping achieved 58% savings in high-fidelity function calls over optimization directly in the high-fidelity space.

[1]  H. Ashley,et al.  Aerodynamics of Wings and Bodies , 1965 .

[2]  C. G. Broyden The Convergence of a Class of Double-rank Minimization Algorithms 1. General Considerations , 1970 .

[3]  R. Fletcher,et al.  A New Approach to Variable Metric Algorithms , 1970, Comput. J..

[4]  D. Shanno Conditioning of Quasi-Newton Methods for Function Minimization , 1970 .

[5]  D. Goldfarb A family of variable-metric methods derived by variational means , 1970 .

[6]  David Mautner Himmelblau,et al.  Applied Nonlinear Programming , 1972 .

[7]  C. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[8]  J. Anderson,et al.  Fundamentals of Aerodynamics , 1984 .

[9]  L. Sirovich Turbulence and the dynamics of coherent structures. I. Coherent structures , 1987 .

[10]  J. Katz,et al.  Low-Speed Aerodynamics , 1991 .

[11]  J. -F. M. Barthelemy,et al.  Approximation concepts for optimum structural design — a review , 1993 .

[12]  John W. Bandler,et al.  Space mapping technique for electromagnetic optimization , 1994 .

[13]  Lawrence Sirovich,et al.  Karhunen–Loève procedure for gappy data , 1995 .

[14]  Charles L. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[15]  M. Karpel,et al.  Modal-Based Structural Optimization with Static Aeroelastic and Stress Constraints , 1997 .

[16]  F. Jose,et al.  Convergence of Trust Region Augmented Lagrangian Methods Using Variable Fidelity Approximation Data , 1997 .

[17]  N. M. Alexandrov,et al.  A trust-region framework for managing the use of approximation models in optimization , 1997 .

[18]  Markus Voelter,et al.  State of the Art , 1997, Pediatric Research.

[19]  Jonathan C. Mattingly,et al.  Low-dimensional models of coherent structures in turbulence , 1997 .

[20]  L. Watson,et al.  Trust Region Augmented Lagrangian Methods for Sequential Response Surface Approximation and Optimization , 1998 .

[21]  J. H. Starnes,et al.  Construction of Response Surface Approximations for Design Optimization , 1998 .

[22]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[23]  A. J. Booker,et al.  A rigorous framework for optimization of expensive functions by surrogates , 1998 .

[24]  P. A. Newman,et al.  Optimization with variable-fidelity models applied to wing design , 1999 .

[25]  M. D. McKay,et al.  A comparison of three methods for selecting values of input variables in the analysis of output from a computer code , 2000 .

[26]  J. Renaud,et al.  Trust region model management in multidisciplinary design optimization , 2000 .

[27]  W. K. Anderson,et al.  First-Order Model Management With Variable-Fidelity Physics Applied to Multi-Element Airfoil Optimization , 2000 .

[28]  Exact modal analysis of an idealised whole aircraft using symbolic computation , 2000 .

[29]  R. Lewis,et al.  A MULTIGRID APPROACH TO THE OPTIMIZATION OF SYSTEMS GOVERNED BY DIFFERENTIAL EQUATIONS , 2000 .

[30]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[31]  Charles Audet,et al.  A surrogate-model-based method for constrained optimization , 2000 .

[32]  Nicholas I. M. Gould,et al.  Trust Region Methods , 2000, MOS-SIAM Series on Optimization.

[33]  John E. Renaud,et al.  Adaptive experimental design for construction of response surface approximations , 2001 .

[34]  P. A. Newman,et al.  Approximation and Model Management in Aerodynamic Optimization with Variable-Fidelity Models , 2001 .

[35]  Farrokh Mistree,et al.  Kriging Models for Global Approximation in Simulation-Based Multidisciplinary Design Optimization , 2001 .

[36]  Y. Yeun,et al.  Managing approximation models in multiobjective optimization , 2002 .

[37]  Asme,et al.  A collection of technical papers : 44th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference : 11th AIAA/ASME/AHS Adaptive Structures Forum : 4th AIAA Gossamer Spacecraft Forum : AIAA Dynamics Specialists Conference, Norfolk, Virginia, 7-10 April 2003 , 2003 .

[38]  L. Watson,et al.  Homotopy Curve Tracking in Approximate Interior Point Optimization , 2003 .

[39]  K. Willcox,et al.  Aerodynamic Data Reconstruction and Inverse Design Using Proper Orthogonal Decomposition , 2004 .

[40]  Michael S. Eldred,et al.  Second-Order Corrections for Surrogate-Based Optimization with Model Hierarchies , 2004 .

[41]  J.W. Bandler,et al.  Space mapping: the state of the art , 2004, IEEE Transactions on Microwave Theory and Techniques.

[42]  Charles Audet,et al.  A Pattern Search Filter Method for Nonlinear Programming without Derivatives , 2001, SIAM J. Optim..

[43]  M. Eldred,et al.  Solving the Infeasible Trust-region Problem Using Approximations. , 2004 .

[44]  Ilan Kroo,et al.  Two-Level Multifidelity Design Optimization Studies for Supersonic Jets , 2005 .

[45]  Raphael T. Haftka,et al.  Surrogate-based Analysis and Optimization , 2005 .

[46]  Seongim Choi,et al.  Two-Level Multi-Fidelity Design Optimization Studies for Supersonic Jets , 2005 .

[47]  Robert Haimes,et al.  Strategies for Multifidelity Optimization with Variable-Dimensional Hierarchical Models , 2006 .

[48]  Andy J. Keane,et al.  Optimization using surrogate models and partially converged computational fluid dynamics simulations , 2006, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.