Cross-validation based single response adaptive design of experiments for Kriging metamodeling of deterministic computer simulations

A new approach for single response adaptive design of deterministic computer experiments is presented. The approach is called SFCVT, for Space-Filling Cross-Validation Tradeoff. SFCVT uses metamodeling to obtain an estimate of cross-validation errors, which are maximized subject to a constraint on space filling to determine sample points in the design space. The proposed method is compared, using a test suite of forty four numerical examples, with three DOE methods from the literature. The numerical test examples can be classified into symmetric and asymmetric functions. Symmetric examples refer to functions for which the extreme points are located symmetrically in the design space and asymmetric examples are those for which the extreme regions are not located in a symmetric fashion in the design space. Based upon the comparison results for the numerical examples, it is shown that SFCVT performs better than an existing adaptive and a non-adaptive DOE method for asymmetric multimodal functions with high nonlinearity near the boundary, and is comparable for symmetric multimodal functions and other test problems. The proposed approach is integrated with a multi-scale heat exchanger optimization tool to reduce the computational effort involved in the design of novel air-to-water heat exchangers. The resulting designs are shown to be significantly more compact than mainstream heat exchanger designs.

[1]  Omar Abdelaziz Ahmed Abdelaziz,et al.  Development of multi-scale, multi-physics, analysis capability and its application to novel heat exchangers design and optimization , 2009 .

[2]  Søren Nymand Lophaven,et al.  Aspects of the Matlab toolbox DACE , 2002 .

[3]  Chi-Chuan Wang,et al.  Heat transfer and friction characteristics of plain fin-and-tube heat exchangers, part II: Correlation , 2000 .

[4]  M. D. McKay,et al.  A comparison of three methods for selecting values of input variables in the analysis of output from a computer code , 2000 .

[5]  Henry P. Wynn,et al.  Maximum entropy sampling , 1987 .

[6]  Joshua D. Knowles,et al.  ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems , 2006, IEEE Transactions on Evolutionary Computation.

[7]  Michael S. Eldred,et al.  OVERVIEW OF MODERN DESIGN OF EXPERIMENTS METHODS FOR COMPUTATIONAL SIMULATIONS , 2003 .

[8]  Agus Sudjianto,et al.  Blind Kriging: A New Method for Developing Metamodels , 2008 .

[9]  P. Rousseeuw,et al.  Wiley Series in Probability and Mathematical Statistics , 2005 .

[10]  Ruichen Jin,et al.  On Sequential Sampling for Global Metamodeling in Engineering Design , 2002, DAC 2002.

[11]  Zissimos P. Mourelatos,et al.  On Estimating the Reliability of Multiple Failure Region Problems Using Approximate Metamodels , 2009 .

[12]  Panos Y. Papalambros,et al.  Metamodeling sampling criteria in a global optimization framework , 2000 .

[13]  T. Simpson,et al.  Computationally Inexpensive Metamodel Assessment Strategies , 2002 .

[14]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[15]  R. Shah,et al.  Laminar Flow Forced Convection in Ducts: A Source Book for Compact Heat Exchanger Analytical Data , 2014 .

[16]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[17]  Noel A. C. Cressie,et al.  Statistics for Spatial Data: Cressie/Statistics , 1993 .

[18]  Natalia Alexandrov,et al.  Multidisciplinary design optimization : state of the art , 1997 .

[19]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[20]  Husam Hamad.  A New Metric for Measuring Metamodels Quality-of-Fit for Deterministic Simulations , 2006, Proceedings of the 2006 Winter Simulation Conference.

[21]  Noel A Cressie,et al.  Statistics for Spatial Data. , 1992 .

[22]  Pierre Goovaerts,et al.  Adaptive Experimental Design Applied to Ergonomics Testing Procedure , 2002, DAC 2002.

[23]  Shapour Azarm,et al.  An accumulative error based adaptive design of experiments for offline metamodeling , 2009 .

[24]  Donald R. Jones,et al.  A Taxonomy of Global Optimization Methods Based on Response Surfaces , 2001, J. Glob. Optim..

[25]  Vikrant Aute,et al.  CoilDesigner: a general-purpose simulation and design tool for air-to-refrigerant heat exchangers , 2006 .

[26]  T. Simpson,et al.  Comparative studies of metamodeling techniques under multiple modeling criteria , 2000 .

[27]  M. E. Johnson,et al.  Minimax and maximin distance designs , 1990 .

[28]  Victor Picheny,et al.  Adaptive Designs of Experiments for Accurate Approximation of a Target Region , 2010 .

[29]  Raphael T. Haftka,et al.  Performance Estimate and Simultaneous Application of Multiple Surrogates , 2006 .

[30]  Cristina H. Amon,et al.  On Adaptive Sampling for Single and Multi-Response Bayesian Surrogate Models , 2006, DAC 2006.

[31]  Yong Zhang,et al.  Uniform Design: Theory and Application , 2000, Technometrics.

[32]  Armin Iske,et al.  Hierarchical Nonlinear Approximation for Experimental Design and Statistical Data Fitting , 2007, SIAM J. Sci. Comput..

[33]  Donald E. Myers,et al.  Basic Linear Geostatistics , 1998, Technometrics.

[34]  Jay D. Martin,et al.  Improving the Performance of Visual Steering Commands for Multi-Dimensional Trade Space Exploration , 2008, DAC 2008.

[35]  Mike Rees,et al.  5. Statistics for Spatial Data , 1993 .

[36]  Jack P. C. Kleijnen,et al.  Application-driven sequential designs for simulation experiments: Kriging metamodelling , 2004, J. Oper. Res. Soc..

[37]  Shapour Azarm,et al.  Bayesian meta‐modelling of engineering design simulations: a sequential approach with adaptation to irregularities in the response behaviour , 2005 .

[38]  T. Simpson,et al.  Comparative studies of metamodelling techniques under multiple modelling criteria , 2001 .

[39]  Douglas C. Montgomery,et al.  Response Surface Methodology: Process and Product Optimization Using Designed Experiments , 1995 .

[40]  Marcus Pettersson,et al.  Adaptive Complex Method for Efficient Design Optimization , 2007, DAC 2007.

[41]  Randal J. Barnes,et al.  Infill sampling criteria to locate extremes , 1995 .

[42]  Farrokh Mistree,et al.  Sequential Metamodeling in Engineering Design , 2004 .

[43]  Warren M. Rohsenow,et al.  Heat Mass and Momentum Transfer , 1961 .

[44]  Reinhard Radermacher,et al.  Approximation-Assisted Optimization for Novel Compact Heat Exchanger Designs , 2010 .

[45]  Urmila M. Diwekar,et al.  An efficient sampling technique for off-line quality control , 1997 .

[46]  Sundar Krishnamurty,et al.  A Clustering-Based Surrogate Model Updating Approach to Simulation-Based Engineering Design , 2008 .

[47]  G. Gary Wang,et al.  Review of Metamodeling Techniques in Support of Engineering Design Optimization , 2007 .

[48]  Farrokh Mistree,et al.  A Sequential Exploratory Experimental Design Method: Development of Appropriate Empirical Models in Design , 2004, DAC 2004.