Robust Design Optimization With Quadratic Loss Derived From Gaussian Process Models

Gaussian process models, which include the class of linear models, are widely employed for modeling responses as a function of control or noise factors. Using these models, the average loss at control factor settings can be estimated and compared. However, robust design optimization is often performed based on the expected quadratic loss computed as if the posterior mean were the true response function. This can give very misleading results. We propose an expected quadratic loss criterion derived by taking expectation with respect to the noise factors and the posterior predictive process. Approximate but highly accurate credible intervals for the average quadratic loss are constructed via the numerical inversion of the Lugannani–Rice saddlepoint approximation. The accuracy of the Lugannani–Rice intervals is compared with intervals constructed via moment-matching techniques on real data. This article has supplementary materials that are available online.

[1]  H. Solomon,et al.  Distribution of a Sum of Weighted Chi-Square Variables , 1977 .

[2]  Raymond H. Myers,et al.  Response Surface Methods and the Use of Noise Variables , 1997 .

[3]  S. Rice,et al.  Saddle point approximation for the distribution of the sum of independent random variables , 1980, Advances in Applied Probability.

[4]  B. Baldessari,et al.  The Distribution of a Quadratic Form of Normal Random Variables , 1967 .

[5]  T J Santner,et al.  Design and analysis of robust total joint replacements: finite element model experiments with environmental variables. , 2001, Journal of biomechanical engineering.

[6]  Irad Ben-Gal,et al.  Designing experiments for robust-optimization problems: the V s-optimality criterion , 2006 .

[7]  Sonja Kuhnt,et al.  Design and analysis of computer experiments , 2010 .

[8]  R. Butler SADDLEPOINT APPROXIMATIONS WITH APPLICATIONS. , 2007 .

[9]  Begnaud Francis Hildebrand,et al.  Introduction to numerical analysis: 2nd edition , 1987 .

[10]  M. Stein,et al.  A Bayesian analysis of kriging , 1993 .

[11]  G. C. Tiao,et al.  Bayesian inference in statistical analysis , 1973 .

[12]  Peng Chen,et al.  Simulation of springback variation in forming of advanced high strength steels , 2007 .

[13]  H. E. Daniels,et al.  Tail Probability Approximations , 1987 .

[14]  A. C. Miller,et al.  Discrete Approximations of Probability Distributions , 1983 .

[15]  Daniel W. Apley,et al.  Understanding the effects of model uncertainty in robust design with computer experiments , 2006, DAC 2006.

[16]  J. Imhof Computing the distribution of quadratic forms in normal variables , 1961 .

[17]  N. Doganaksoy,et al.  Joint Optimization of Mean and Standard Deviation Using Response Surface Methods , 2003 .

[18]  Thomas J. Santner,et al.  Sequential design of computer experiments to minimize integrated response functions , 2000 .

[19]  John J. Peterson,et al.  Ridge Analysis With Noise Variables , 2005, Technometrics.

[20]  T J Santner,et al.  Robust optimization of total joint replacements incorporating environmental variables. , 1999, Journal of biomechanical engineering.

[21]  Mahmoud Al Bawaneh Determination of material constitutive models using orthogonal machining tests , 2007 .

[22]  Hugh A. Chipman,et al.  HANDLING UNCERTAINTY IN ANALYSIS OF ROBUST DESIGN EXPERIMENTS , 1998 .

[23]  John J. Peterson,et al.  A Bayesian Approach for Multiple Response Surface Optimization in the Presence of Noise Variables , 2004 .

[24]  Huan Liu,et al.  A new chi-square approximation to the distribution of non-negative definite quadratic forms in non-central normal variables , 2009, Comput. Stat. Data Anal..

[25]  Arnold Zellner,et al.  Prediction and Decision Problems in Regression Models from the Bayesian Point of View , 1965 .

[26]  P. Patnaik THE NON-CENTRAL χ2- AND F-DISTRIBUTIONS AND THEIR APPLICATIONS , 1949 .

[27]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[28]  G. Box Some Theorems on Quadratic Forms Applied in the Study of Analysis of Variance Problems, I. Effect of Inequality of Variance in the One-Way Classification , 1954 .

[29]  A. O'Hagan,et al.  Gaussian process emulation of dynamic computer codes , 2009 .

[30]  William I. Notz,et al.  DESIGNING COMPUTER EXPERIMENTS TO DETERMINE ROBUST CONTROL VARIABLES , 2004 .

[31]  Robert Michael Lewis,et al.  Pattern Search Algorithms for Bound Constrained Minimization , 1999, SIAM J. Optim..