A Bayesian Model-Averaging Approach for Multiple-Response Optimization

The characteristics that define the quality and reliability of many products and processes are often multidimensional. Many of the current multiple-response optimization approaches assume a single-response model to optimize such processes and do not consider the correlations among the response data, the uncertainty in the response models, and the uncertainty in the parameter estimates of the models. Failure to account for these uncertainties can result in misleading quality estimates and therefore poor process design. In this paper, we consider a Bayesian decision theoretic approach to the modeling and optimization of multiple-response systems. This approach naturally accounts for the correlations among the responses, the variability of the predictions, and the uncertainty of the model parameters. We further propose a Bayesian model averaging approach to account for response-model uncertainty. This approach is general and enables the consideration of many types of quality criteria and characteristics. In addition, we also consider the important follow-up question of how to allocate further resources for additional experimentation to achieve or improve on the desired quality level.

[1]  S. J. Press,et al.  Applied multivariate analysis : using Bayesian and frequentist methods of inference , 1984 .

[2]  Hugh Chipman,et al.  Bayesian variable selection with related predictors , 1995, bayes-an/9510001.

[3]  J. York,et al.  Bayesian Graphical Models for Discrete Data , 1995 .

[4]  Dean Phillips Foster,et al.  Calibration and Empirical Bayes Variable Selection , 1997 .

[5]  Anthony O'Hagan,et al.  Elicitation of multivariate prior distributions: A nonparametric Bayesian approach , 2010 .

[6]  Valerii Fedorov.  Discussion: follow-up designs to resolve confounding in multifactor experiments , 1996 .

[7]  Szu Hui Ng,et al.  Design of follow‐up experiments for improving model discrimination and parameter estimation , 2004 .

[8]  A. Dawid.  Some matrix-variate distribution theory: Notational considerations and a Bayesian application , 1981 .

[9]  W. Näther.  Optimum experimental designs , 1994 .

[10]  George E. P. Box,et al.  Follow-up designs to resolve confounding in multifactor experiments , 1996 .

[11]  John J. Peterson,et al.  A Bayesian Approach for Multiple Response Surface Optimization in the Presence of Noise Variables , 2004 .

[12]  John J. Peterson.  A Posterior Predictive Approach to Multiple Response Surface Optimization , 2004 .

[13]  T. Fearn,et al.  Multivariate Bayesian variable selection and prediction , 1998 .

[14]  R. Kohn,et al.  Nonparametric regression using Bayesian variable selection , 1996 .

[15]  Peter Müller,et al.  Optimal Design via Curve Fitting of Monte Carlo Experiments , 1995 .

[16]  G. Geoffrey Vining,et al.  A Compromise Approach to Multiresponse Optimization , 1998 .

[17]  Enrique Del Castillo,et al.  Model and Distribution-Robust Process Optimization with Noise Factors , 2005 .

[18]  D. Madigan,et al.  Bayesian Model Averaging for Linear Regression Models , 1997 .

[19]  W. DuMouchel,et al.  A simple Bayesian modification of D-optimal designs to reduce dependence on an assumed model , 1994 .

[20]  Frank Bretz,et al.  Comparison of Methods for the Computation of Multivariate t Probabilities , 2002 .

[21]  R. D. Meyer,et al.  Finding the Active Factors in Fractionated Screening Experiments , 1993 .

[22]  K. Burnham,et al.  Model selection: An integral part of inference , 1997 .

[23]  R. Carroll.  Measurement, Regression, and Calibration , 1994 .

[24]  Joseph J. Pignatiello,et al.  STRATEGIES FOR ROBUST MULTIRESPONSE QUALITY ENGINEERING , 1993 .

[25]  Alyson G. Wilson,et al.  Finding Near-Optimal Bayesian Experimental Designs via Genetic Algorithms , 2001 .

[26]  Adrian E. Raftery,et al.  Bayesian model averaging: a tutorial (with comments by M. Clyde, David Draper and E. I. George, and a rejoinder by the authors , 1999 .

[27]  Adrian F. M. Smith,et al.  Sampling-Based Approaches to Calculating Marginal Densities , 1990 .

[28]  田口 玄一,et al.  Introduction to quality engineering : designing quality into products and processes , 1986 .

[29]  Enrique del Castillo,et al.  Model-Robust Process Optimization Using Bayesian Model Averaging , 2005, Technometrics.

[30]  Arto Luoma,et al.  Bayesian Model Selection , 2016 .

[31]  J. Bernardo,et al.  Simulation-Based Optimal Design , 1999 .

[32]  M. Steel,et al.  Benchmark Priors for Bayesian Model Averaging , 2001 .

[33]  Anthony C. Atkinson,et al.  Discussion: posterior probabilities and experimental designs for discriminating between regression models , 1996 .

[34]  M. Hamada,et al.  Analyzing Experiments with Correlated Multiple Responses , 2001 .

[35]  E. George,et al.  APPROACHES FOR BAYESIAN VARIABLE SELECTION , 1997 .

[36]  C. F. Jeff Wu,et al.  Experiments: Planning, Analysis, and Parameter Design Optimization , 2000 .

[37]  Edward I. George,et al.  The Practical Implementation of Bayesian Model Selection , 2001 .

[38]  J. Berger.  Statistical Decision Theory and Bayesian Analysis , 1988 .

[39]  John Peterson.  A Review of Bayesian Reliability Approaches to Multiple Response Surface Optimization , 2006 .