Quadrature Methods for Bayesian Optimal Design of Experiments With Nonnormal Prior Distributions

ABSTRACT Many optimal experimental designs depend on one or more unknown model parameters. In such cases, it is common to use Bayesian optimal design procedures to seek designs that perform well over an entire prior distribution of the unknown model parameter(s). Generally, Bayesian optimal design procedures are viewed as computationally intensive. This is because they require numerical integration techniques to approximate the Bayesian optimality criterion at hand. The most common numerical integration technique involves pseudo Monte Carlo draws from the prior distribution(s). For a good approximation of the Bayesian optimality criterion, a large number of pseudo Monte Carlo draws is required. This results in long computation times. As an alternative to the pseudo Monte Carlo approach, we propose using computationally efficient Gaussian quadrature techniques. Since, for normal prior distributions, suitable quadrature techniques have already been used in the context of optimal experimental design, we focus on quadrature techniques for nonnormal prior distributions. Such prior distributions are appropriate for variance components, correlation coefficients, and any other parameters that are strictly positive or have upper and lower bounds. In this article, we demonstrate the added value of the quadrature techniques we advocate by means of the Bayesian D-optimality criterion in the context of split-plot experiments, but we want to stress that the techniques can be applied to other optimality criteria and other types of experimental designs as well. Supplementary materials for this article are available online.

[1]  A. Ralston A first course in numerical analysis , 1965 .

[2]  Alan Genz,et al.  Fully symmetric interpolatory rules for multiple integrals , 1986 .

[3]  Searching for Optimal Block Designs when Block Effects are Random , 1986 .

[4]  K. Chaloner,et al.  Optimal Bayesian design applied to logistic regression experiments , 1989 .

[5]  Robert F. Berry Computer Benchmark Evaluation and Design of Experiments, a Case Study , 1992, IEEE Trans. Computers.

[6]  W. Näther Optimum experimental designs , 1994 .

[7]  A. Genz,et al.  Fully symmetric interpolatory rules for multiple integrals over infinite regions with Gaussian weight , 1996 .

[8]  Holger Dette,et al.  Designing Experiments with Respect to ‘Standardized’ Optimality Criteria , 1997 .

[9]  John Eccleston,et al.  Some results on two-level factorial designs with dependent observations , 1998 .

[10]  R. J. Martin,et al.  An algorithm for the design of factorial experiments when the data are correlated , 1999, Stat. Comput..

[11]  Steven G. Gilmour,et al.  Multistratum Response Surface Designs , 2001, Technometrics.

[12]  Peter Goos,et al.  D -optimal response surface designs in the presence of random block effects , 2001 .

[13]  P. Goos,et al.  Optimal Split-Plot Designs , 2001 .

[14]  Lorens A. Imhof,et al.  Maximin designs for exponential growth models and heteroscedastic polynomial models , 2001 .

[15]  M. Wedel,et al.  Designing Conjoint Choice Experiments Using Managers' Prior Beliefs , 2001 .

[16]  M. Wilck,et al.  A general approximation method for solving integrals containing a lognormal weighting function , 2001 .

[17]  Arnold Neumaier,et al.  Introduction to Numerical Analysis , 2001 .

[18]  Peter Goos,et al.  D-Optimal Split-Plot Designs With Given Numbers and Sizes of Whole Plots , 2003, Technometrics.

[19]  Knut Petras,et al.  Smolyak cubature of given polynomial degree with few nodes for increasing dimension , 2003, Numerische Mathematik.

[20]  Holger Dette,et al.  Maximin and Bayesian Optimal Designs for Regression Models , 2003 .

[21]  Peter Goos,et al.  Outperforming Completely Randomized Designs , 2004 .

[22]  Prem K. Kythe,et al.  Handbook of Computational Methods for Integration , 2004 .

[23]  W. Gautschi Orthogonal Polynomials: Computation and Approximation , 2004 .

[24]  Weiming Ke,et al.  The Optimal Design of Blocked and Split-Plot Experiments , 2005, Technometrics.

[25]  Peter Goos,et al.  And by contacting: The MIMS Secretary , 2005 .

[26]  P. Goos,et al.  A variable-neighbourhood search algorithm for finding optimal run orders in the presence of serial correlation and time trends , 2006 .

[27]  Peter J. Diggle,et al.  Bayesian Geostatistical Design , 2006 .

[28]  David C. Woods,et al.  Designs for Generalized Linear Models With Several Variables and Model Uncertainty , 2006, Technometrics.

[29]  Gene H. Golub,et al.  Calculation of Gauss quadrature rules , 1967, Milestones in Matrix Computation.

[30]  Anthony C. Atkinson,et al.  Optimum Experimental Designs, with SAS , 2007 .

[31]  Peter Goos,et al.  A candidate-set-free algorithm for generating D-optimal split-plot designs , 2007, Journal of the Royal Statistical Society. Series C, Applied statistics.

[32]  M. Bliemer,et al.  Approximation of bayesian efficiency in experimental choice designs , 2008 .

[33]  Florian Heiss,et al.  Likelihood approximation by numerical integration on sparse grids , 2008 .

[34]  Peter Goos,et al.  D-optimal design of split-split-plot experiments , 2009 .

[35]  David M. Steinberg,et al.  Fast Computation of Designs Robust to Parameter Uncertainty for Nonlinear Settings , 2009, Technometrics.

[36]  Peter Goos,et al.  An Efficient Algorithm for Constructing Bayesian Optimal Choice Designs , 2009 .

[37]  M. D. Martínez-Miranda,et al.  Computational Statistics and Data Analysis , 2009 .

[38]  D. Raghavarao,et al.  Balanced 2 n Factorial Designs When Observations are Spatially Correlated , 2009, Journal of biopharmaceutical statistics.

[39]  Christopher M. Gotwalt,et al.  Addendum to “Fast Computation of Designs Robust to Parameter Uncertainty for Nonlinear Settings” , 2010, Technometrics.

[40]  Peter Goos,et al.  D-Optimal and D-Efficient Equivalent-Estimation Second-Order Split-Plot Designs , 2010 .

[41]  Peter Goos,et al.  Comparing different sampling schemes for approximating the integrals involved in the efficient design of stated choice experiments , 2010 .

[42]  Peter Goos,et al.  Design and analysis of industrial strip‐plot experiments , 2010, Qual. Reliab. Eng. Int..

[43]  E. Schoen,et al.  A Split-Plot Experiment with Factor-Dependent Whole-Plot Sizes , 2011 .

[44]  Peter Goos,et al.  The usefulness of Bayesian optimal designs for discrete choice experiments , 2011 .

[45]  Peter Goos,et al.  Optimal Design of Experiments: A Case Study Approach , 2011 .

[46]  Peter Goos,et al.  Staggered-Level Designs for Experiments With More Than One Hard-to-Change Factor , 2012, Technometrics.

[47]  Peter Goos,et al.  I-Optimal Versus D-Optimal Split-Plot Response Surface Designs , 2012 .

[48]  B. Jones,et al.  Three-Stage Industrial Strip-Plot Experiments* , 2013 .

[49]  Christos Koukouvinos,et al.  A Comparison of Three-Level Orthogonal Arrays in the Presence of Different Correlation Structures in Observations , 2013, Commun. Stat. Simul. Comput..

[50]  Valerii V. Fedorov,et al.  Optimal Design for Nonlinear Response Models , 2013 .

[51]  Kalliopi Mylona,et al.  A coordinate-exchange two-phase local search algorithm for the D- and I-optimal designs of split-plot experiments , 2014, Comput. Stat. Data Anal..

[52]  Kalliopi Mylona,et al.  Optimal Design of Blocked and Split-Plot Experiments for Fixed Effects and Variance Component Estimation , 2014, Technometrics.

[53]  David M. Steinberg,et al.  Optimal designs for Gaussian process models |via spectral decomposition , 2014 .

[54]  Peter Goos,et al.  Staggered-Level Designs for Response Surface Modeling , 2015 .

[55]  Steven G. Gilmour,et al.  Improved Split-Plot and Multistratum Designs , 2015, Technometrics.

[56]  Angelika Fruehauf,et al.  A First Course In Numerical Analysis , 2016 .

[57]  Kalliopi Mylona,et al.  A multi-objective coordinate-exchange two-phase local search algorithm for multi-stratum experiments , 2016, Statistics and Computing.