Towards Bayesian experimental design for nonlinear models that require a large number of sampling times

The use of Bayesian methodologies for solving optimal experimental design problems has increased. Many of these methods have been found to be computationally intensive for design problems that require a large number of design points. A simulation-based approach that can be used to solve optimal design problems in which one is interested in finding a large number of (near) optimal design points for a small number of design variables is presented. The approach involves the use of lower dimensional parameterisations that consist of a few design variables, which generate multiple design points. Using this approach, one simply has to search over a few design variables, rather than searching over a large number of optimal design points, thus providing substantial computational savings. The methodologies are demonstrated on four applications, including the selection of sampling times for pharmacokinetic and heat transfer studies, and involve nonlinear models. Several Bayesian design criteria are also compared and contrasted, as well as several different lower dimensional parameterisation schemes for generating the many design points.

[1]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[2]  W. J. Studden,et al.  Theory Of Optimal Experiments , 1972 .

[3]  David Lindley,et al.  Bayesian Statistics, a Review , 1987 .

[4]  K. Chaloner,et al.  Bayesian Experimental Design: A Review , 1995 .

[5]  Christian P. Robert,et al.  Bayesian-Optimal Design via Interacting Particle Systems , 2006 .

[6]  D. Rubin,et al.  The Precise Time Course of Retention , 1999 .

[7]  Peter Müller,et al.  Redesigning a Network of Rainfall Stations , 1999 .

[8]  David M. Steinberg,et al.  Fast Computation of Designs Robust to Parameter Uncertainty for Nonlinear Settings , 2009, Technometrics.

[9]  荒井保明.  Pharmacokinetics , 1993 .

[10]  D Z D'Argenio,et al.  Incorporating prior parameter uncertainty in the design of sampling schedules for pharmacokinetic parameter estimation experiments. , 1990, Mathematical biosciences.

[11]  Peter Müller,et al.  Optimal sampling times in population pharmacokinetic studies , 2001 .

[12]  L Aarons,et al.  Design of population pharmacokinetic experiments using prior information. , 2007, Xenobiotica; the fate of foreign compounds in biological systems.

[13]  Joseph B. Kadane,et al.  A Gridding Method for Bayesian Sequential Decision Problems , 2003 .

[14]  Peter Müller,et al.  A Bayesian Decision-Theoretic Dose-Finding Trial , 2006, Decis. Anal..

[15]  G. Gibson,et al.  Optimal Observation Times in Experimental Epidemic Processes , 2008, Biometrics.

[16]  Marie Davidian,et al.  Nonlinear models for repeated measurement data: An overview and update , 2003 .

[17]  A. Pettitt,et al.  Marginal likelihood estimation via power posteriors , 2008 .

[18]  David C. Woods,et al.  Designs for Generalized Linear Models With Several Variables and Model Uncertainty , 2006, Technometrics.

[19]  M. Degroot.  Optimal Statistical Decisions , 1970 .

[20]  Heikki Haario,et al.  Simulation-Based Optimal Design Using a Response Variance Criterion , 2012 .

[21]  A. N. Pettitt,et al.  A sequential Monte Carlo approach to derive sampling times and windows for population pharmacokinetic studies , 2012, Journal of Pharmacokinetics and Pharmacodynamics.

[22]  Friedrich Pukelsheim,et al.  Optimal weights for experimental designs on linearly independent support points , 1991 .

[23]  David Lindley,et al.  Optimal Statistical Decisions , 1971 .

[24]  Kerrie Mengersen,et al.  Evaluation of the Pre-Posterior Distribution of Optimized Sampling Times for the Design of Pharmacokinetic Studies , 2012, Journal of biopharmaceutical statistics.

[25]  Jon Wakefield,et al.  Bayesian Analysis of Population PK/PD Models: General Concepts and Software , 2002, Journal of Pharmacokinetics and Pharmacodynamics.

[26]  M. Wand,et al.  Multivariate plug-in bandwidth selection , 1994 .

[27]  C. Bielza,et al.  Decision Analysis by Augmented Probability Simulation , 1999 .

[28]  Xun Huan,et al.  Simulation-based optimal Bayesian experimental design for nonlinear systems , 2011, J. Comput. Phys..

[29]  W. Näther.  Optimum experimental designs , 1994 .

[30]  Mark A. Pitt,et al.  Adaptive Design Optimization: A Mutual Information-Based Approach to Model Discrimination in Cognitive Science , 2010, Neural Computation.

[31]  P. Müller.  Simulation Based Optimal Design , 2005 .

[32]  Anthony N Pettitt,et al.  Bayesian Experimental Design for Models with Intractable Likelihoods , 2013, Biometrics.

[33]  X. Huan,et al.  GRADIENT-BASED STOCHASTIC OPTIMIZATION METHODS IN BAYESIAN EXPERIMENTAL DESIGN , 2012, 1212.2228.

[34]  Peter Müller,et al.  Exploring Expected Utility Surfaces by Markov Chains , 1996 .

[35]  James M. McGree,et al.  Sequential Monte Carlo for Bayesian sequentially designed experiments for discrete data , 2013, Comput. Stat. Data Anal..

[36]  Lingji Kong,et al.  A Family of Generalized Beta Distributions for Income , 2007 .

[37]  P. Laycock,et al.  Optimum Experimental Designs , 1995 .

[38]  Emile H. L. Aarts,et al.  Simulated Annealing: Theory and Applications , 1987, Mathematics and Its Applications.

[39]  Hovav A. Dror,et al.  Robust Experimental Design for Multivariate Generalized Linear Models , 2006, Technometrics.

[40]  Stephen Duffull,et al.  Some Considerations on the Design of Population Pharmacokinetic Studies , 2005, Journal of Pharmacokinetics and Pharmacodynamics.

[41]  K. Chaloner,et al.  Optimal Bayesian design applied to logistic regression experiments , 1989 .