Likelihood-free Simulation-based Optimal Design

Simulation-based optimal design techniques are a convenient tool for solving a particular class of optimal design problems. The goal is to find the optimal configuration of factor settings with respect to an expected utility criterion. This criterion depends on the specified probability model for the data and on the assumed prior distribution for the model parameters. We develop new simulation-based optimal design methods which incorporate likelihood-free approaches and utilize them in novel applications. Most simulation-based design strategies solve the intractable expected utility integral at a specific design point by using Monte Carlo simulations from the probability model. Optimizing the criterion over the design points is carried out in a separate step. M\"uller (1999) introduces an MCMC algorithm which simultaneously addresses the simulation as well as the optimization problem. In principle, the optimal design can be found by detecting the utility mode of the sampled design points. Several improvements have been suggested to facilitate this task for multidimensional design problems (see e.g. Amzal et al. 2006). We aim to extend this simulation-based design methodology to design problems where the likelihood of the probability model is of an unknown analytical form but it is possible to simulate from the probability model. We further assume that prior observations are available. In such a setting it is seems natural to employ approximate Bayesian computation (ABC) techniques in order to be able to simulate from the conditional probability model. We provide a thorough review of adjacent literature and we investigate the benefits and the limitations of our design methodology for a particular paradigmatic example.

[1]  Mike West,et al.  Bayesian Learning from Marginal Data in Bionetwork Models , 2011, Statistical applications in genetics and molecular biology.

[2]  Xun Huan,et al.  Simulation-based optimal Bayesian experimental design for nonlinear systems , 2011, J. Comput. Phys..

[3]  J. Spall.  Implementation of the simultaneous perturbation algorithm for stochastic optimization , 1998 .

[4]  P. Müller,et al.  Optimal Bayesian Design by Inhomogeneous Markov Chain Simulation , 2004 .

[5]  K. Chaloner,et al.  Bayesian Experimental Design: A Review , 1995 .

[6]  Heikki Haario,et al.  Simulation-Based Optimal Design Using a Response Variance Criterion , 2012 .

[7]  D. Balding,et al.  Approximate Bayesian computation in population genetics. , 2002, Genetics.

[8]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[10]  L. Tierney.  Markov Chains for Exploring Posterior Distributions , 1994 .

[11]  James C. Spall,et al.  AN OVERVIEW OF THE SIMULTANEOUS PERTURBATION METHOD FOR EFFICIENT OPTIMIZATION , 1998 .

[12]  P. Müller.  Simulation Based Optimal Design , 2005 .

[13]  Franck Jabot,et al.  Inferring the parameters of the neutral theory of biodiversity using phylogenetic information and implications for tropical forests. , 2009, Ecology letters.

[14]  Jun S. Liu,et al.  Monte Carlo strategies in scientific computing , 2001 .

[15]  Mark M. Tanaka,et al.  Sequential Monte Carlo without likelihoods , 2007, Proceedings of the National Academy of Sciences.

[16]  A. Zhigljavsky.  Stochastic Global Optimization , 2008, International Encyclopedia of Statistical Science.

[17]  S. Sisson,et al.  Likelihood-free Markov chain Monte Carlo , 2010, 1001.2058.

[18]  Markus Hainy,et al.  Approximate Bayesian Computation Design (ABCD), an Introduction , 2013 .

[19]  Emile H. L. Aarts,et al.  Simulated Annealing: Theory and Applications , 1987, Mathematics and Its Applications.

[20]  Christian P. Robert,et al.  Bayesian-Optimal Design via Interacting Particle Systems , 2006 .

[21]  Paul Marjoram,et al.  Markov chain Monte Carlo without likelihoods , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[22]  P. Moral,et al.  Sequential Monte Carlo samplers for rare events , 2006 .

[23]  Anthony N. Pettitt,et al.  Likelihood-free Bayesian estimation of multivariate quantile distributions , 2011, Comput. Stat. Data Anal..

[24]  S. Coles,et al.  Inference for Stereological Extremes , 2007 .

[25]  Christian P. Robert,et al.  Monte Carlo Statistical Methods , 2005, Springer Texts in Statistics.

[26]  Paola Sebastiani,et al.  Bayesian Experimental Design and Shannon Information , 1997 .