Simulation-based sequential Bayesian design

Abstract We consider simulation-based methods for exploration and maximization of expected utility in sequential decision problems. We consider problems which require backward induction with analytically intractable expected utility integrals at each stage. We propose to use forward simulation to approximate the integral expressions, and a reduction of the allowable action space to avoid problems related to an increasing number of possible trajectories in the backward induction. The artificially reduced action space allows strategies to depend on the full history of earlier observations and decisions only indirectly through a low dimensional summary statistic. The proposed rule provides a finite-dimensional approximation to the unrestricted infinite-dimensional optimal decision rule. We illustrate the proposed approach with an application to an optimal stopping problem in a clinical trial.

[1]  Donald A. Berry,et al.  Group sequential clinical trials: a classical evaluation of Bayesian decision-theoretic designs , 1994 .

[2]  Michael D. Smith,et al.  Adaptive Bayesian Designs for Dose-Ranging Drug Trials , 2002 .

[3]  D A Berry,et al.  A case for Bayesianism in clinical trials. , 1993, Statistics in medicine.

[4]  D Malakoff,et al.  Bayes Offers a 'New' Way to Make Sense of Numbers , 1999, Science.

[5]  J. Andrés Christen,et al.  Sequential stopping rules for species accumulation , 2003 .

[6]  Joseph B. Kadane,et al.  A Gridding Method for Bayesian Sequential Decision Problems , 2003 .

[7]  J Whitehead,et al.  Bayesian decision procedures for dose determining experiments. , 1995, Statistics in medicine.

[8]  Alan E. Gelfand,et al.  Nonparametric Bayesian Group Sequential Design , 1998 .

[9]  A E Gelfand,et al.  Approaches for optimal sequential decision analysis in clinical trials. , 1998, Biometrics.

[10]  David J. Spiegelhalter,et al.  Bayesian Approaches to Randomized Trials , 1994, Bayesian Biostatistics.

[11]  Donald A. Berry,et al.  Bandit Problems: Sequential Allocation of Experiments. , 1986 .

[12]  J Whitehead,et al.  Bayesian decision procedures based on logistic regression models for dose-finding studies. , 1998, Journal of biopharmaceutical statistics.

[13]  Murray K. Clayton,et al.  BAYES DISCRETE SEQUENTIAL BOUNDARIES FOR CLINICAL TRIALS , 2001 .

[14]  P F Thall,et al.  A strategy for dose-finding and safety monitoring based on efficacy and adverse outcomes in phase I/II clinical trials. , 1998, Biometrics.

[15]  Eric R. Ziegel,et al.  Practical Nonparametric and Semiparametric Bayesian Statistics , 1998, Technometrics.

[16]  P. Müller,et al.  Optimal Bayesian Design by Inhomogeneous Markov Chain Simulation , 2004 .

[17]  K. Chaloner,et al.  Bayesian Experimental Design: A Review , 1995 .

[18]  Jon Wakefield,et al.  An Expected Loss Approach to the Design of Dosage Regimens Via Sampling‐Based Methods , 1994 .

[19]  J. Berger.  Statistical Decision Theory and Bayesian Analysis , 1988 .

[20]  J. Q. Smith,et al.  1. Bayesian Statistics 4 , 1993 .

[21]  P. Thall,et al.  Bayesian sequential monitoring designs for single-arm clinical trials with multiple outcomes. , 1995, Statistics in medicine.