Langevin Diffusion for Population Based Sampling with an Application in Bayesian Inference for Pharmacodynamics

We propose an algorithm for the efficient and robust sampling of the posterior probability distribution in Bayesian inference problems. The algorithm combines the local search capabilities of the Manifold Metropolis Adjusted Langevin transition kernels with the advantages of global exploration by a population based sampling algorithm, the Transitional Markov Chain Monte Carlo (TMCMC). The Langevin diffusion process is determined by either the Hessian or the Fisher Information of the target distribution with appropriate modifications for non positive definiteness. The present methods is shown to be superior over other population based algorithms, in sampling probability distributions for which gradients are available and is shown to handle otherwise unidentifiable models. We demonstrate the capabilities and advantages of the method in computing the posterior distribution of the parameters in a Pharmacodynamics model, for glioma growth and its drug induced inhibition, using clinical data.

[1]  S. Kou,et al.  Equi-energy sampler with applications in statistical inference and statistical mechanics , 2005, math/0507080.

[2]  J. Rosenthal,et al.  Optimal scaling for various Metropolis-Hastings algorithms , 2001 .

[3]  Iason Papaioannou,et al.  Transitional Markov Chain Monte Carlo: Observations and Improvements , 2016 .

[4]  A. Pettitt,et al.  Marginal likelihood estimation via power posteriors , 2008 .

[5]  Guillermo Rus-Carlborg,et al.  Approximate Bayesian Computation by Subset Simulation , 2014, SIAM J. Sci. Comput..

[6]  K. Aizu,et al.  Parameter Differentiation of Quantum‐Mechanical Linear Operators , 1963 .

[7]  J. Beck,et al.  Model Selection using Response Measurements: Bayesian Probabilistic Approach , 2004 .

[8]  Petros Koumoutsakos,et al.  Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES) , 2003, Evolutionary Computation.

[9]  M. Tribus,et al.  Probability theory: the logic of science , 2003 .

[10]  Jayanta K. Ghosh,et al.  An Introduction to Bayesian Analysis , 2006 .

[11]  M. Girolami,et al.  Langevin diffusions and the Metropolis-adjusted Langevin algorithm , 2013, 1309.2983.

[12]  P. Moral,et al.  Sequential Monte Carlo samplers , 2002, cond-mat/0212648.

[13]  Michael Betancourt,et al.  A General Metric for Riemannian Manifold Hamiltonian Monte Carlo , 2012, GSI.

[14]  H. Philippe,et al.  Computing Bayes factors using thermodynamic integration. , 2006, Systematic biology.

[15]  T. Bui-Thanh,et al.  A SCALED STOCHASTIC NEWTON ALGORITHM FOR MARKOV CHAIN MONTE CARLO SIMULATIONS , 2012 .

[16]  Frank Nielsen,et al.  Geometric science of information : first International Conference, GSI 2013, Paris, France, August 28-30, 2013, proceedings , 2013 .

[17]  Jens Timmer,et al.  Joining forces of Bayesian and frequentist methodology: a study for inference in the presence of non-identifiability , 2012, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[18]  Robert M. Califf,et al.  Accelerating development of scientific evidence for medical products within the existing US regulatory framework , 2017, Nature Reviews Drug Discovery.

[19]  Raquel Urtasun,et al.  A Family of MCMC Methods on Implicitly Defined Manifolds , 2012, AISTATS.

[20]  Heikki Haario,et al.  Efficient MCMC for Climate Model Parameter Estimation: Parallel Adaptive Chains and Early Rejection , 2012 .

[21]  Costas Papadimitriou,et al.  Bayesian Annealed Sequential Importance Sampling: An Unbiased Version of Transitional Markov Chain Monte Carlo , 2018 .

[22]  Christian P. Robert,et al.  Bayesian computation: a summary of the current state, and samples backwards and forwards , 2015, Statistics and Computing.

[23]  K. Hukushima,et al.  Exchange Monte Carlo Method and Application to Spin Glass Simulations , 1995, cond-mat/9512035.

[24]  S. Duane,et al.  Hybrid Monte Carlo , 1987 .

[25]  Yan Zhou,et al.  Multilevel Sequential Monte Carlo with Dimension-Independent Likelihood-Informed Proposals , 2017, SIAM/ASA J. Uncertain. Quantification.

[26]  Johan Pallud,et al.  A Tumor Growth Inhibition Model for Low-Grade Glioma Treated with Chemotherapy or Radiotherapy , 2012, Clinical Cancer Research.

[27]  Paul Marjoram,et al.  Markov chain Monte Carlo without likelihoods , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[28]  M. Girolami,et al.  Riemann manifold Langevin and Hamiltonian Monte Carlo methods , 2011, Journal of the Royal Statistical Society: Series B (Statistical Methodology).

[29]  Radford M. Neal.  Annealed importance sampling , 1998, Stat. Comput..

[30]  Tiangang Cui,et al.  Dimension-independent likelihood-informed MCMC , 2014, J. Comput. Phys..

[31]  Mark A. Girolami,et al.  Estimating Bayes factors via thermodynamic integration and population MCMC , 2009, Comput. Stat. Data Anal..

[32]  James Martin,et al.  A Stochastic Newton MCMC Method for Large-Scale Statistical Inverse Problems with Application to Seismic Inversion , 2012, SIAM J. Sci. Comput..

[33]  Heikki Haario,et al.  DRAM: Efficient adaptive MCMC , 2006, Stat. Comput..

[34]  J. Ching,et al.  Transitional Markov Chain Monte Carlo Method for Bayesian Model Updating, Model Class Selection, and Model Averaging , 2007 .

[35]  Hoon Kim,et al.  Monte Carlo Statistical Methods , 2000, Technometrics.

[36]  Costas Papadimitriou,et al.  Π4U: A high performance computing framework for Bayesian uncertainty quantification of complex models , 2015, J. Comput. Phys..

[37]  A. O'Hagan,et al.  Bayesian calibration of computer models , 2001 .

[38]  T. S. Kleppe.  Adaptive Step Size Selection for Hessian‐Based Manifold Langevin Samplers , 2015, 1501.07454.

[39]  G. Roberts,et al.  Langevin Diffusions and Metropolis-Hastings Algorithms , 2002 .

[40]  Tiangang Cui,et al.  Likelihood-informed dimension reduction for nonlinear inverse problems , 2014, 1403.4680.

[41]  Mlnoru Slotani.  Tolerance regions for a multivariate normal population , 1964 .

[42]  J. Rosenthal,et al.  Optimal scaling of discrete approximations to Langevin diffusions , 1998 .