Adaptive Markov chain Monte Carlo algorithms for Bayesian inference: recent advances and comparative study

Abstract Condition assessments of structures require prediction models such as empirical model and numerical simulation model. Generally, these prediction models have model parameters to be estimated from experimental data. Bayesian inference is the formal statistical framework to estimate the model parameters and their uncertainties. As a result, uncertainties associated with the model and measurement can be accounted for decision making. Markov Chain Monte Carlo (MCMC) algorithms have been widely employed. However, there still remain some implementation issues from the inappropriate selection of the proposal mechanism in Markov chain. Since the posterior density for a given problem is often problem-dependent and unknown, users require a trial-and-error approach to select and tune optimal proposal mechanism. To relieve this difficulty, various adaptive MCMC algorithms have been recently appeared. Users must understand their mechanism and limitations before applying the algorithms to their problems. However, there is no comprehensive work to provide detailed exposition and their performance comparison together. This study aims to bring together different adaptive MCMC algorithms with the goal of providing their mechanisms and evaluating their performances through comparative study. Three algorithms are chosen as the representative proposal mechanism. From comparative studies, the discussions were drawn in terms of performances, simplicity and computational costs for less-experienced users.

[1]  Joel P. Conte,et al.  Uncertainty Quantification in the Assessment of Progressive Damage in a 7-Story Full-Scale Building Slice , 2013 .

[2]  Nando de Freitas,et al.  Adaptive Hamiltonian and Riemann Manifold Monte Carlo , 2013, ICML.

[3]  J. Beck,et al.  Bayesian Model Updating Using Hybrid Monte Carlo Simulation with Application to Structural Dynamic Models with Many Uncertain Parameters , 2009 .

[4]  Jeffrey S. Rosenthal,et al.  Optimal Proposal Distributions and Adaptive MCMC , 2011 .

[5]  Søren Nielsen,et al.  First passage probability estimation of wind turbines by Markov Chain Monte Carlo , 2013 .

[6]  Weitao Zhang,et al.  Bayesian calibration of mechanistic aquatic biogeochemical models and benefits for environmental management , 2008 .

[7]  Heikki Haario,et al.  Componentwise adaptation for high dimensional MCMC , 2005, Comput. Stat..

[8]  Nando de Freitas,et al.  Self-Avoiding Random Dynamics on Integer Complex Systems , 2011, TOMC.

[9]  Andrew Gelman,et al.  The No-U-turn sampler: adaptively setting path lengths in Hamiltonian Monte Carlo , 2011, J. Mach. Learn. Res..

[10]  A. Mira.  On Metropolis-Hastings algorithms with delayed rejection , 2001 .

[11]  D. Higdon,et al.  Accelerating Markov Chain Monte Carlo Simulation by Differential Evolution with Self-Adaptive Randomized Subspace Sampling , 2009 .

[12]  Christian Bucher,et al.  On model updating of existing structures utilizing measured dynamic responses , 2005 .

[13]  M. Girolami,et al.  Riemann manifold Langevin and Hamiltonian Monte Carlo methods , 2011, Journal of the Royal Statistical Society: Series B (Statistical Methodology).

[14]  Ivo Babuška,et al.  A systematic approach to model validation based on Bayesian updates and prediction related rejection criteria , 2008 .

[15]  A. Mita,et al.  Posterior density estimation for structural parameters using improved differential evolution adaptive Metropolis algorithm , 2015 .

[16]  Jian Zhang,et al.  Advanced Markov Chain Monte Carlo Approach for Finite Element Calibration under Uncertainty , 2013, Comput. Aided Civ. Infrastructure Eng..

[17]  Wei-Xin Ren,et al.  Stochastic model updating utilizing Bayesian approach and Gaussian process model , 2016 .

[18]  Hyung-Jo Jung,et al.  A new multi-objective approach to finite element model updating , 2014 .

[19]  A. Gelman,et al.  Adaptively Scaling the Metropolis Algorithm Using Expected Squared Jumped Distance , 2007 .

[20]  Ning Xia,et al.  Probabilistic modelling of the bond deterioration of fully-grouted rock bolts subject to spatiotemporally stochastic corrosion , 2013 .

[21]  P. Green,et al.  Delayed rejection in reversible jump Metropolis–Hastings , 2001 .

[22]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[23]  Tshilidzi Marwala,et al.  Finite Element Model Updating Using the Shadow Hybrid Monte Carlo Technique , 2015 .

[24]  E. Walshaw,et al.  A systematic approach , 2018, BDJ.

[25]  William A. Link,et al.  On thinning of chains in MCMC , 2012 .

[26]  H. Haario,et al.  An adaptive Metropolis algorithm , 2001 .

[27]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[28]  James-A. Goulet,et al.  Uncertainty quantification for model parameters and hidden state variables in Bayesian dynamic linear models , 2018, Structural Control and Health Monitoring.

[29]  J. Beck,et al.  Estimation of Small Failure Probabilities in High Dimensions by Subset Simulation , 2001 .

[30]  S. Chib,et al.  Understanding the Metropolis-Hastings Algorithm , 1995 .

[31]  Jasper A. Vrugt,et al.  Markov chain Monte Carlo simulation using the DREAM software package: Theory, concepts, and MATLAB implementation , 2016, Environ. Model. Softw..

[32]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[33]  Bruno Sudret,et al.  Updating the long-term creep strains in concrete containment vessels by using Markov chain Monte Carlo simulation and polynomial chaos expansions , 2012 .

[34]  K. D. Murphy,et al.  Bayesian identification of a cracked plate using a population-based Markov Chain Monte Carlo method , 2011 .

[35]  A. Kiureghian,et al.  STRUCTURAL RELIABILITY UNDER INCOMPLETE PROBABILITY INFORMATION , 1986 .

[36]  Ralph C. Smith,et al.  Uncertainty Quantification: Theory, Implementation, and Applications , 2013 .

[37]  Derek J. Posselt,et al.  Robust Characterization of Model Physics Uncertainty for Simulations of Deep Moist Convection , 2010 .

[38]  Ajay Jasra,et al.  On population-based simulation for static inference , 2007, Stat. Comput..

[39]  Ralph C. Smith,et al.  A modeling and uncertainty quantification framework for a flexible structure with macrofiber composite actuators operating in hysteretic regimes , 2014 .

[40]  Heikki Haario,et al.  DRAM: Efficient adaptive MCMC , 2006, Stat. Comput..

[41]  Cajo J. F. ter Braak,et al.  A Markov Chain Monte Carlo version of the genetic algorithm Differential Evolution: easy Bayesian computing for real parameter spaces , 2006, Stat. Comput..

[42]  Richard D. Neidinger,et al.  Introduction to Automatic Differentiation and MATLAB Object-Oriented Programming , 2010, SIAM Rev..

[43]  A. Emin Aktan,et al.  Structural identification of constructed systems : approaches, methods, and technologies for effective practice of St-Id , 2013 .

[44]  S. Duane,et al.  Hybrid Monte Carlo , 1987 .

[45]  J. Vrugt,et al.  The role of uncertainty in bedrock depth and hydraulic properties on the stability of a variably-saturated slope , 2017 .

[46]  Hui Wang,et al.  Reliability-based temporal and spatial maintenance strategy for integrity management of corroded underground pipelines , 2016 .