Bayesian Estimation of Agent-Based Models via Adaptive Particle Markov Chain Monte Carlo

Over the last decade, agent-based models in economics have reached a state of maturity that brought the tasks of statistical inference and goodness-of-fit of such models on the agenda of the research community. While most available papers have pursued a frequentist approach adopting either likelihood-based algorithms or simulated moment estimators, here we explore Bayesian estimation using a Markov chain Monte Carlo approach (MCMC). One major problem in the design of MCMC estimators is finding a parametrization that leads to a reasonable acceptance probability for new draws from the proposal density. With agent-based models the appropriate choice of the proposal density and its parameters becomes even more complex since such models often require a numerical approximation of the likelihood. This brings in additional factors affecting the acceptance rate as it will also depend on the approximation error of the likelihood. In this paper, we take advantage of a number of recent innovations in MCMC: We combine Particle Filter Markov Chain Monte Carlo (PMCMC) as proposed by Andrieu et al. (2010) with adaptive choice of the proposal distribution and delayed rejection in order to identify an appropriate design of the MCMC estimator. We illustrate the methodology using two well-known behavioral asset pricing models.

[1]  A. Doucet,et al.  Efficient implementation of Markov chain Monte Carlo when using an unbiased likelihood estimator , 2012, 1210.1871.

[2]  Nils Bertschinger,et al.  Bayesian estimation and likelihood-based comparison of agent-based volatility models , 2020, Journal of Economic Interaction and Coordination.

[3]  Murali Haran,et al.  Markov chain Monte Carlo: Can we trust the third significant figure? , 2007, math/0703746.

[4]  J. Rosenthal,et al.  On the efficiency of pseudo-marginal random walk Metropolis algorithms , 2013, The Annals of Statistics.

[5]  Heikki Haario,et al.  DRAM: Efficient adaptive MCMC , 2006, Stat. Comput..

[6]  Edmund J Crampin,et al.  MCMC can detect nonidentifiable models. , 2012, Biophysical journal.

[7]  Frank Schorfheide,et al.  Bayesian Estimation of DSGE Models , 2015 .

[8]  S. J. Koopman Discussion of `Particle Markov chain Monte Carlo methods – C. Andrieu, A. Doucet and R. Holenstein’ [Review of: Particle Markov chain Monte Carlo methods] , 2010 .

[9]  Ralph S. Silva,et al.  On Some Properties of Markov Chain Monte Carlo Simulation Methods Based on the Particle Filter , 2012 .

[10]  Darren J Wilkinson,et al.  Bayesian parameter inference for stochastic biochemical network models using particle Markov chain Monte Carlo , 2011, Interface Focus.

[11]  Christophe Andrieu,et al.  A tutorial on adaptive MCMC , 2008, Stat. Comput..

[12]  Mark M. Tanaka,et al.  Sequential Monte Carlo without likelihoods , 2007, Proceedings of the National Academy of Sciences.

[13]  Sitabhra Sinha,et al.  Reality-check for Econophysics: Likelihood-based fitting of physics-inspired market models to empirical data , 2018, ArXiv.

[14]  Jingjing Zhang,et al.  Linking individual-based and statistical inferential models in movement ecology: A case study with black petrels (Procellaria parkinsoni) , 2017 .

[15]  L. Tierney Markov Chains for Exploring Posterior Distributions , 1994 .

[16]  Jeffrey S. Rosenthal,et al.  Optimal Proposal Distributions and Adaptive MCMC , 2011 .

[17]  Thomas Lux,et al.  Time-Variation of Higher Moments in a Financial Market with Heterogeneous Agents: An Analytical Approach , 2008 .

[18]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[19]  F. Westerhoff,et al.  Structural stochastic volatility in asset pricing dynamics: Estimation and model contest , 2012 .

[20]  T. Lux,et al.  Bringing an elementary agent-based model to the data: Estimation via GMM and an application to forecasting of asset price volatility* , 2016 .

[21]  T. Lux Herd Behaviour, Bubbles and Crashes , 1995 .

[22]  Matteo G. Richiardi,et al.  Bayesian Estimation of Agent-Based Models , 2017 .

[23]  Xiao-Li Meng,et al.  Perfection within Reach: Exact MCMC Sampling , 2011 .

[24]  Roberto Dieci,et al.  Heterogeneous Agent Models in Finance , 2018 .

[25]  T. Lux Time variation of second moments from a noise trader/infection model , 1997 .

[26]  A. Doucet,et al.  Particle Markov chain Monte Carlo methods , 2010 .

[27]  Thomas Lux,et al.  Empirical validation of agent-based models , 2018 .

[28]  Marc C. Kennedy,et al.  A Bayesian sensitivity analysis applied to an Agent-based model of bird population response to landscape change , 2013, Environ. Model. Softw..

[29]  G. Kitagawa Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[30]  Thomas Lux,et al.  Estimation of agent-based models using sequential Monte Carlo methods , 2018, Journal of Economic Dynamics and Control.