Amortized Bayesian Inference for Models of Cognition

As models of cognition grow in complexity and number of parameters, Bayesian inference with standard methods can become intractable, especially when the data-generating model is of unknown analytic form. Recent advances in simulation-based inference using specialized neural network architectures circumvent many previous problems of approximate Bayesian computation. Moreover, due to the properties of these special neural network estimators, the effort of training the networks via simulations amortizes over subsequent evaluations which can re-use the same network for multiple datasets and across multiple researchers. However, these methods have been largely underutilized in cognitive science and psychology so far, even though they are well suited for tackling a wide variety of modeling problems. With this work, we provide a general introduction to amortized Bayesian parameter estimation and model comparison and demonstrate the applicability of the proposed methods on a well-known class of intractable response-time models.

[1]  Stefan T. Radev,et al.  BayesFlow: Learning Complex Stochastic Models With Invertible Neural Networks , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Stefan T. Radev,et al.  Amortized Bayesian Model Comparison With Evidential Deep Learning , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Stefan T. Radev,et al.  Jumping to Conclusion? A Lévy Flight Model of Decision Making , 2020 .

[4]  Gilles Louppe,et al.  The frontier of simulation-based inference , 2019, Proceedings of the National Academy of Sciences.

[5]  David S. Greenberg,et al.  Automatic Posterior Transformation for Likelihood-Free Inference , 2019, ICML.

[6]  J. Rieskamp,et al.  A reinforcement learning diffusion decision model for value-based decisions , 2019, Psychonomic Bulletin & Review.

[7]  Andreas Voss,et al.  Sequential sampling models with variable boundaries and non-normal noise: A comparison of six models , 2019, Psychonomic Bulletin & Review.

[8]  Birte U. Forstmann,et al.  Joint Models of Neural and Behavioral Data , 2019, Computational Approaches to Cognition and Perception.

[9]  F. Tuerlinckx,et al.  Prepaid parameter estimation without likelihoods , 2018, PLoS Comput. Biol..

[10]  Aki Vehtari,et al.  Validating Bayesian Inference Algorithms with Simulation-Based Calibration , 2018, 1804.06788.

[11]  Jean-Michel Marin,et al.  Likelihood-Free Model Choice , 2015, Handbook of Approximate Bayesian Computation.

[12]  Frank D. Wood,et al.  Inference Compilation and Universal Probabilistic Programming , 2016, AISTATS.

[13]  James L. McClelland,et al.  Bayesian analysis of simulation-based models , 2016 .

[14]  Jasper Snoek,et al.  Practical Bayesian Optimization of Machine Learning Algorithms , 2012, NIPS.

[15]  Jay I. Myung,et al.  Analytic Expressions for the BCDMEM Model of Recognition Memory. , 2007, Journal of mathematical psychology.

[16]  A. Raftery,et al.  Strictly Proper Scoring Rules, Prediction, and Estimation , 2007 .

[17]  Jerome R Busemeyer,et al.  Cognitive modeling analysis of decision-making processes in cocaine abusers , 2004, Psychonomic bulletin & review.

[18]  R. Ratcliff,et al.  A diffusion model analysis of the effects of aging in the lexical-decision task. , 2004, Psychology and aging.

[19]  Scott M. Lynch,et al.  Bayesian Posterior Predictive Checks for Complex Models , 2004 .

[20]  M. Tribus,et al.  Probability theory: the logic of science , 2003 .