Bayesian Decision Models: A Primer

To understand decision-making behavior in simple, controlled environments, Bayesian models are often useful. First, optimal behavior is always Bayesian. Second, even when behavior deviates from optimality, the Bayesian approach offers candidate models to account for suboptimalities. Third, a realist interpretation of Bayesian models opens the door to studying the neural representation of uncertainty. In this tutorial, we review the principles of Bayesian models of decision making and then focus on five case studies with exercises. We conclude with reflections and future directions.

[1]  A. Pouget,et al.  Not Noisy, Just Wrong: The Role of Suboptimal Inference in Behavioral Variability , 2012, Neuron.

[2]  Luigi Acerbi,et al.  Human online adaptation to changes in prior probability , 2019, PLoS computational biology.

[3]  Jessica B. Hamrick,et al.  Simulation as an engine of physical scene understanding , 2013, Proceedings of the National Academy of Sciences.

[4]  Jeffrey S. Perry,et al.  Contour statistics in natural images: Grouping across occlusions , 2009, Visual Neuroscience.

[5]  Dale Purves,et al.  Comparison of Bayesian and empirical ranking approaches to visual perception. , 2006, Journal of theoretical biology.

[6]  M. Treisman Motion sickness: an evolutionary hypothesis. , 1977, Science.

[7]  Charles Kemp,et al.  How to Grow a Mind: Statistics, Structure, and Abstraction , 2011, Science.

[8]  Joshua I. Gold,et al.  A Mixture of Delta-Rules Approximation to Bayesian Inference in Change-Point Problems , 2013, PLoS Comput. Biol..

[9]  T. Sanger,et al.  Probability density estimation for the interpretation of neural population codes. , 1996, Journal of neurophysiology.

[10]  M. Sahani,et al.  Implicit knowledge of visual uncertainty guides decisions with asymmetric outcomes. , 2008, Journal of vision.

[11]  D H Brainard,et al.  Bayesian color constancy. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[12]  Aapo Hyvärinen,et al.  Interpreting Neural Response Variability as Monte Carlo Sampling of the Posterior , 2002, NIPS.

[13]  T. Sargent,et al.  Anticipated Utility and Rational Expectations as Approximations of Bayesian Decision Making , 2008 .

[14]  L. Maloney,et al.  Bayesian decision theory as a model of human visual perception: Testing Bayesian transfer , 2009, Visual Neuroscience.

[15]  Janneke F. M. Jehee,et al.  Sensory uncertainty decoded from visual cortex predicts behavior , 2015, Nature Neuroscience.

[16]  Joshua B. Tenenbaum,et al.  Human-level concept learning through probabilistic program induction , 2015, Science.

[17]  Thomas L. Griffiths,et al.  Rational Use of Cognitive Resources: Levels of Analysis Between the Computational and the Algorithmic , 2015, Top. Cogn. Sci..

[18]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[19]  A. Yuille,et al.  Object perception as Bayesian inference. , 2004, Annual review of psychology.

[20]  I. J. Myung,et al.  Tutorial on maximum likelihood estimation , 2003 .

[21]  B. Love,et al.  The myth of computational level theory and the vacuity of rational analysis , 2011, Behavioral and Brain Sciences.

[22]  Wei Ji Ma,et al.  Efficient Probabilistic Inference in Generic Neural Networks Trained with Non-Probabilistic Feedback , 2018 .

[23]  A. Tolias,et al.  Trial-to-trial, uncertainty-based adjustment of decision boundaries in visual categorization , 2013, Proceedings of the National Academy of Sciences.

[24]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[25]  A. Faisal,et al.  Noise in the nervous system , 2008, Nature Reviews Neuroscience.

[26]  József Fiser,et al.  Perceptual Decision-Making as Probabilistic Inference by Neural Sampling , 2014, Neuron.

[27]  Eero P. Simoncelli,et al.  Noise characteristics and prior expectations in human visual speed perception , 2006, Nature Neuroscience.

[28]  Luigi Acerbi,et al.  On the Origins of Suboptimality in Human Probabilistic Inference , 2014, PLoS Comput. Biol..

[29]  Wei Ji Ma,et al.  Neural coding of uncertainty and probability. , 2014, Annual review of neuroscience.

[30]  Konrad Paul Kording,et al.  Sensory Cue Integration , 2011 .

[31]  Sophie Denève,et al.  Bayesian Spiking Neurons I: Inference , 2008, Neural Computation.

[32]  Eero P. Simoncelli,et al.  Cardinal rules: Visual orientation perception reflects knowledge of environmental statistics , 2011, Nature Neuroscience.

[33]  Wei Ji Ma,et al.  A neural basis of probabilistic computation in visual cortex , 2018, Nature Neuroscience.

[34]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[35]  A. Pouget,et al.  Behavior and neural basis of near-optimal visual search , 2011, Nature Neuroscience.

[36]  Alexander Mendiburu,et al.  Multi-start Methods , 2018, Handbook of Heuristics.

[37]  Luigi Acerbi,et al.  Bayesian comparison of explicit and implicit causal inference strategies in multisensory heading perception , 2017, bioRxiv.

[38]  R. Zemel,et al.  Inference and computation with population codes. , 2003, Annual review of neuroscience.

[39]  J. R. Pomerantz,et al.  A century of Gestalt psychology in visual perception: II. Conceptual and theoretical foundations. , 2012, Psychological bulletin.

[40]  Ned Block,et al.  If perception is probabilistic, why does it not seem probabilistic? , 2018, Philosophical Transactions of the Royal Society B: Biological Sciences.

[41]  D. Wolpert,et al.  Cognitive Tomography Reveals Complex, Task-Independent Mental Representations , 2013, Current Biology.

[42]  Michael C. Frank,et al.  Review Pragmatic Language Interpretation as Probabilistic Inference , 2022 .

[43]  Pierre Baldi,et al.  Bayesian surprise attracts human attention , 2005, Vision Research.

[44]  J. Bowers,et al.  Bayesian just-so stories in psychology and neuroscience. , 2012, Psychological bulletin.

[45]  W. Ma Organizing probabilistic models of perception , 2012, Trends in Cognitive Sciences.

[46]  J. Tenenbaum,et al.  Theory-based Bayesian models of inductive learning and reasoning , 2006, Trends in Cognitive Sciences.