Bayes in the Brain—On Bayesian Modelling in Neuroscience

According to a growing trend in theoretical neuroscience, the human perceptual system is akin to a Bayesian machine. The aim of this article is to clearly articulate the claims that perception can be considered Bayesian inference and that the brain can be considered a Bayesian machine, some of the epistemological challenges to these claims; and some of the implications of these claims. We address two questions: (i) How are Bayesian models used in theoretical neuroscience? (ii) From the use of Bayesian models in theoretical neuroscience, have we learned or can we hope to learn that perception is Bayesian inference or that the brain is a Bayesian machine? From actual practice in theoretical neuroscience, we argue for three claims. First, currently Bayesian models do not provide mechanistic explanations; instead they are useful devices for predicting and systematizing observational statements about people's performances in a variety of perceptual tasks. That is, currently we should have an instrumentalist attitude towards Bayesian models in neuroscience. Second, the inference typically drawn from Bayesian behavioural performance in a variety of perceptual tasks to underlying Bayesian mechanisms should be understood within the three-level framework laid out by David Marr ([1982]). Third, we can hope to learn that perception is Bayesian inference or that the brain is a Bayesian machine to the extent that Bayesian models will prove successful in yielding secure and informative predictions of both subjects' perceptual performance and features of the underlying neural mechanisms. 1 Introduction 2 Theoretical Neuroscientists meet Bayes 3 Is Perception Bayesian Inference? 4 How Should we Understand the Inference from Bayesian Observers to Bayesian Brains? 5 How Could we Discover that Brains are Bayesian? 6 Conclusion 1 Introduction 2 Theoretical Neuroscientists meet Bayes 3 Is Perception Bayesian Inference? 4 How Should we Understand the Inference from Bayesian Observers to Bayesian Brains? 5 How Could we Discover that Brains are Bayesian? 6 Conclusion

[1]  P. Leoni Long-Range Out-of-Sample Properties of Autoregressive Neural Networks , 2009, Neural Computation.

[2]  Wei Ji Ma,et al.  Spiking networks for Bayesian inference and choice , 2008, Current Opinion in Neurobiology.

[3]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[4]  Wei Ji Ma,et al.  Comparing Bayesian models for multisensory cue combination without mandatory integration , 2007, NIPS.

[5]  M. Ernst,et al.  Experience can change the 'light-from-above' prior , 2004, Nature Neuroscience.

[6]  C. Ray Smith,et al.  Maximum-entropy and Bayesian methods in science and engineering , 1988 .

[7]  Eero P. Simoncelli,et al.  Noise characteristics and prior expectations in human visual speed perception , 2006, Nature Neuroscience.

[8]  David C Knill,et al.  Reaching for visual cues to depth: the brain combines depth cues differently for motor control and perception. , 2005, Journal of vision.

[9]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[10]  M. Eckstein,et al.  Perceptual learning through optimization of attentional weighting: human versus optimal Bayesian learner. , 2004, Journal of vision.

[11]  S. Psillos Scientific Realism: How Science Tracks Truth , 1999 .

[12]  H. Putnam Mathematics, Matter, And Method , 1975 .

[13]  A. Musgrave,et al.  Logical versus Historical Theories of Confirmation , 1974, The British Journal for the Philosophy of Science.

[14]  S. Psillos,et al.  The Routledge Companion to Philosophy of Science , 2008 .

[15]  Journal of the Optical Society of America , 1950, Nature.

[16]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[17]  David Danks,et al.  Rational Analyses, Instrumentalism, and Implementations , 2008 .

[18]  Rajesh P. N. Rao Bayesian Computation in Recurrent Neural Circuits , 2004, Neural Computation.

[19]  Aaron R. Seitz,et al.  Rapidly learned stimulus expectations alter perception of motion. , 2010, Journal of vision.

[20]  Adam Binch,et al.  Perception as Bayesian Inference , 2014 .

[21]  Nicole C Rust,et al.  Ambiguity and invariance: two fundamental challenges for visual processing , 2010, Current Opinion in Neurobiology.

[22]  Michael Devitt Realism/Anti-Realism , 2013 .

[23]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[24]  P. Machamer,et al.  Thinking about Mechanisms , 2000, Philosophy of Science.

[25]  Laurence T. Maloney,et al.  Statistical Decision Theory and Biological Vision , 2005 .

[26]  J. Saunders,et al.  Do humans optimally integrate stereo and texture information for judgments of surface slant? , 2003, Vision Research.

[27]  E. Bizzi,et al.  The Cognitive Neurosciences , 1996 .

[28]  David C. Knill,et al.  Introduction: a Bayesian formulation of visual perception , 1996 .

[29]  Timothy D. Hanks,et al.  Probabilistic Population Codes for Bayesian Decision Making , 2008, Neuron.

[30]  J. Bogen,et al.  Regularities and causality; generalizations and causal explanations. , 2005, Studies in history and philosophy of biological and biomedical sciences.

[31]  R. Weale Vision. A Computational Investigation Into the Human Representation and Processing of Visual Information. David Marr , 1983 .

[32]  S. Psillos,et al.  Routledge Companion to the Philosophy of Science , 2008 .

[33]  E. Bickerstaff Explaining the Brain , 1976 .

[34]  Paul R. Schrater,et al.  Vision, Psychophysics and Bayes , 2001 .

[35]  Antony B. Morland,et al.  Perceptual distortions of speed at low luminance: Evidence inconsistent with a Bayesian account of speed encoding , 2007, Vision Research.

[36]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[37]  Sophie Denève,et al.  Bayesian Spiking Neurons I: Inference , 2008, Neural Computation.

[38]  D. Alais,et al.  Orientation tuning of contrast masking caused by motion streaks. , 2010, Journal of vision.

[39]  Rajesh P. N. Rao,et al.  Bayesian brain : probabilistic approaches to neural coding , 2006 .

[40]  J. Tenenbaum,et al.  Probabilistic models of cognition: exploring representations and inductive biases , 2010, Trends in Cognitive Sciences.

[41]  Lefteris Farmakis Inference to the Best Explanation, 2nd edition , 2004 .

[42]  Hermann von Helmholtz,et al.  Treatise on Physiological Optics , 1962 .

[43]  Alan A. Stocker,et al.  Is the Homunculus Aware of Sensory Adaptation? , 2009, Neural Computation.

[44]  Maurice A Smith,et al.  Bayesian and "anti-Bayesian" biases in sensory integration for action and perception in the size-weight illusion. , 2010, Journal of neurophysiology.

[45]  N. Chater,et al.  The probabilistic mind: prospects for Bayesian cognitive science , 2008 .

[46]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[47]  Paul R. Schrater,et al.  Pattern inference theory: A probabilistic approach to vision , 2002 .

[48]  K Nakayama,et al.  Experiencing and perceiving visual surfaces. , 1992, Science.

[49]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[50]  Karl J. Friston,et al.  Free-energy and the brain , 2007, Synthese.

[51]  L. Maloney,et al.  Bayesian decision theory as a model of human visual perception: Testing Bayesian transfer , 2009, Visual Neuroscience.

[52]  W. Richards,et al.  Perception as Bayesian Inference , 2008 .

[53]  Rajesh P. N. Rao,et al.  Probabilistic Models of the Brain: Perception and Neural Function , 2002 .

[54]  Christopher Hitchcock,et al.  Prediction Versus Accommodation and the Risk of Overfitting , 2004, The British Journal for the Philosophy of Science.

[55]  E. T. Jaynes,et al.  How Does the Brain Do Plausible Reasoning , 1988 .

[56]  Allison M McKendrick,et al.  The effect of normal aging on closed contour shape discrimination. , 2010, Journal of vision.

[57]  D H Brainard,et al.  Bayesian color constancy. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[58]  Eero P. Simoncelli Optimal Estimation in Sensory Systems , 2009 .

[59]  Edward H. Adelson,et al.  Motion illusions as optimal percepts , 2002, Nature Neuroscience.

[60]  Konrad Paul Körding,et al.  The loss function of sensorimotor learning. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[61]  P. Kleingeld,et al.  The Stanford Encyclopedia of Philosophy , 2013 .

[62]  M.-C. Dubois,et al.  Light from above , 2003 .

[63]  R. Mausfeld,et al.  Perception and the Physical World: Psychological and Philosophical Issues in Perception , 2002 .