Bayesian Models of Brain and Behaviour

This paper presents a review of Bayesian models of brain and behaviour. We first review the basic principles of Bayesian inference. This is followed by descriptions of sampling and variational methods for approximate inference, and forward and backward recursions in time for inference in dynamical models. The review of behavioural models covers work in visual processing, sensory integration, sensorimotor integration, and collective decision making. The review of brain models covers a range of spatial scales from synapses to neurons and population codes, but with an emphasis on models of cortical hierarchies. We describe a simple hierarchical model which provides a mathematical framework relating constructs in Bayesian inference to those in neural computation. We close by reviewing recent theoretical developments in Bayesian inference for planning and control.

[1]  E. Todorov Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[2]  M. Carandini,et al.  Normalization as a canonical neural computation , 2011, Nature Reviews Neuroscience.

[3]  Karl J. Friston,et al.  A Hierarchy of Time-Scales and the Brain , 2008, PLoS Comput. Biol..

[4]  S. Denéve,et al.  Neural processing as causal inference , 2011, Current Opinion in Neurobiology.

[5]  Aapo Hyvärinen,et al.  Interpreting Neural Response Variability as Monte Carlo Sampling of the Posterior , 2002, NIPS.

[6]  J. Meditch,et al.  Applied optimal control , 1972, IEEE Transactions on Automatic Control.

[7]  Ajay Jasra,et al.  On population-based simulation for static inference , 2007, Stat. Comput..

[8]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[9]  Geoffrey E. Hinton Learning multiple layers of representation , 2007, Trends in Cognitive Sciences.

[10]  Jiri Najemnik,et al.  Eye movement statistics in humans are consistent with an optimal search strategy. , 2008, Journal of vision.

[11]  Christopher D. Fiorillo,et al.  Towards a General Theory of Neural Computation Based on Prediction by Single Neurons , 2008, PloS one.

[12]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[13]  Geoffrey E. Hinton,et al.  The Helmholtz Machine , 1995, Neural Computation.

[14]  Sophie Denève,et al.  Bayesian Spiking Neurons II: Learning , 2008, Neural Computation.

[15]  J. Gold,et al.  Neural computations that underlie decisions about sensory stimuli , 2001, Trends in Cognitive Sciences.

[16]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[17]  Angela J. Yu,et al.  Uncertainty, Neuromodulation, and Attention , 2005, Neuron.

[18]  DeLiang Wang,et al.  Unsupervised Learning: Foundations of Neural Computation , 2001, AI Mag..

[19]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[20]  S. Morad,et al.  Ceramide-orchestrated signalling in cancer cells , 2012, Nature Reviews Cancer.

[21]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[22]  Rajesh P. N. Rao,et al.  Bayesian brain : probabilistic approaches to neural coding , 2006 .

[23]  D Mumford,et al.  On the computational architecture of the neocortex. II. The role of cortico-cortical loops. , 1992, Biological cybernetics.

[24]  Jason D. Warren,et al.  The Oxford Companion to the Mind , 2005 .

[25]  A. Pouget,et al.  Marginalization in Neural Circuits with Divisive Normalization , 2011, The Journal of Neuroscience.

[26]  Karl J. Friston,et al.  Preserved Feedforward But Impaired Top-Down Processes in the Vegetative State , 2011, Science.

[27]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[28]  P. Dayan,et al.  Matching storage and recall: hippocampal spike timing–dependent plasticity and phase response curves , 2005, Nature Neuroscience.

[29]  Karl J. Friston,et al.  Free Energy and Dendritic Self-Organization , 2011, Front. Syst. Neurosci..

[30]  Karl J. Friston,et al.  Dynamic causal modelling , 2003, NeuroImage.

[31]  G. Shepherd The Synaptic Organization of the Brain , 1979 .

[32]  Aapo Hyvärinen,et al.  A two-layer sparse coding model learns simple and complex cell receptive fields and topography from natural images , 2001, Vision Research.

[33]  Raymond J. Dolan,et al.  Dopamine, Affordance and Active Inference , 2012, PLoS Comput. Biol..

[34]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[35]  Philip Holmes,et al.  Dynamical Analysis of Bayesian Inference Models for the Eriksen Task , 2009, Neural Computation.

[36]  Emanuel Todorov,et al.  General duality between optimal control and estimation , 2008, 2008 47th IEEE Conference on Decision and Control.

[37]  A. Yuille,et al.  Object perception as Bayesian inference. , 2004, Annual review of psychology.

[38]  Adam Binch,et al.  Perception as Bayesian Inference , 2014 .

[39]  Nicole C Rust,et al.  Ambiguity and invariance: two fundamental challenges for visual processing , 2010, Current Opinion in Neurobiology.

[40]  Marc Toussaint,et al.  Robot trajectory optimization using approximate inference , 2009, ICML '09.

[41]  R D Sorkin,et al.  Signal-detection analysis of group decision making. , 2001, Psychological review.

[42]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[43]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[44]  Zoubin Ghahramani,et al.  Propagation Algorithms for Variational Bayesian Learning , 2000, NIPS.

[45]  W. Schultz,et al.  Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons , 2003, Science.

[46]  M. Ernst,et al.  Experience can change the 'light-from-above' prior , 2004, Nature Neuroscience.

[47]  Eero P. Simoncelli,et al.  Noise characteristics and prior expectations in human visual speed perception , 2006, Nature Neuroscience.

[48]  Karl J. Friston,et al.  Predictions not commands: active inference in the motor system , 2012, Brain Structure and Function.

[49]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[50]  Michael S. Lewicki,et al.  Efficient auditory coding , 2006, Nature.

[51]  P. A. Kolers,et al.  Shape and color in apparent motion , 1976, Vision Research.

[52]  Rajesh P. N. Rao,et al.  Dynamic Model of Visual Recognition Predicts Neural Response Properties in the Visual Cortex , 1997, Neural Computation.

[53]  Wilson S. Geisler,et al.  Optimal eye movement strategies in visual search , 2005, Nature.

[54]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[55]  Angela J. Yu,et al.  Dynamics of attentional selection under conflict: toward a rational Bayesian account. , 2009, Journal of experimental psychology. Human perception and performance.

[56]  Matthew J. Beal Variational algorithms for approximate Bayesian inference , 2003 .

[57]  Karl J. Friston,et al.  Dynamic causal modeling , 2010, Scholarpedia.

[58]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[59]  Emanuel Todorov,et al.  Efficient computation of optimal actions , 2009, Proceedings of the National Academy of Sciences.

[60]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[61]  R. Sundareswara,et al.  Perceptual multistability predicted by search model for Bayesian decisions. , 2008, Journal of vision.

[62]  R. Rosenfeld Nature , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[63]  S. W. Kuffler,et al.  From Neuron to Brain: A Cellular and Molecular Approach to the Function of the Nervous System , 1992 .

[64]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[65]  Richard S. Sutton,et al.  Reinforcement Learning , 1992, Handbook of Machine Learning.

[66]  D. Mumford On the computational architecture of the neocortex , 2004, Biological Cybernetics.

[67]  M. Mesulam,et al.  From sensation to cognition. , 1998, Brain : a journal of neurology.

[68]  R. Gregory Eye and Brain: The Psychology of Seeing , 1969 .

[69]  P. Latham,et al.  References and Notes Supporting Online Material Materials and Methods Figs. S1 to S11 References Movie S1 Optimally Interacting Minds R�ports , 2022 .

[70]  Zoubin Ghahramani,et al.  A Unifying Review of Linear Gaussian Models , 1999, Neural Computation.

[71]  R. Ivry,et al.  The coordination of movement: optimal feedback control and beyond , 2010, Trends in Cognitive Sciences.

[72]  Joshua B. Tenenbaum,et al.  Perceptual Multistability as Markov Chain Monte Carlo Inference , 2009, NIPS.

[73]  C. Frith,et al.  From drugs to deprivation: a Bayesian framework for understanding models of psychosis , 2009, Psychopharmacology.

[74]  Robert A Jacobs,et al.  Bayesian integration of visual and auditory signals for spatial localization. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[75]  Mazyar Fallah,et al.  A Motion-Dependent Distortion of Retinotopy in Area V4 , 2006, Neuron.

[76]  Michael I. Jordan,et al.  Graphical models: Probabilistic inference , 2002 .

[77]  Matteo Colombo,et al.  Bayes in the Brain—On Bayesian Modelling in Neuroscience , 2012, The British Journal for the Philosophy of Science.

[78]  Edmund T. Rolls,et al.  Invariant Object Recognition in the Visual System with Novel Views of 3D Objects , 2002, Neural Computation.

[79]  Kenji Doya,et al.  Metalearning and neuromodulation , 2002, Neural Networks.

[80]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[81]  József Fiser,et al.  Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment , 2011, Science.

[82]  Peter Dayan,et al.  Inference, Attention, and Decision in a Bayesian Neural Architecture , 2004, NIPS.

[83]  Karl J. Friston The free-energy principle: a rough guide to the brain? , 2009, Trends in Cognitive Sciences.

[84]  P. Subramanian Active Vision: The Psychology of Looking and Seeing , 2006 .

[85]  A. Hasman,et al.  Probabilistic reasoning in intelligent systems: Networks of plausible inference , 1991 .

[86]  Hagai Attias,et al.  Planning by Probabilistic Inference , 2003, AISTATS.

[87]  Peter Dayan,et al.  A Hierarchical Model of Binocular Rivalry , 1998, Neural Computation.

[88]  M.-C. Dubois Light from above , 2003 .

[89]  Neil J. Gordon,et al.  Editors: Sequential Monte Carlo Methods in Practice , 2001 .

[90]  T J Sejnowski,et al.  Motion integration and postdiction in visual awareness. , 2000, Science.

[91]  Karl J. Friston,et al.  Variational Bayesian identification and prediction of stochastic nonlinear dynamic causal models , 2009, Physica D. Nonlinear phenomena.

[92]  J J Hopfield,et al.  What is a moment? Transient synchrony as a collective mechanism for spatiotemporal integration. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[93]  Barbara A. Wilson Making up the Mind: How the Brain Creates our Mental World , 2009 .

[94]  P. Tibbetts :Making up the Mind: How the Brain Creates our Mental World , 2007 .

[95]  Henry Kennedy,et al.  Self-organization and interareal networks in the primate cortex. , 2012, Progress in brain research.

[96]  J. Movshon,et al.  The statistical reliability of signals in single neurons in cat and monkey visual cortex , 1983, Vision Research.

[97]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.

[98]  L. Abbott,et al.  Synaptic computation , 2004, Nature.

[99]  J. Magnus,et al.  Are Points in Tennis Independent and Identically Distributed? Evidence From a Dynamic Binary Panel Data Model , 2001 .

[100]  P. Dayan,et al.  Synapses with short-term plasticity are optimal estimators of presynaptic membrane potentials , 2010, Nature Neuroscience.

[101]  D. Mackay The Epistemological Problem for Automata , 1956 .

[102]  Edward H. Adelson,et al.  Motion illusions as optimal percepts , 2002, Nature Neuroscience.

[103]  Peter Dayan,et al.  Uncertainty, phase and oscillatory hippocampal recall , 2006, NIPS.

[104]  Romi Nijhawan,et al.  Motion extrapolation in catching , 1994, Nature.

[105]  Wei Ji Ma,et al.  Spiking networks for Bayesian inference and choice , 2008, Current Opinion in Neurobiology.

[106]  Karl J. Friston,et al.  A free energy principle for the brain , 2006, Journal of Physiology-Paris.

[107]  L. Williams,et al.  Contents , 2020, Ophthalmology (Rochester, Minn.).

[108]  Dileep George,et al.  Towards a Mathematical Theory of Cortical Micro-circuits , 2009, PLoS Comput. Biol..

[109]  D. Wolpert,et al.  Two Eyes for an Eye: The Neuroscience of Force Escalation , 2003, Science.

[110]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[111]  Timothy J. Robinson,et al.  Sequential Monte Carlo Methods in Practice , 2003 .

[112]  Sophie Denève,et al.  Bayesian Spiking Neurons I: Inference , 2008, Neural Computation.

[113]  K. Sakai,et al.  Predictive and postdictive mechanisms jointly contribute to visual awareness , 2009, Consciousness and Cognition.

[114]  ChrisD . Frith,et al.  Perceiving is believing: a Bayesian approach to explaining the positive symptoms of schizophrenia , 2009, Nature Reviews Neuroscience.

[115]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[116]  David Terman,et al.  Mathematical foundations of neuroscience , 2010 .

[117]  Paul Cisek,et al.  Cortical mechanisms of action selection: the affordance competition hypothesis , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[118]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[119]  Karl J. Friston,et al.  Computational psychiatry , 2012, Trends in Cognitive Sciences.

[120]  S. Shipp Structure and function of the cerebral cortex , 2007, Current Biology.

[121]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[122]  Karl J. Friston,et al.  Computational psychiatry (vol 16, pg 72, 2012) , 2012 .

[123]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[124]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[125]  Kevan A. C. Martin,et al.  A Canonical Microcircuit for Neocortex , 1989, Neural Computation.

[126]  Karl J. Friston Learning and inference in the brain , 2003, Neural Networks.

[127]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[128]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[129]  Karl J. Friston,et al.  Evoked brain responses are generated by feedback loops , 2007, Proceedings of the National Academy of Sciences.