A computational analysis of the neural bases of Bayesian inference

Empirical support for the Bayesian brain hypothesis, although of major theoretical importance for cognitive neuroscience, is surprisingly scarce. This hypothesis posits simply that neural activities code and compute Bayesian probabilities. Here, we introduce an urn-ball paradigm to relate event-related potentials (ERPs) such as the P300 wave to Bayesian inference. Bayesian model comparison is conducted to compare various models in terms of their ability to explain trial-by-trial variation in ERP responses at different points in time and over different regions of the scalp. Specifically, we are interested in dissociating specific ERP responses in terms of Bayesian updating and predictive surprise. Bayesian updating refers to changes in probability distributions given new observations, while predictive surprise equals the surprise about observations under current probability distributions. Components of the late positive complex (P3a, P3b, Slow Wave) provide dissociable measures of Bayesian updating and predictive surprise. Specifically, the updating of beliefs about hidden states yields the best fit for the anteriorly distributed P3a, whereas the updating of predictions of observations accounts best for the posteriorly distributed Slow Wave. In addition, parietally distributed P3b responses are best fit by predictive surprise. These results indicate that the three components of the late positive complex reflect distinct neural computations. As such they are consistent with the Bayesian brain hypothesis, but these neural computations seem to be subject to nonlinear probability weighting. We integrate these findings with the free-energy principle that instantiates the Bayesian brain hypothesis.

[1]  E. John,et al.  Evoked-Potential Correlates of Stimulus Uncertainty , 1965, Science.

[2]  S. Kelly,et al.  A supramodal accumulation-to-bound signal that determines perceptual decisions in humans , 2012, Nature Neuroscience.

[3]  E. T. Jaynes,et al.  How Does the Brain Do Plausible Reasoning , 1988 .

[4]  Colin Camerer,et al.  Neural Response to Reward Anticipation under Risk Is Nonlinear in Probabilities , 2009, The Journal of Neuroscience.

[5]  Joaquín M. Fuster The Prefrontal Cortex Makes the Brain a Preadaptive System , 2014, Proceedings of the IEEE.

[6]  Geoffrey E. Hinton,et al.  The Helmholtz Machine , 1995, Neural Computation.

[7]  Jonathan R. Folstein,et al.  Influence of cognitive control and mismatch on the N2 component of the ERP: a review. , 2007, Psychophysiology.

[8]  Colin Camerer,et al.  A framework for studying the neurobiology of value-based decision making , 2008, Nature Reviews Neuroscience.

[9]  Hugo L. Fernandes,et al.  Differential Representations of Prior and Likelihood Uncertainty in the Human Brain , 2012, Current Biology.

[10]  Berrin Maraşligil,et al.  İnsanlarda Yenilik N2 Yanıtı Hedef Uyaranların Zamansal Sınıflamasını Yansıtır , 2011 .

[11]  R. Heuser Surprise, surprise , 2014, Catheterization and cardiovascular interventions : official journal of the Society for Cardiac Angiography & Interventions.

[12]  R. Poldrack,et al.  Prospect Theory and the Brain , 2009 .

[13]  David M. Grether,et al.  Testing Bayes Rule and the Representativeness Heuristic: Some Experimental Evidence , 1992 .

[14]  Stanislas Dehaene,et al.  Accumulation of Evidence during Sequential Decision Making: The Importance of Top–Down Factors , 2010, The Journal of Neuroscience.

[15]  S. Quartz,et al.  Neural Differentiation of Expected Reward and Risk in Human Subcortical Structures , 2006, Neuron.

[16]  Hiroshi Nittono,et al.  Motivational significance and cognitive effort elicit different late positive potentials , 2015, Clinical Neurophysiology.

[17]  David J. Weiss,et al.  Conservatism in a Simple Probability Inference Task , 2008 .

[18]  W. Schultz,et al.  The Human Brain Encodes Event Frequencies While Forming Subjective Beliefs , 2013, The Journal of Neuroscience.

[19]  Christian P. Robert,et al.  The Bayesian choice : from decision-theoretic foundations to computational implementation , 2007 .

[20]  E. Donchin,et al.  Parsing the late positive complex: mental chronometry and the ERP components that inhabit the neighborhood of the P300. , 2004, Psychophysiology.

[21]  Karl J. Friston,et al.  Modelling Trial-by-Trial Changes in the Mismatch Negativity , 2013, PLoS Comput. Biol..

[22]  Robert L. Wolpert,et al.  Statistical Inference , 2019, Encyclopedia of Social Network Analysis and Mining.

[23]  J. O'Doherty,et al.  The Role of the Ventromedial Prefrontal Cortex in Abstract State-Based Inference during Decision Making in Humans , 2006, The Journal of Neuroscience.

[24]  J. Polich Updating P 300 : An Integrative Theory of P 3 a and P 3 b , 2009 .

[25]  Daniel R. Cavagnaro,et al.  Discriminating among probability weighting functions using adaptive design optimization , 2013, Journal of risk and uncertainty.

[26]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[27]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[28]  Konrad Kording,et al.  Annals of the New York Academy of Sciences Bayesian Models: the Structure of the World, Uncertainty, Behavior, and the Brain , 2022 .

[29]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[30]  L. Maloney,et al.  The Neural Correlates of Subjective Utility of Monetary Outcome and Probability Weight in Economic and in Motor Decision under Risk , 2011, The Journal of Neuroscience.

[31]  S. Kelly,et al.  Internal and External Influences on the Rate of Sensory Evidence Accumulation in the Human Brain , 2013, The Journal of Neuroscience.

[32]  A. Pouget,et al.  Probabilistic brains: knowns and unknowns , 2013, Nature Neuroscience.

[33]  E. Donchin Presidential address, 1980. Surprise!...Surprise? , 1981, Psychophysiology.

[34]  R. Poldrack,et al.  Prospect theory on the brain? Toward a cognitive neuroscience of decision under risk. , 2005, Brain research. Cognitive brain research.

[35]  Xiao-Jing Wang,et al.  Synaptic computation underlying probabilistic inference , 2010, Nature Neuroscience.

[36]  Simon Haykin,et al.  On Cognitive Dynamic Systems: Cognitive Neuroscience and Engineering Learning From Each Other , 2014, Proceedings of the IEEE.

[37]  Michael N. Shadlen,et al.  Probabilistic reasoning by neurons , 2007, Nature.

[38]  S. Hillyard,et al.  Electrophysiology of Cognition , 2011 .

[39]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[40]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[41]  Gregory S. Berns,et al.  Nonlinear neurobiological probability weighting functions for aversive outcomes , 2008, NeuroImage.

[42]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[43]  D. M. Grether,et al.  Bayes Rule as a Descriptive Model: The Representativeness Heuristic , 1980 .

[44]  C. Summerfield,et al.  A Neural Representation of Prior Information during Perceptual Inference , 2008, Neuron.

[45]  Rajesh P. N. Rao,et al.  Bayesian brain : probabilistic approaches to neural coding , 2006 .

[46]  R. Baierlein Probability Theory: The Logic of Science , 2004 .

[47]  Emily Bell,et al.  Striatal topography of probability and magnitude information for decisions under uncertainty , 2012, NeuroImage.

[48]  Karl J. Friston,et al.  Bayesian model selection for group studies , 2009, NeuroImage.

[49]  Colin Camerer,et al.  Behavioral / Systems / Cognitive Dopamine D 1 Receptors and Nonlinear Probability Weighting in Risky Choice , 2010 .

[50]  Johan A. du Preez,et al.  Audio-Visual Speech Recognition using SciPy , 2010 .

[51]  B. Kopp,et al.  Electrophysiological indicators of surprise and entropy in dynamic task-switching environments , 2013, Front. Hum. Neurosci..

[52]  P. Dayan,et al.  Goals and Habits in the Brain , 2013, Neuron.

[53]  E. Donchin,et al.  Is the P300 component a manifestation of context updating? , 1988, Behavioral and Brain Sciences.

[54]  Colin Camerer,et al.  Neuroeconomics: decision making and the brain , 2008 .

[55]  E Donchin,et al.  A new method for off-line removal of ocular artifact. , 1983, Electroencephalography and clinical neurophysiology.

[56]  Tim Fingscheidt,et al.  A Model-Based Approach to Trial-By-Trial P300 Amplitude Fluctuations , 2013, Front. Hum. Neurosci..

[57]  Claude E. Shannon,et al.  The mathematical theory of communication , 1950 .

[58]  Stefan J. Kiebel,et al.  Evidence for neural encoding of Bayesian surprise in human somatosensation , 2012, NeuroImage.

[59]  S. Luck An Introduction to the Event-Related Potential Technique , 2005 .

[60]  A. Clark Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[61]  Karl J. Friston,et al.  Classical and Bayesian Inference in Neuroimaging: Theory , 2002, NeuroImage.

[62]  D. Ruchkin,et al.  Toward a functional categorization of slow waves. , 1988, Psychophysiology.

[63]  Karl J. Friston,et al.  Observing the Observer (II): Deciding When to Decide , 2010, PloS one.

[64]  Marco Steinhauser,et al.  The neural basis of belief updating and rational decision making. , 2014, Social cognitive and affective neuroscience.

[65]  Peter N. C. Mohr,et al.  Neural Processing of Risk , 2010, The Journal of Neuroscience.

[66]  Peter Bossaerts,et al.  Risk and risk prediction error signals in anterior insula , 2010, Brain Structure and Function.

[67]  L. Garcia-Larrea,et al.  P3, positive slow wave and working memory load: a study on the functional correlates of slow wave activity. , 1998, Electroencephalography and clinical neurophysiology.

[68]  R. Dolan,et al.  Knowing how much you don't know: a neural organization of uncertainty estimates , 2012, Nature Reviews Neuroscience.

[69]  Daeyeol Lee,et al.  Functional Specialization of the Primate Frontal Cortex during Decision Making , 2007, The Journal of Neuroscience.

[70]  Christopher D. Fiorillo,et al.  Beyond Bayes: On the Need for a Unified and Jaynesian Definition of Probability and Information within Neuroscience , 2012, Inf..

[71]  Daniel S. Ruchkin,et al.  The Late Positive Complex , 1984, Annals of the New York Academy of Sciences.

[72]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[73]  George I. Christopoulos,et al.  Neuronal Distortions of Reward Probability without Choice , 2008, The Journal of Neuroscience.

[74]  Bruno B Averbeck,et al.  Parietal Cortex and Insula Relate to Evidence Seeking Relevant to Reward-Related Decisions , 2011, The Journal of Neuroscience.

[75]  Hang Zhang,et al.  Ubiquitous Log Odds: A Common Representation of Probability and Frequency Distortion in Perception, Action, and Cognition , 2012, Front. Neurosci..

[76]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[77]  William D. Penny,et al.  Comparing Dynamic Causal Models using AIC, BIC and Free Energy , 2012, NeuroImage.

[78]  A. Tversky,et al.  Advances in prospect theory: Cumulative representation of uncertainty , 1992 .

[79]  Karl J. Friston,et al.  Variational free energy and the Laplace approximation , 2007, NeuroImage.

[80]  Richard Gonzalez,et al.  On the Shape of the Probability Weighting Function , 1999, Cognitive Psychology.

[81]  Lionel Rigoux,et al.  VBA: A Probabilistic Treatment of Nonlinear Models for Neurobiological and Behavioural Data , 2014, PLoS Comput. Biol..

[82]  Sharon Bertsch McGrayne,et al.  The Theory That Would Not Die: How Bayes' Rule Cracked the Enigma Code, Hunted Down Russian Submarines, and Emerged Triumphant from Two Centuries of Controversy , 2011 .

[83]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[84]  Pierre Baldi,et al.  Of bits and wows: A Bayesian theory of surprise with applications to attention , 2010, Neural Networks.

[85]  E. Donchin,et al.  Spatiotemporal analysis of the late ERP responses to deviant stimuli. , 2001, Psychophysiology.

[86]  Karl J. Friston,et al.  Comparing hemodynamic models with DCM , 2007, NeuroImage.

[87]  Raymond J. Dolan,et al.  Information theory, novelty and hippocampal responses: unpredicted or unpredictable? , 2005, Neural Networks.

[88]  Christopher Summerfield,et al.  Building Bridges between Perceptual and Economic Decision-Making: Neural and Computational Mechanisms , 2012, Front. Neurosci..

[89]  Jacqueline A. Rushby,et al.  An orienting reflex perspective on anteriorisation of the P3 of the event-related potential , 2006, Experimental Brain Research.

[90]  Philip Seeman,et al.  The Dopamine D1 Receptors , 1992 .

[91]  J. Polich Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[92]  Karl J. Friston,et al.  Comparing dynamic causal models , 2004, NeuroImage.

[93]  Karl J. Friston,et al.  Comparing Families of Dynamic Causal Models , 2010, PLoS Comput. Biol..

[94]  Daniel S. Ruchkin,et al.  N250 latency and decision time , 1980 .

[95]  A. Verschoor,et al.  The probability weighting function: experimental evidence from Uganda, India and Ethiopia , 2004 .

[96]  Pierre Baldi,et al.  Bayesian surprise attracts human attention , 2005, Vision Research.

[97]  Floris P. de Lange,et al.  Prior Expectations Evoke Stimulus Templates in the Primary Visual Cortex , 2014, Journal of Cognitive Neuroscience.

[98]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[99]  S. Nieuwenhuis,et al.  The anatomical and functional relationship between the P3 and autonomic components of the orienting response. , 2011, Psychophysiology.

[100]  S. Quartz,et al.  Human Insula Activation Reflects Risk Prediction Errors As Well As Risk , 2008, The Journal of Neuroscience.

[101]  D. Friedman,et al.  The novelty P3: an event-related brain potential (ERP) sign of the brain's evaluation of novelty , 2001, Neuroscience & Biobehavioral Reviews.

[102]  G. Casella,et al.  Statistical Inference , 2003, Encyclopedia of Social Network Analysis and Mining.

[103]  Wei Ji Ma,et al.  Probabilistic brains: knowns and , 2013 .

[104]  Robert T. Knight,et al.  Think differently: a brain orienting response to task novelty , 2002, Neuroreport.