Selective and graded coding of reward uncertainty by neurons in the primate anterodorsal septal region

Natural environments are uncertain. Uncertainty of emotional outcomes can induce anxiety and raise vigilance, promote and signal the opportunity for learning, modulate economic choice and regulate risk-seeking. Here we demonstrate that a subset of neurons in the anterodorsal region of the primate septum (ADS) are primarily devoted to processing uncertainty in a highly specific manner. Those neurons were selectively activated by visual cues indicating probabilistic delivery of reward (for example, 25%, 50% and 75% reward) and did not respond to cues indicating certain outcomes (0% and 100% reward). The average ADS uncertainty response was graded with the magnitude of reward uncertainty and selectively signaled uncertainty about rewards rather than punishments. The selective and graded information about reward uncertainty encoded by many neurons in the ADS may underlie modulation of uncertainty of value- and sensorimotor-related areas to regulate goal-directed behavior.

[1]  David A. Leopold,et al.  pyElectrode: An open-source tool using structural MRI for electrode positioning and neuron mapping , 2013, Journal of Neuroscience Methods.

[2]  From The Laboratory To The Clinic , 1998 .

[3]  S. Kakade,et al.  Learning and selective attention , 2000, Nature Neuroscience.

[4]  J. Herbert,et al.  Endogenous steroids and financial risk taking on a London trading floor , 2008, Proceedings of the National Academy of Sciences.

[5]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[6]  Jordan B. Peterson,et al.  Psychological entropy: a framework for understanding uncertainty-related anxiety. , 2012, Psychological review.

[7]  L. Swanson,et al.  Connections of the rat lateral septal complex 1 Published on the World Wide Web on 2 June 1997. 1 , 1997, Brain Research Reviews.

[8]  Guillem R. Esber,et al.  Reconciling the influence of predictiveness and uncertainty on stimulus salience: a model of attention in associative learning , 2011, Proceedings of the Royal Society B: Biological Sciences.

[9]  Colin Camerer,et al.  Neural Systems Responding to Degrees of Uncertainty in Human Decision-Making , 2005, Science.

[10]  Timothy E. J. Behrens,et al.  Learning the value of information in an uncertain world , 2007, Nature Neuroscience.

[11]  George I. Christopoulos,et al.  Neural Correlates of Value, Risk, and Risk Aversion Contributing to Decision Making under Risk , 2009, The Journal of Neuroscience.

[12]  C. Olson,et al.  Functional heterogeneity in cingulate cortex: the anterior executive and posterior evaluative regions. , 1992, Cerebral cortex.

[13]  W. Cowan,et al.  The connections of the septal region in the rat , 1979, The Journal of comparative neurology.

[14]  A. Neuringer.  Operant variability: Evidence, functions, and theory , 2002, Psychonomic bulletin & review.

[15]  M. Platt,et al.  Risk-sensitive neurons in macaque posterior cingulate cortex , 2005, Nature Neuroscience.

[16]  J. Staiger,et al.  The efferent connections of the lateral septal nucleus in the guinea pig: intrinsic connectivity of the septum and projections to other telencephalic areas , 1991, Cell and Tissue Research.

[17]  Angela J. Yu,et al.  Uncertainty, Neuromodulation, and Attention , 2005, Neuron.

[18]  Geoffrey Schoenbaum,et al.  Risk-Responsive Orbitofrontal Neurons Track Acquired Salience , 2013, Neuron.

[19]  K. Ressler,et al.  Targeting abnormal neural circuits in mood and anxiety disorders: from the laboratory to the clinic , 2007, Nature Neuroscience.

[20]  R. Chambers,et al.  Regulation of affect by the lateral septum: implications for neuropsychiatry , 2004, Brain Research Reviews.

[21]  D. Treit,et al.  Lateral and medial septal lesions reduce anxiety in the plus-maze and probe-burying tests , 1996, Physiology & Behavior.

[22]  W. Schultz,et al.  Coding of Reward Risk by Orbitofrontal Neurons Is Mostly Distinct from Coding of Reward Value , 2010, Neuron.

[23]  E. Weber,et al.  Predicting Risk-Sensitivity in Humans and Lower Animals: Risk as Variance or Coefficient of Variation , 2004, Psychological review.

[24]  Ethan S. Bromberg-Martin,et al.  Midbrain Dopamine Neurons Signal Preference for Advance Information about Upcoming Rewards , 2009, Neuron.

[25]  J. Pearce,et al.  A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. , 1980, Psychological review.

[26]  L. Fellows,et al.  Beyond Reversal: A Critical Role for Human Orbitofrontal Cortex in Flexible Learning from Probabilistic Feedback , 2010, The Journal of Neuroscience.

[27]  J. Gray,et al.  Anxiolytic action on the behavioural inhibition system implies multiple types of arousal contribute to anxiety. , 2000, Journal of affective disorders.

[28]  C. Padoa-Schioppa,et al.  Neurons in the orbitofrontal cortex encode economic value , 2006, Nature.

[29]  J. Schulkin,et al.  From normal fear to pathological anxiety. , 1998, Psychological review.

[30]  S. Quartz,et al.  Neural Differentiation of Expected Reward and Risk in Human Subcortical Structures , 2006, Neuron.

[31]  S. Quartz,et al.  Human Insula Activation Reflects Risk Prediction Errors As Well As Risk , 2008, The Journal of Neuroscience.

[32]  Robert C. Wolpert,et al.  A Review of the , 1985 .

[33]  Ilya E Monosov,et al.  Regionally Distinct Processing of Rewards and Punishments by the Primate Ventromedial Prefrontal Cortex , 2012, The Journal of Neuroscience.

[34]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[35]  R. Dolan,et al.  Knowing how much you don't know: a neural organization of uncertainty estimates , 2012, Nature Reviews Neuroscience.

[36]  O. Hikosaka,et al.  Representation of negative motivational value in the primate lateral habenula , 2009, Nature Neuroscience.

[37]  M. Platt,et al.  Risky business: the neuroeconomics of decision making under uncertainty , 2008, Nature Neuroscience.

[38]  W. Schultz,et al.  Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons , 2003, Science.

[39]  E. W. Powell.  Limbic projections to the thalamus , 1973, Experimental Brain Research.

[40]  L. Swanson,et al.  Chemoarchitecture of the rat lateral septal nucleus 1 Published on the World Wide Web on 2 June 1997. 1 , 1997, Brain Research Reviews.

[41]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[42]  J. Pearce,et al.  A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli. , 1980 .

[43]  T. Ono,et al.  Motivation‐related neuronal activity in the object discrimination task in monkey septal nuclei , 1997, Hippocampus.

[44]  T. Ono,et al.  Septal neuronal responses related to spatial representation in monkeys , 1997, Hippocampus.

[45]  D L Rosene,et al.  Cingulate cortex of the rhesus monkey: I. Cytoarchitecture and thalamic afferents , 1987, The Journal of comparative neurology.

[46]  Timothy E. J. Behrens,et al.  Choice, uncertainty and value in prefrontal and cingulate cortex , 2008, Nature Neuroscience.

[47]  C. Cavada,et al.  The anatomical connections of the macaque monkey orbitofrontal cortex. A review. , 2000, Cerebral cortex.

[48]  Colin Camerer,et al.  Explicit neural signals reflecting reward uncertainty , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[49]  P. Anselme,et al.  The uncertainty processing theory of motivation , 2010, Behavioural Brain Research.

[50]  Timothy E. J. Behrens,et al.  Giving credit where credit is due: orbitofrontal cortex and valuation in an uncertain world , 2011, Annals of the New York Academy of Sciences.

[51]  N. McNaughton,et al.  Comparison between the behavioural effects of septal and hippocampal lesions: A review , 1983, Neuroscience & Biobehavioral Reviews.

[52]  Christian Grillon,et al.  Assessing fear and anxiety in humans using the threat of predictable and unpredictable aversive events (the NPU-threat test) , 2012, Nature Protocols.

[53]  K. Preuschoff,et al.  Adding Prediction Risk to the Theory of Reward Learning , 2007, Annals of the New York Academy of Sciences.