A neural mechanism underlying failure of optimal choice with multiple alternatives

Despite widespread interest in neural mechanisms of decision-making, most investigations focus on decisions between just two options. Here we adapt a biophysically plausible model of decision-making to predict how a key decision variable, the value difference signal—encoding how much better one choice is than another—changes with the value of a third, but unavailable, alternative. The model predicts a surprising failure of optimal decision-making: greater difficulty choosing between two options in the presence of a third very poor, as opposed to very good, alternative. Both investigation of human decision-making and functional magnetic resonance imaging–based measurements of value difference signals in ventromedial prefrontal cortex (vmPFC) bore out this prediction. The vmPFC signal decreased in the presence of low-value third alternatives, and vmPFC effect sizes predicted individual variation in suboptimal decision-making in the presence of multiple alternatives. The effect contrasts with that of divisive normalization in parietal cortex.

[1]  Stefan Everling,et al.  Specific Contributions of Ventromedial, Anterior Cingulate, and Lateral Prefrontal Cortex for Attentional Selection and Stimulus Valuation , 2011, PLoS biology.

[2]  Stephen M. Smith,et al.  General multilevel linear modeling for group analysis in FMRI , 2003, NeuroImage.

[3]  P. Glimcher,et al.  The neural correlates of subjective value during intertemporal choice , 2007, Nature Neuroscience.

[4]  Ann Allergy,et al.  O R I G I N a L a R T I C L E S , 2022 .

[5]  L. Fellows.  Deciding how to decide: ventromedial frontal lobe damage affects information acquisition in multi-attribute decision making. , 2006, Brain : a journal of neurology.

[6]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.

[7]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[8]  Mark W. Woolrich,et al.  Multilevel linear modelling for FMRI group analysis using Bayesian inference , 2004, NeuroImage.

[9]  Timothy Edward John Behrens,et al.  Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex , 2010, Proceedings of the National Academy of Sciences.

[10]  M. Woolrich,et al.  Mechanisms underlying cortical activity during value-guided choice , 2011, Nature Neuroscience.

[11]  Xiao-Jing Wang,et al.  A Biophysically Based Neural Model of Matching Law Behavior: Melioration by Stochastic Synapses , 2006, The Journal of Neuroscience.

[12]  Marios G Philiastides,et al.  A mechanistic account of value computation in the human brain , 2010, Proceedings of the National Academy of Sciences.

[13]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[14]  J. Kable,et al.  Ventromedial Frontal Lobe Damage Disrupts Value Maximization in Humans , 2011, The Journal of Neuroscience.

[15]  Ivan Toni,et al.  Cerebral Changes during Performance of Overlearned Arbitrary Visuomotor Associations , 2006, The Journal of Neuroscience.

[16]  John H. R. Maunsell,et al.  Shape selectivity in primate lateral intraparietal cortex , 1998, Nature.

[17]  Thomas H. B. FitzGerald,et al.  The Role of Human Orbitofrontal Cortex in Value Comparison for Incommensurable Objects , 2009, The Journal of Neuroscience.

[18]  Stephen M. Smith,et al.  A global optimisation method for robust affine registration of brain images , 2001, Medical Image Anal..

[19]  P. Glimcher,et al.  The Neurobiology of Decision: Consensus and Controversy , 2009, Neuron.

[20]  H. Seo,et al.  Lateral Intraparietal Cortex and Reinforcement Learning during a Mixed-Strategy Game , 2009, Journal of Neuroscience.

[21]  Antonio Rangel,et al.  The Decision Value Computations in the vmPFC and Striatum Use a Relative Value Code That is Guided by Visual Attention , 2011, The Journal of Neuroscience.

[22]  Joonyeol Lee,et al.  A Normalization Model of Attentional Modulation of Single Unit Responses , 2009, PloS one.

[23]  E. Murray,et al.  Dissociable Effects of Subtotal Lesions within the Macaque Orbital Prefrontal Cortex on Reward-Guided Behavior , 2011, The Journal of Neuroscience.

[24]  P. Glimcher,et al.  Reward Value-Based Gain Control: Divisive Normalization in Parietal Cortex , 2011, The Journal of Neuroscience.

[25]  S. Kennerley,et al.  Heterogeneous reward signals in prefrontal cortex , 2010, Current Opinion in Neurobiology.

[26]  W. Newsome,et al.  Choosing the greater of two goods: neural currencies for valuation and decision making , 2005, Nature Reviews Neuroscience.

[27]  L. Hunt,et al.  A mechanism for value-guided choice based on the excitation-inhibition balance in prefrontal cortex , 2012, Nature Neuroscience.

[28]  Ilya E Monosov,et al.  Regionally Distinct Processing of Rewards and Punishments by the Primate Ventromedial Prefrontal Cortex , 2012, The Journal of Neuroscience.

[29]  M. Shadlen,et al.  Decision-making with multiple alternatives , 2008, Nature Neuroscience.

[30]  R Turner,et al.  Optimized EPI for fMRI studies of the orbitofrontal cortex , 2003, NeuroImage.

[31]  Karl J. Friston,et al.  Psychophysiological and Modulatory Interactions in Neuroimaging , 1997, NeuroImage.

[32]  Mark Jenkinson,et al.  Fast, automated, N‐dimensional phase‐unwrapping algorithm , 2003, Magnetic resonance in medicine.

[33]  J. Wallis.  Cross-species studies of orbitofrontal cortex and value-based decision-making , 2011, Nature Neuroscience.

[34]  B. Richmond,et al.  Ventromedial and Orbital Prefrontal Neurons Differentially Encode Internally and Externally Driven Motivational Values in Monkeys , 2010, The Journal of Neuroscience.

[35]  Alan Cowey,et al.  Temporal aspects of visual search studied by transcranial magnetic stimulation , 1997, Neuropsychologia.

[36]  M. Walton,et al.  Re‐evaluating the role of the orbitofrontal cortex in reward and reinforcement , 2012, The European journal of neuroscience.

[37]  V. Michel,et al.  An Automatic Valuation System in the Human Brain: Evidence from Functional Neuroimaging , 2009, Neuron.

[38]  Timothy E. J. Behrens,et al.  Neural Mechanisms of Foraging , 2012, Science.

[39]  Xiao-Jing Wang,et al.  Probabilistic Decision Making by Slow Reverberation in Cortical Circuits , 2002, Neuron.

[40]  Mel W. Khaw,et al.  Normalization is a general neural mechanism for context-dependent decision making , 2013, Proceedings of the National Academy of Sciences.

[41]  C. Padoa-Schioppa.  Range-Adapting Representation of Economic Value in the Orbitofrontal Cortex , 2009, The Journal of Neuroscience.

[42]  Timothy Edward John Behrens,et al.  Diffusion-Weighted Imaging Tractography-Based Parcellation of the Human Parietal Cortex and Comparison with Human and Macaque Resting-State Functional Connectivity , 2011, The Journal of Neuroscience.

[43]  Daeyeol Lee,et al.  Ubiquity and Specificity of Reinforcement Signals throughout the Human Brain , 2011, Neuron.

[44]  Christopher Summerfield,et al.  Building Bridges between Perceptual and Economic Decision-Making: Neural and Computational Mechanisms , 2012, Front. Neurosci..

[45]  H. Simon,et al.  Rational choice and the structure of the environment. , 1956, Psychological review.

[46]  Timothy Edward John Behrens,et al.  Separable Learning Systems in the Macaque Brain and the Role of Orbitofrontal Cortex in Contingent Learning , 2010, Neuron.

[47]  R. Dolan,et al.  Confidence in value-based choice , 2012, Nature Neuroscience.

[48]  Timothy Edward John Behrens,et al.  How Green Is the Grass on the Other Side? Frontopolar Cortex and the Evidence in Favor of Alternative Courses of Action , 2009, Neuron.

[49]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[50]  Xiao-Jing Wang.  Neural dynamics and circuit mechanisms of decision-making , 2012, Current Opinion in Neurobiology.

[51]  Mark W. Woolrich,et al.  Robust group analysis using outlier inference , 2008, NeuroImage.

[52]  Colin Camerer,et al.  Transformation of stimulus value signals into motor commands during simple choice , 2011, Proceedings of the National Academy of Sciences.

[53]  Joonyeol Lee,et al.  Attentional Modulation of MT Neurons with Single or Multiple Stimuli in Their Receptive Fields , 2010, The Journal of Neuroscience.

[54]  Alan C. Evans,et al.  A Three-Dimensional Statistical Analysis for CBF Activation Studies in Human Brain , 1992, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[55]  A. Nobre,et al.  Effects of Decision Variables and Intraparietal Stimulation on Sensorimotor Oscillatory Activity in the Human Brain , 2012, The Journal of Neuroscience.

[56]  Kenway Louie,et al.  Separating Value from Choice: Delay Discounting Activity in the Lateral Intraparietal Area , 2010, The Journal of Neuroscience.

[57]  P. Dayan,et al.  Mapping value based planning and extensively trained choice in the human brain , 2012, Nature Neuroscience.

[58]  M. Pessiglione,et al.  Brain Hemispheres Selectively Track the Expected Value of Contralateral Options , 2009, The Journal of Neuroscience.

[59]  Colin Camerer,et al.  A framework for studying the neurobiology of value-based decision making , 2008, Nature Reviews Neuroscience.

[60]  Timothy E. J. Behrens,et al.  Review Frontal Cortex and Reward-guided Learning and Decision-making Figure 1. Frontal Brain Regions in the Macaque Involved in Reward-guided Learning and Decision-making Finer Grained Anatomical Divisions with Frontal Cortical Systems for Reward-guided Behavior , 2022 .

[61]  M. Rushworth,et al.  Distinct Roles of Three Frontal Cortical Areas in Reward-Guided Behavior , 2011, The Journal of Neuroscience.

[62]  Society of magnetic resonance in medicine , 1990 .