Independent Neural Computation of Value from Other People's Confidence

Expectation of reward can be shaped by the observation of actions and expressions of other people in one's environment. A person's apparent confidence in the likely reward of an action, for instance, makes qualities of their evidence, not observed directly, socially accessible. This strategy is computationally distinguished from associative learning methods that rely on direct observation, by its use of inference from indirect evidence. In twenty-three healthy human subjects, we isolated effects of first-hand experience, other people's choices, and the mediating effect of their confidence, on decision-making and neural correlates of value within ventromedial prefrontal cortex (vmPFC). Value derived from first-hand experience and other people's choices (regardless of confidence) were indiscriminately represented across vmPFC. However, value computed from agent choices weighted by their associated confidence was represented with specificity for ventromedial area 10. This pattern corresponds to shifts of connectivity and overlapping cognitive processes along a posterior-anterior vmPFC axis. Task behavior and self-reported self-reliance for decision-making in other social contexts correlated. The tendency to conform in other social contexts corresponded to increased activation in cortical regions previously shown to respond to social conflict in proportion to subsequent conformity (Campbell-Meiklejohn et al., 2010). The tendency to self-monitor predicted a selectively enhanced response to accordance with others in the right temporoparietal junction (rTPJ). The findings anatomically decompose vmPFC value representations according to computational requirements and provide biological insight into the social transmission of preference and reassurance gained from the confidence of others. SIGNIFICANCE STATEMENT Decades of research have provided evidence that the ventromedial prefrontal cortex (vmPFC) signals the satisfaction we expect from imminent actions. However, we have a surprisingly modest understanding of the organization of value across this substantial and varied region. This study finds that using cues of the reliability of other peoples' knowledge to enhance expectation of personal success generates value correlates that are anatomically distinct from those concurrently computed from direct, personal experience. This suggests that representation of decision values in vmPFC is suborganized according to the underlying computation, consistent with what we know about the anatomical heterogeneity of the region. These results also provide insight into the observational learning process by which someone else's confidence can sway and reassure our choices.

[1]  A. Rangel,et al.  Informatic parcellation of the network involved in the computation of subjective value. , 2014, Social cognitive and affective neuroscience.

[2]  Hauke R. Heekeren,et al.  The Neural Basis of Following Advice , 2011, PLoS biology.

[3]  Colin Camerer,et al.  Neural evidence for inequality-averse social preferences , 2010, Nature.

[4]  Hans Knutsson,et al.  Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates , 2016, Proceedings of the National Academy of Sciences.

[5]  J. O'Doherty,et al.  The Role of the Ventromedial Prefrontal Cortex in Abstract State-Based Inference during Decision Making in Humans , 2006, The Journal of Neuroscience.

[6]  Antonio Rangel,et al.  Economic choices can be made using only stimulus values , 2010, Proceedings of the National Academy of Sciences.

[7]  Mark W. Woolrich,et al.  Robust group analysis using outlier inference , 2008, NeuroImage.

[8]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.

[9]  Alec Solway,et al.  Goal-directed decision making as probabilistic inference: a computational framework and potential neural correlates. , 2012, Psychological review.

[10]  P. Dayan,et al.  Cortical substrates for exploratory decisions in humans , 2006, Nature.

[11]  Mark W Woolrich,et al.  Associative learning of social value , 2008, Nature.

[12]  B. T. Thomas Yeo,et al.  The Organization of Local and Distant Functional Connectivity in the Human Brain , 2010, PLoS Comput. Biol..

[13]  Iroise Dumontheil,et al.  Function and localization within rostral prefrontal cortex (area 10) , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[14]  Peter Bossaerts,et al.  Neural correlates of mentalizing-related computations during strategic interactions in humans , 2008, Proceedings of the National Academy of Sciences.

[15]  C. Frith,et al.  Meeting of minds: the medial frontal cortex and social cognition , 2006, Nature Reviews Neuroscience.

[16]  Colin Camerer,et al.  In the Mind of the Market: Theory of Mind Biases Value Computation during Financial Bubbles , 2013, Neuron.

[17]  J. O'Doherty,et al.  Is Avoiding an Aversive Outcome Rewarding? Neural Substrates of Avoidance Learning in the Human Brain , 2006, PLoS biology.

[18]  J. O'Doherty,et al.  Model‐Based fMRI and Its Application to Reward Learning and Decision Making , 2007, Annals of the New York Academy of Sciences.

[19]  D. Patel,et al.  Inferring subjective states through the observation of actions , 2012, Proceedings of the Royal Society B: Biological Sciences.

[20]  D Gianola,et al.  Technical note: an R package for fitting generalized linear mixed models in animal breeding. , 2010, Journal of animal science.

[21]  R. Dolan,et al.  How the Opinion of Others Affects Our Valuation of Objects , 2010, Current Biology.

[22]  A. Owen,et al.  Anterior prefrontal cortex: insights into function from anatomy and neuroimaging , 2004, Nature Reviews Neuroscience.

[23]  Brian Butterworth,et al.  Are Subitizing and Counting Implemented as Separate or Functionally Overlapping Processes? , 2002, NeuroImage.

[24]  C. Zink,et al.  Know Your Place: Neural Processing of Social Hierarchy in Humans , 2008, Neuron.

[25]  Jonathan P. Thomas,et al.  The confidence heuristic: A game-theoretic analysis , 1995 .

[26]  N. Humphrey The Social Function of Intellect , 1976 .

[27]  Hiroshi Fukuda,et al.  A functional MRI study of simple arithmetic--a comparison between children and adults. , 2004, Brain research. Cognitive brain research.

[28]  Stephen M. Smith,et al.  Probabilistic independent component analysis for functional magnetic resonance imaging , 2004, IEEE Transactions on Medical Imaging.

[29]  K. Doya,et al.  The computational neurobiology of learning and reward , 2006, Current Opinion in Neurobiology.

[30]  M. Petrides,et al.  Quantitative demonstration of comparable architectonic areas within the ventromedial and lateral orbital frontal cortex in the human and the macaque monkey brains , 2010, The European journal of neuroscience.

[31]  P. Dayan,et al.  Model-based influences on humans’ choices and striatal prediction errors , 2011, Neuron.

[32]  J. Dreher,et al.  Processing of primary and secondary rewards: A quantitative meta-analysis and review of human functional neuroimaging studies , 2013, Neuroscience & Biobehavioral Reviews.

[33]  Timothy E. J. Behrens,et al.  Review Frontal Cortex and Reward-guided Learning and Decision-making Figure 1. Frontal Brain Regions in the Macaque Involved in Reward-guided Learning and Decision-making Finer Grained Anatomical Divisions with Frontal Cortical Systems for Reward-guided Behavior , 2022 .

[34]  J. Price,et al.  Architectonic subdivision of the human orbital and medial prefrontal cortex , 2003, The Journal of comparative neurology.

[35]  D. Mobbs,et al.  When Your Gain Is My Pain and Your Pain Is My Gain: Neural Correlates of Envy and Schadenfreude , 2009, Science.

[36]  Hauke R. Heekeren,et al.  How Expert Advice Influences Decision Making , 2012, PloS one.

[37]  Daniel C. McNamee,et al.  Category-dependent and category-independent goal-value codes in human ventromedial prefrontal cortex , 2013, Nature Neuroscience.

[38]  Haiyan Wu,et al.  Neural signatures of social conformity: A coordinate-based activation likelihood estimation meta-analysis of functional brain imaging studies , 2016, Neuroscience & Biobehavioral Reviews.

[39]  Timothy E. J. Behrens,et al.  An Agent Independent Axis for Executed and Modeled Choice in Medial Prefrontal Cortex , 2013, Neuron.

[40]  Nathan J Emery,et al.  Introduction. Social intelligence: from brain to culture , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[41]  Saori C. Tanaka,et al.  Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops , 2004, Nature Neuroscience.

[42]  Joseph W. Kable,et al.  The valuation system: A coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value , 2013, NeuroImage.

[43]  S. Quartz,et al.  Exploring the Nature of 'Trader Intuition' , 2010 .

[44]  D. Povinelli,et al.  Theory of mind: evolutionary history of a cognitive specialization , 1995, Trends in Neurosciences.

[45]  Jonathan D. Cohen,et al.  Conflict monitoring and anterior cingulate cortex: an update , 2004, Trends in Cognitive Sciences.

[46]  R. Adolphs,et al.  Social and monetary reward learning engage overlapping neural substrates. , 2012, Social cognitive and affective neuroscience.

[47]  Freda Kemp Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences , 2003 .

[48]  J. O'Doherty,et al.  The Behavioral and Neural Mechanisms Underlying the Tracking of Expertise , 2013, Neuron.

[49]  Robin I. M. Dunbar,et al.  Understanding primate brain evolution , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[50]  Albert Mehrabian,et al.  Basic temperament components of loneliness, shyness, and conformity , 1995 .

[51]  C. Frith,et al.  Mechanisms of social cognition. , 2012, Annual review of psychology.

[52]  W. Schultz,et al.  Neural mechanisms of observational learning , 2010, Proceedings of the National Academy of Sciences.

[53]  S. Huettel,et al.  A Distinct Role of the Temporal-Parietal Junction in Predicting Socially Guided Decisions , 2012, Science.

[54]  Mark W. Woolrich,et al.  Multilevel linear modelling for FMRI group analysis using Bayesian inference , 2004, NeuroImage.

[55]  Dino J. Levy,et al.  The root of all value: a neural common currency for choice , 2012, Current Opinion in Neurobiology.

[56]  Skyler T. Hawk,et al.  Presentation and validation of the Radboud Faces Database , 2010 .

[57]  M. Snyder Self-monitoring of expressive behavior. , 1974 .

[58]  Geoffrey Bird,et al.  Enhancing Social Ability by Stimulating Right Temporoparietal Junction Tdcs of Right Tpj , 2022 .

[59]  P. Tobler,et al.  Spatial gradient in value representation along the medial prefrontal cortex reflects individual differences in prosociality , 2015, Proceedings of the National Academy of Sciences.

[60]  H. Barbas,et al.  Specialized Elements of Orbitofrontal Cortex in Primates , 2007, Annals of the New York Academy of Sciences.

[61]  E. Rolls,et al.  The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsychology , 2004, Progress in Neurobiology.

[62]  E. Tolman Cognitive maps in rats and men. , 1948, Psychological review.

[63]  N. Sadato,et al.  Processing of Social and Monetary Rewards in the Human Striatum , 2008, Neuron.

[64]  J. Dreher,et al.  Local Morphology Predicts Functional Organization of Experienced Value Signals in the Human Orbitofrontal Cortex , 2015, The Journal of Neuroscience.