Neural computations underlying strategic social decision-making in groups

When making decisions in groups, the outcome of one’s decision often depends on the decisions of others, and there is a tradeoff between short-term incentives for an individual and long-term incentives for the groups. Yet, little is known about the neurocomputational mechanisms at play when weighing different utilities during repeated social interactions. Here, using model-based fMRI and Public-good-games, we find that the ventromedial prefrontal cortex encodes immediate expected rewards as individual utility while the lateral frontopolar cortex encodes group utility (i.e., pending rewards of alternative strategies beneficial for the group). When it is required to change one’s strategy, these brain regions exhibited changes in functional interactions with brain regions engaged in switching strategies. Moreover, the anterior cingulate cortex and the temporoparietal junction updated beliefs about the decision of others during interactions. Together, our findings provide a neurocomputational account of how the brain dynamically computes effective strategies to make adaptive collective decisions. The brain mechanisms underlying cooperation within groups, while balancing individual and collective interests, are poorly understood. Here, the authors identify the neurocomputations engaged in social dilemmas requiring strategic decisions during repeated social interactions in groups.

[1]  Matthew F.S. Rushworth,et al.  The Anterior Cingulate Gyrus and Social Cognition: Tracking the Motivation of Others , 2016, Neuron.

[2]  J. O'Doherty,et al.  Neural Mechanisms Underlying Human Consensus Decision-Making , 2015, Neuron.

[3]  D. E. Campbell Public Goods , 2021, Encyclopedia of Evolutionary Psychological Science.

[4]  A. Diekmann Volunteer's Dilemma , 1985 .

[5]  Jochem Marotzke,et al.  Stabilizing the earth's climate is not a losing game: supporting evidence from public goods experiments. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Marco K. Wittmann,et al.  The Good, the Bad, and the Irrelevant: Neural Mechanisms of Learning Real and Hypothetical Rewards and Effort , 2015, The Journal of Neuroscience.

[7]  Marco K. Wittmann,et al.  Multiple signals in anterior cingulate cortex , 2016, Current Opinion in Neurobiology.

[8]  B. Warscheid,et al.  A systems study reveals concurrent activation of AMPK and mTOR by amino acids , 2016, Nature Communications.

[9]  Karl J. Friston,et al.  Neural Mechanisms of Belief Inference during Cooperative Games , 2010, The Journal of Neuroscience.

[10]  Steve W. C. Chang,et al.  Social learning through prediction error in the brain , 2017, npj Science of Learning.

[11]  M. Nowak,et al.  Evolution of cooperation in stochastic games , 2018, Nature.

[12]  M. Rushworth,et al.  Connectivity reveals relationship of brain areas for reward-guided learning and decision making in human and monkey frontal cortex , 2015, Proceedings of the National Academy of Sciences.

[13]  Sidney C. Sufrin,et al.  The Logic of Collective Action: Public Goods and the Theory of Groups. , 1966 .

[14]  Keiji Tanaka,et al.  The Neural Basis of Intuitive Best Next-Move Generation in Board Game Experts , 2011, Science.

[15]  Timothy E. J. Behrens,et al.  An Agent Independent Axis for Executed and Modeled Choice in Medial Prefrontal Cortex , 2012, Neuron.

[16]  Karl J. Friston,et al.  Bayesian model selection for group studies , 2009, NeuroImage.

[17]  M. Archetti,et al.  Cooperation as a volunteer’s dilemma and the strategy of conflict in public goods games , 2009, Journal of evolutionary biology.

[18]  E. Koechlin,et al.  Managing competing goals — a key role for the frontopolar cortex , 2017, Nature Reviews Neuroscience.

[19]  Shinsuke Shimojo,et al.  Neural Computations Underlying Arbitration between Model-Based and Model-free Learning , 2013, Neuron.

[20]  D. Barraclough,et al.  Prefrontal cortex and decision making in a mixed-strategy game , 2004, Nature Neuroscience.

[21]  M. Rushworth,et al.  Prospection, Perseverance, and Insight in Sequential Behavior , 2018, Neuron.

[22]  J. Ledyard Public Goods: A Survey of Experimental Research , 1994 .

[23]  M. Olson,et al.  The Logic of Collective Action: Public Goods and the Theory of Groups. , 1973 .

[24]  K. Yun,et al.  Decoding covert motivations of free riding and cooperation from multi-feature pattern analysis of EEG signals. , 2015, Social cognitive and affective neuroscience.

[25]  Marco K. Wittmann,et al.  Ventral anterior cingulate cortex and social decision-making , 2018, Neuroscience & Biobehavioral Reviews.

[26]  C. Cadsby,et al.  Gender and free riding in a threshold public goods game: Experimental evidence , 1998 .

[27]  P. Dayan,et al.  States versus Rewards: Dissociable Neural Prediction Error Signals Underlying Model-Based and Model-Free Reinforcement Learning , 2010, Neuron.

[28]  Timothy Edward John Behrens,et al.  How Green Is the Grass on the Other Side? Frontopolar Cortex and the Evidence in Favor of Alternative Courses of Action , 2009, Neuron.

[29]  Adam G. Thomas,et al.  Comparison of Human Ventral Frontal Cortex Areas for Cognitive Control and Language with Areas in Monkey Frontal Cortex , 2014, Neuron.

[30]  Peter Ford Dominey,et al.  Behavioral Regulation and the Modulation of Information Coding in the Lateral Prefrontal and Cingulate Cortex. , 2015, Cerebral cortex.

[31]  J L Andersson,et al.  Social Network Size Affects Neural Circuits in Macaques , 2011, Science.

[32]  M. Rushworth,et al.  Behavioral / Systems / Cognitive Connectivity-Based Parcellation of Human Cingulate Cortex and Its Relation to Functional Specialization , 2008 .

[33]  Justin L. Gardner,et al.  Learning to Simulate Others' Decisions , 2012, Neuron.

[34]  L. Felkins The Social Dilemmas , 2015 .

[35]  Duncan J. Watts,et al.  Empirical agent based models of cooperation in public goods games , 2013, EC '13.

[36]  M. Platt,et al.  Neural Correlates of Social Target Value in Macaque Parietal Cortex , 2008, Current Biology.

[37]  A. Graybiel,et al.  A Feud that Wasn't: Acetylcholine Evokes Dopamine Release in the Striatum , 2012, Neuron.

[38]  I. Fried,et al.  Observational learning computations in neurons of the human anterior cingulate cortex , 2016, Nature Communications.

[39]  J. O'Doherty,et al.  The Behavioral and Neural Mechanisms Underlying the Tracking of Expertise , 2013, Neuron.

[40]  Keiji Tanaka,et al.  Neural encoding of opposing strategy values in anterior and posterior cingulate cortex , 2015, Nature Neuroscience.

[41]  C. H. Donahue,et al.  Neural correlates of strategic reasoning during competitive games , 2014, Science.

[42]  Mancur Olson The Logic of Collective Action: Public Goods and the Theory of Groups, Second Printing with a New Preface and Appendix , 2009 .

[43]  R. Nagel,et al.  Neural correlates of depth of strategic reasoning in medial prefrontal cortex , 2009, Proceedings of the National Academy of Sciences.

[44]  Ernst Fehr,et al.  Linking Brain Structure and Activation in Temporoparietal Junction to Explain the Neurobiology of Human Altruism , 2012, Neuron.

[45]  Ziv M. Williams,et al.  Neuronal Prediction of Opponent’s Behavior during Cooperative Social Interchange in Primates , 2015, Cell.

[46]  Rajesh P. N. Rao,et al.  Modeling other minds: Bayesian inference explains human choices in group decision-making , 2019, Science Advances.

[47]  Marco Archetti,et al.  A STRATEGY TO INCREASE COOPERATION IN THE VOLUNTEER'S DILEMMA: REDUCING VIGILANCE IMPROVES ALARM CALLS , 2011, Evolution; international journal of organic evolution.

[48]  Jérôme Sallet,et al.  Social Learning in the Medial Prefrontal Cortex , 2017, Trends in Cognitive Sciences.

[49]  Y. Benjamini,et al.  On the Adaptive Control of the False Discovery Rate in Multiple Testing With Independent Statistics , 2000 .

[50]  Seongmin A. Park,et al.  TV programs that denounce unfair advantage impact women’s sensitivity to defection in the public goods game , 2013, Social neuroscience.

[51]  Jean Daunizeau,et al.  The Social Bayesian Brain: Does Mentalizing Make a Difference When We Learn? , 2014, PLoS Comput. Biol..

[52]  Etienne Koechlin,et al.  Foundations of human reasoning in the prefrontal cortex , 2014, Science.

[53]  Mark W Woolrich,et al.  Associative learning of social value , 2008, Nature.

[54]  M. Rushworth,et al.  Connectivity-based subdivisions of the human right "temporoparietal junction area": evidence for different areas participating in different cortical networks. , 2012, Cerebral cortex.

[55]  H. Seo,et al.  Reinforcement Learning and Strategic Reasoning During Social Decision-Making , 2017 .