Game theory and neural basis of social decision making

Decision making in a social group has two distinguishing features. First, humans and other animals routinely alter their behavior in response to changes in their physical and social environment. As a result, the outcomes of decisions that depend on the behavior of multiple decision makers are difficult to predict and require highly adaptive decision-making strategies. Second, decision makers may have preferences regarding consequences to other individuals and therefore choose their actions to improve or reduce the well-being of others. Many neurobiological studies have exploited game theory to probe the neural basis of decision making and suggested that these features of social decision making might be reflected in the functions of brain areas involved in reward evaluation and reinforcement learning. Molecular genetic studies have also begun to identify genetic mechanisms for personal traits related to reinforcement learning and complex social decision making, further illuminating the biological basis of social behavior.

[1]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[2]  J. Nash Equilibrium Points in N-Person Games. , 1950, Proceedings of the National Academy of Sciences of the United States of America.

[3]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[4]  V. Smith,et al.  Preferences, Property Rights, and Anonymity in Bargaining Games , 1994 .

[5]  David F. Sally Conversation and Cooperation in Social Dilemmas , 1995 .

[6]  T. Clutton‐Brock,et al.  Punishment in animal societies , 1995, Nature.

[7]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[8]  Andrew Schotter,et al.  Fairness and survival in ultimatum and dictatorship games , 1996 .

[9]  Robert H. Crites,et al.  Multiagent reinforcement learning in the Iterated Prisoner's Dilemma. , 1996, Bio Systems.

[10]  Masataka Watanabe Reward expectancy in primate prefrental neurons , 1996, Nature.

[11]  D. Perrett,et al.  A specific neural substrate for perceiving facial expressions of disgust , 1997, Nature.

[12]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[13]  Dilip Mookherjee,et al.  Learning and Decision Costs in Experimental Constant Sum Games , 1997 .

[14]  A. Roth,et al.  Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria , 1998 .

[15]  O. Hikosaka,et al.  Expectation of reward modulates cognitive signals in the basal ganglia , 1998, Nature Neuroscience.

[16]  M. Nowak,et al.  Evolution of indirect reciprocity by image scoring , 1998, Nature.

[17]  D. Fudenberg,et al.  The Theory of Learning in Games , 1998 .

[18]  E. Fehr A Theory of Fairness, Competition and Cooperation , 1998 .

[19]  M. Shadlen,et al.  Effect of Expected Reward Magnitude on the Response of Neurons in the Dorsolateral Prefrontal Cortex of the Macaque , 1999, Neuron.

[20]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[21]  R. Adolphs Social cognition and the human brain , 1999, Trends in Cognitive Sciences.

[22]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[23]  Nick Feltovich,et al.  Reinforcement-based vs. Belief-based Learning Models in Experimental Asymmetric-information Games , 2000 .

[24]  M. Milinski,et al.  Cooperation through image scoring in humans. , 2000, Science.

[25]  D. Kahneman,et al.  Functional Imaging of Neural Responses to Expectancy and Experience of Monetary Gains and Losses tasks with monetary payoffs , 2001 .

[26]  Daniel Houser,et al.  A functional imaging study of cooperation in two-person reciprocal exchange , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[27]  E. Fehr,et al.  Altruistic punishment in humans , 2002, Nature.

[28]  B. Richmond,et al.  Anterior Cingulate: Single Neuronal Signals Related to Degree of Reward Expectancy , 2002, Science.

[29]  Christopher D. Frith,et al.  Imaging the Intentional Stance in a Competitive Game , 2002, NeuroImage.

[30]  G. Pagnoni,et al.  A Neural Basis for Social Cooperation , 2002, Neuron.

[31]  Colin Camerer Behavioral Game Theory: Experiments in Strategic Interaction , 2003 .

[32]  Samuel M. McClure,et al.  Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum , 2003, Neuron.

[33]  M. Hauser,et al.  Give unto others: genetically unrelated cotton-top tamarin monkeys preferentially give food to those who altruistically give food back , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[34]  Wolfram Schultz,et al.  Effects of expectations for different reward magnitudes on neuronal activity in primate striatum. , 2003, Journal of neurophysiology.

[35]  Karl J. Friston,et al.  Temporal Difference Models and Reward-Related Learning in the Human Brain , 2003, Neuron.

[36]  W. Schultz,et al.  Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons , 2003, Science.

[37]  U. Fischbacher,et al.  The nature of human altruism , 2003, Nature.

[38]  R. Boyd,et al.  The evolution of altruistic punishment , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[39]  C. Frith,et al.  Functional imaging of ‘theory of mind’ , 2003, Trends in Cognitive Sciences.

[40]  Jonathan D. Cohen,et al.  The Neural Basis of Economic Decision-Making in the Ultimatum Game , 2003, Science.

[41]  P. Glimcher,et al.  Activity in Posterior Parietal Cortex Is Correlated with the Relative Subjective Desirability of Action , 2004, Neuron.

[42]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[43]  James K Rilling,et al.  The neural correlates of theory of mind within interpersonal interactions , 2004, NeuroImage.

[44]  Karl J. Friston,et al.  Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning , 2004, Science.

[45]  D. D. de Quervain,et al.  The Neural Basis of Altruistic Punishment , 2004, Science.

[46]  Andrew N. Meltzoff,et al.  The neural bases of cooperation and competition: an fMRI investigation , 2004, NeuroImage.

[47]  Nikos K Logothetis,et al.  Interpreting the BOLD signal. , 2004, Annual review of physiology.

[48]  Jonathan D. Cohen,et al.  Opposing BOLD responses to reciprocated and unreciprocated altruism in putative reward pathways , 2004, Neuroreport.

[49]  D. Barraclough,et al.  Prefrontal cortex and decision making in a mixed-strategy game , 2004, Nature Neuroscience.

[50]  S. Tsujimoto,et al.  Neuronal representation of response-outcome in the primate prefrontal cortex. , 2004, Cerebral cortex.

[51]  M. Delgado,et al.  Modulation of Caudate Activity by Action Contingency , 2004, Neuron.

[52]  M. Roesch,et al.  Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex , 2004, Science.

[53]  J. O'Doherty,et al.  Reward representations and reward-related learning in the human brain: insights from neuroimaging , 2004, Current Opinion in Neurobiology.

[54]  P. Glimcher,et al.  Neuroeconomics: The Consilience of Brain and Decision , 2004, Science.

[55]  D. Barraclough,et al.  Reinforcement learning and decision making in monkeys during a competitive game. , 2004, Brain research. Cognitive brain research.

[56]  S. Quartz,et al.  Getting to Know You: Reputation and Trust in a Two-Person Economic Exchange , 2005, Science.

[57]  Matthew T. Kaufman,et al.  Distributed Neural Representation of Expected Value , 2005, The Journal of Neuroscience.

[58]  K. Doya,et al.  Representation of Action-Specific Reward Values in the Striatum , 2005, Science.

[59]  Colin Camerer,et al.  Neural Systems Responding to Degrees of Uncertainty in Human Decision-Making , 2005, Science.

[60]  U. Fischbacher,et al.  Oxytocin increases trust in humans , 2005, Nature.

[61]  M. Delgado,et al.  Perceptions of moral character modulate the neural systems of reward during the trust game , 2005, Nature Neuroscience.

[62]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[63]  P. Glimcher,et al.  Midbrain Dopamine Neurons Encode a Quantitative Reward Prediction Error Signal , 2005, Neuron.

[64]  Jeffrey C. Cooper,et al.  Functional magnetic resonance imaging of reward prediction , 2005, Current opinion in neurology.

[65]  Meghana Bhatt,et al.  Self-Referential Thinking and Equilibrium as States of Mind in Games: Fmri Evidence , 2005, Games Econ. Behav..

[66]  D. Barraclough,et al.  Learning and decision making in monkeys during a rock-paper-scissors game. , 2005, Brain research. Cognitive brain research.

[67]  Takashi Hanakawa,et al.  The neural basis of social tactics: An fMRI study , 2006, NeuroImage.

[68]  C. Padoa-Schioppa,et al.  Neurons in the orbitofrontal cortex encode economic value , 2006, Nature.

[69]  M. Nowak Five Rules for the Evolution of Cooperation , 2006, Science.

[70]  D. Weinberger,et al.  Imaging Genetics: Perspectives from Studies of Genetically Driven Variation in Serotonin Function and Corticolimbic Affective Processing , 2006, Biological Psychiatry.

[71]  Jonathan D. Cohen,et al.  Imaging valuation models in human choice. , 2006, Annual review of neuroscience.

[72]  Joseph J. Paton,et al.  The primate amygdala represents the positive and negative value of visual stimuli during learning , 2006, Nature.

[73]  S. Quartz,et al.  Neural Differentiation of Expected Reward and Risk in Human Subcortical Structures , 2006, Neuron.

[74]  Colin F Camerer,et al.  Agent-Specific Responses in the Cingulate Cortex During Economic Exchanges , 2006, Science.

[75]  R. Saxe Uniquely human social cognition , 2006, Current Opinion in Neurobiology.

[76]  W. Schultz Behavioral theories and the neurophysiology of reward. , 2006, Annual review of psychology.

[77]  M. Tomasello,et al.  Altruistic Helping in Human Infants and Young Chimpanzees , 2006, Science.

[78]  J. Grafman,et al.  Human fronto–mesolimbic networks guide decisions about charitable donation , 2006, Proceedings of the National Academy of Sciences.

[79]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[80]  T. Burnham High-testosterone men reject low ultimatum game offers , 2007, Proceedings of the Royal Society B: Biological Sciences.

[81]  M. Kawato,et al.  Non-commercial Research and Educational Use including without Limitation Use in Instruction at Your Institution, Sending It to Specific Colleagues That You Know, and Providing a Copy to Your Institution's Administrator. All Other Uses, Reproduction and Distribution, including without Limitation Comm , 2022 .

[82]  Elisabeth A. Murray,et al.  Genetic modulation of cognitive flexibility and socioemotional behavior in rhesus monkeys , 2007, Proceedings of the National Academy of Sciences.

[83]  R. Hoskins,et al.  Neural Responses to Taxation and Voluntary Giving Reveal Motives for Charitable Donations , 2007 .

[84]  M. Reuter,et al.  Genetically Determined Differences in Learning from Errors , 2007, Science.

[85]  Dharol Tankersley,et al.  Altruism is associated with an increased neural response to agency , 2007, Nature Neuroscience.

[86]  K. Fliessbach,et al.  Social Comparison Affects Reward-Related Brain Activity in the Human Ventral Striatum , 2007, Science.

[87]  K. Lesch,et al.  Long story short: the serotonin transporter in emotion regulation and social cognition , 2007, Nature Neuroscience.

[88]  Jaap J. A. Denissen,et al.  The evolutionary genetics of personality , 2007 .

[89]  Daeyeol Lee,et al.  Order-Dependent Modulation of Directional Signals in the Supplementary and Presupplementary Motor Areas , 2007, The Journal of Neuroscience.

[90]  Michael J. Frank,et al.  Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning , 2007, Proceedings of the National Academy of Sciences.

[91]  Colin Camerer,et al.  Social neuroeconomics: the neural circuitry of social preferences , 2007, Trends in Cognitive Sciences.

[92]  M. Tomasello,et al.  Chimpanzees Are Rational Maximizers in an Ultimatum Game , 2007, Science.

[93]  R. Dolan,et al.  Brain, emotion and decision making: the paradigmatic example of regret , 2007, Trends in Cognitive Sciences.

[94]  M. Johannesson,et al.  Heritability of ultimatum game responder behavior , 2007, Proceedings of the National Academy of Sciences.

[95]  M. Roesch,et al.  Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards , 2007, Nature Neuroscience.

[96]  U. Fischbacher,et al.  The Neural Signature of Social Norm Compliance , 2007, Neuron.

[97]  H. Seo,et al.  Temporal Filtering of Reward Signals in the Dorsal Anterior Cingulate Cortex during a Mixed-Strategy Game , 2007, The Journal of Neuroscience.

[98]  Daeyeol Lee,et al.  Functional Specialization of the Primate Frontal Cortex during Decision Making , 2007, The Journal of Neuroscience.

[99]  A. Sanfey Social Decision-Making : Insights from Game Theory and Neuroscience , 2022 .

[100]  Kevin McCabe,et al.  Neural signature of fictive learning signals in a sequential investment task , 2007, Proceedings of the National Academy of Sciences.

[101]  J. Gläscher,et al.  Gene–gene interaction associated with neural reward sensitivity , 2007, Proceedings of the National Academy of Sciences.

[102]  F. D. de Waal Putting the altruism back into altruism: the evolution of empathy. , 2008, Annual review of psychology.

[103]  R. K. Simpson Nature Neuroscience , 2022 .