The neural and computational systems of social learning

Learning the value of stimuli and actions from others — social learning — adaptively contributes to individual survival and plays a key role in cultural evolution. We review research across species targeting the neural and computational systems of social learning in both the aversive and appetitive domains. Social learning generally follows the same principles as self-experienced value-based learning, including computations of prediction errors and is implemented in brain circuits activated across task domains together with regions processing social information. We integrate neural and computational perspectives of social learning with an understanding of behaviour of varying complexity, from basic threat avoidance to complex social learning strategies and cultural phenomena. Learning the value of stimuli and actions from others — social learning — is crucial for survival. In this review, Olsson, Knapska and Lindström discuss the neural and computational systems underlying social and self-experienced learning, and integrate this knowledge with behavioural phenomena of varying complexity.

[1]  N. Bolger,et al.  Vicarious Fear Learning Depends on Empathic Appraisals and Trait Empathy , 2016, Psychological science.

[2]  Steve W. C. Chang,et al.  Vicarious Reinforcement in Rhesus Macaques (Macaca Mulatta) , 2011, Front. Neurosci..

[3]  Joseph E LeDoux,et al.  Different projections of the central amygdaloid nucleus mediate autonomic and behavioral correlates of conditioned fear , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[4]  Anne E Carpenter,et al.  Neuron-type specific signals for reward and punishment in the ventral tegmental area , 2011, Nature.

[5]  Lilian A. E. Weber,et al.  Hierarchical prediction errors in midbrain and septum during social learning , 2017, Social cognitive and affective neuroscience.

[6]  A. Olsson,et al.  Co-Evolution of Social Learning and Evolutionary Preparedness in Dangerous Environments , 2016, PloS one.

[7]  J. Roiser,et al.  Encoding of Vicarious Reward Prediction in Anterior Cingulate Cortex and Relationship with Trait Empathy , 2015, The Journal of Neuroscience.

[8]  G. Glover,et al.  Prefrontal cortical regulation of brainwide circuit dynamics and reward-related behavior , 2016, Science.

[9]  Frank Van Overwalle,et al.  A dissociation between social mentalizing and general reasoning , 2011, NeuroImage.

[10]  A. Grace,et al.  The Rostral Anterior Cingulate Cortex Modulates the Efficiency of Amygdala-Dependent Fear Learning , 2008, Biological Psychiatry.

[11]  Agnès Gruart,et al.  Observational learning in mice can be prevented by medial prefrontal cortex stimulation and enhanced by nucleus accumbens stimulation. , 2012, Learning & memory.

[12]  Nathaniel D. Daw,et al.  Role of Human Ventromedial Prefrontal Cortex in Learning and Recall of Enhanced Extinction , 2019, The Journal of Neuroscience.

[13]  S. Bikhchandani,et al.  Learning from the behavior of others : conformity, fads, and informational cascades , 1998 .

[14]  Kevin N. Ochsner,et al.  A Meta-analysis of Functional Neuroimaging Studies of Self- and Other Judgments Reveals a Spatial Gradient for Mentalizing in Medial Prefrontal Cortex , 2012, Journal of Cognitive Neuroscience.

[15]  J. O'Doherty,et al.  Neural Mechanisms Underlying Human Consensus Decision-Making , 2015, Neuron.

[16]  T R Zentall,et al.  Observational Learning and Social Facilitation in the Rat , 1972, Science.

[17]  E. Markman,et al.  Prior experiences and perceived efficacy influence 3-year-olds' imitation. , 2008, Developmental psychology.

[18]  Todd A. Hare,et al.  Early developmental emergence of human amygdala–prefrontal connectivity after maternal deprivation , 2013, Proceedings of the National Academy of Sciences.

[19]  J. Debiec,et al.  Intergenerational transmission of emotional trauma through amygdala-dependent mother-to-infant transfer of specific fear , 2014, Proceedings of the National Academy of Sciences.

[20]  Jamil Zaki,et al.  Computational Models of Emotion Inference in Theory of Mind: A Review and Roadmap , 2018, Top. Cogn. Sci..

[21]  Gary Aston-Jones,et al.  Prefrontal neurons encode context-based response execution and inhibition in reward seeking and extinction , 2015, Proceedings of the National Academy of Sciences.

[22]  S. Killcross,et al.  Coordination of actions and habits in the medial prefrontal cortex of rats. , 2003, Cerebral cortex.

[23]  Christin Scholz,et al.  Persuasion, Influence, and Value: Perspectives from Communication and Social Neuroscience , 2018, Annual review of psychology.

[24]  J Richard Eiser,et al.  Attitude formation through exploration: valence asymmetries. , 2004, Journal of personality and social psychology.

[25]  J. Gläscher,et al.  Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making. , 2009, Cerebral cortex.

[26]  T. Robbins,et al.  Different types of fear-conditioned behaviour mediated by separate nuclei within amygdala , 1997, Nature.

[27]  N. Ramnani,et al.  The Anterior Cingulate Gyrus Signals the Net Value of Others' Rewards , 2014, The Journal of Neuroscience.

[28]  P. Dayan,et al.  Reward, Motivation, and Reinforcement Learning , 2002, Neuron.

[29]  G. Schoenbaum,et al.  Encoding Predicted Outcome and Acquired Value in Orbitofrontal Cortex during Cue Sampling Depends upon Input from Basolateral Amygdala , 2003, Neuron.

[30]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[31]  Hee-Sup Shin,et al.  Rodent models for studying empathy , 2016, Neurobiology of Learning and Memory.

[32]  J. Debiec,et al.  Neural correlates of the mother‐to‐infant social transmission of fear , 2016, Journal of neuroscience research.

[33]  L. Kaczmarek,et al.  Between-subject transfer of emotional information evokes specific pattern of amygdala activation. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[34]  Catherine L. Sebastian,et al.  Association of Callous Traits with Reduced Neural Response to Others’ Pain in Children with Conduct Problems , 2013, Current Biology.

[35]  K. Laland,et al.  The evolutionary basis of human social learning , 2012, Proceedings of the Royal Society B: Biological Sciences.

[36]  Essi Viding,et al.  Neurocomputational mechanisms of prosocial learning and links to empathy , 2016, Proceedings of the National Academy of Sciences.

[37]  P. Dayan,et al.  Goals and Habits in the Brain , 2013, Neuron.

[38]  M. Frank,et al.  Instructional control of reinforcement learning: A behavioral and neurocomputational investigation , 2009, Brain Research.

[39]  Mark Mayford,et al.  Empathic Fear Responses in Mice Are Triggered by Recognition of a Shared Experience , 2013, PloS one.

[40]  K. Vogeley,et al.  Toward a second-person neuroscience 1 , 2013, Behavioral and Brain Sciences.

[41]  F. Zufall,et al.  An Olfactory Subsystem that Detects Carbon Disulfide and Mediates Food-Related Social Learning , 2010, Current Biology.

[42]  M. Brass,et al.  Imitation: is cognitive neuroscience solving the correspondence problem? , 2005, Trends in Cognitive Sciences.

[43]  G. Quirk,et al.  Neural Structures Mediating Expression and Extinction of Platform-Mediated Avoidance , 2014, The Journal of Neuroscience.

[44]  H. Roche,et al.  Why Copy Others? Insights from the Social Learning Strategies Tournament , 2010 .

[45]  P. Dayan,et al.  Action versus valence in decision making , 2014, Trends in Cognitive Sciences.

[46]  Luke Rendell,et al.  Social Learning Strategies: Bridge-Building between Fields , 2018, Trends in Cognitive Sciences.

[47]  J. Gore,et al.  Activation of the left amygdala to a cognitive representation of fear , 2001, Nature Neuroscience.

[48]  Susana Q. Lima,et al.  Silence resulting from the cessation of movement signals danger , 2012, Current Biology.

[49]  E. Leadbeater,et al.  A social insect perspective on the evolution of social learning mechanisms , 2017, Proceedings of the National Academy of Sciences.

[50]  Mark Lubell,et al.  Conformists and mavericks: the empirics of frequency-dependent cultural transmission , 2008 .

[51]  J. Henrich,et al.  The cultural niche: Why social learning is essential for human adaptation , 2011, Proceedings of the National Academy of Sciences.

[52]  Conor Liston,et al.  Projections from neocortex mediate top-down control of memory retrieval , 2015, Nature.

[53]  K. Luan Phan,et al.  The contextual brain: implications for fear conditioning, extinction and psychopathology , 2013, Nature Reviews Neuroscience.

[54]  T. Bast,et al.  Hippocampus and two‐way active avoidance conditioning: Contrasting effects of cytotoxic lesion and temporary inactivation , 2015, Hippocampus.

[55]  R. C. Honey,et al.  Imitative learning of stimulus-response and response-outcome associations in pigeons. , 2005, Journal of experimental psychology. Animal behavior processes.

[56]  Kevin J. Miller,et al.  Value representations in the rodent orbitofrontal cortex drive learning, not choice , 2018, bioRxiv.

[57]  M. Bouton Learning and Behavior: A Contemporary Synthesis , 2006 .

[58]  Emily B. Falk,et al.  The Neural Correlates of Persuasion: A Common Network across Cultures and Media , 2010, Journal of Cognitive Neuroscience.

[59]  Luke J. Chang,et al.  Large-Scale Meta-Analysis of Human Medial Frontal Cortex Reveals Tripartite Functional Organization , 2016, The Journal of Neuroscience.

[60]  Raffael Kalisch,et al.  A meta-analysis of instructed fear studies: Implications for conscious appraisal of threat , 2010, NeuroImage.

[61]  Carolyn E. Jones,et al.  Fear conditioning by-proxy: Social transmission of fear during memory retrieval , 2010, Behavioural Brain Research.

[62]  John P O'Doherty,et al.  A causal account of the brain network computations underlying strategic social behavior , 2017, Nature Neuroscience.

[63]  Joseph E LeDoux,et al.  Human Amygdala Activation during Conditioned Fear Acquisition and Extinction: a Mixed-Trial fMRI Study , 1998, Neuron.

[64]  M. Delgado,et al.  Reward‐Related Responses in the Human Striatum , 2007, Annals of the New York Academy of Sciences.

[65]  Garet P Lahvis,et al.  Empathy Is Moderated by Genetic Background in Mice , 2009, PloS one.

[66]  A. Olsson,et al.  Neural signals of vicarious extinction learning. , 2016, Social cognitive and affective neuroscience.

[67]  John P. O'Doherty,et al.  Human Dorsal Striatum Encodes Prediction Errors during Observational Learning of Instrumental Actions , 2012, Journal of Cognitive Neuroscience.

[68]  N. Daw,et al.  Instructed knowledge shapes feedback-driven aversive learning in striatum and orbitofrontal cortex, but not the amygdala , 2016, eLife.

[69]  J. Rosenkranz,et al.  Post-weaning social isolation impairs observational fear conditioning , 2013, Behavioural Brain Research.

[70]  Scott D. Johnson,et al.  Influences on consumer use of word-of-mouth recommendation sources , 1997 .

[71]  W. Schultz,et al.  Dopamine responses comply with basic assumptions of formal learning theory , 2001, Nature.

[72]  P. Dayan,et al.  Algorithms for survival: a comparative perspective on emotions , 2017, Nature Reviews Neuroscience.

[73]  Steve W. C. Chang,et al.  Neuronal reference frames for social decisions in primate frontal cortex , 2012, Nature Neuroscience.

[74]  M. Monfils,et al.  The roots of empathy: Through the lens of rodent models , 2017, Neuroscience & Biobehavioral Reviews.

[75]  Ilana B. Witten,et al.  Reward and choice encoding in terminals of midbrain dopamine neurons depends on striatal target , 2016, Nature Neuroscience.

[76]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[77]  K. Laland,et al.  Cognitive culture: theoretical and empirical insights into social learning strategies , 2011, Trends in Cognitive Sciences.

[78]  J. Grèzes,et al.  Emotional contagion: its scope and limits , 2015, Trends in Cognitive Sciences.

[79]  Jérôme Sallet,et al.  Social Learning in the Medial Prefrontal Cortex , 2017, Trends in Cognitive Sciences.

[80]  Demba E. Ba,et al.  Corticoamygdala Transfer of Socially Derived Information Gates Observational Learning , 2018, Cell.

[81]  J. O'Doherty,et al.  Model‐Based fMRI and Its Application to Reward Learning and Decision Making , 2007, Annals of the New York Academy of Sciences.

[82]  Jamil Zaki,et al.  Social Norms Shift Behavioral and Neural Responses to Foods , 2015, Journal of Cognitive Neuroscience.

[83]  Nicole Propst,et al.  Classical Conditioning Ii Current Research And Theory , 2016 .

[84]  Akira Masuda,et al.  Social Transmission of Avoidance Behavior under Situational Change in Learned and Unlearned Rats , 2009, PloS one.

[85]  Karl J. Friston,et al.  Predictive coding: an account of the mirror neuron system , 2007, Cognitive Processing.

[86]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[87]  Akira Masuda,et al.  Lesions of the medial prefrontal cortex enhance social modulation of avoidance , 2011, Behavioural Brain Research.

[88]  B. Balleine,et al.  The role of the dorsomedial striatum in instrumental conditioning , 2005, The European journal of neuroscience.

[89]  H. T. Blair,et al.  Placing prediction into the fear circuit , 2011, Trends in Neurosciences.

[90]  Sylvia A. Morelli,et al.  Neural sensitivity to personal and vicarious reward differentially relate to prosociality and well-being , 2018, Social cognitive and affective neuroscience.

[91]  Magnus Enquist,et al.  Social Learning : A Solution to Rogers ’ s Paradox of Nonadaptive Culture , 2007 .

[92]  Stephen Maren,et al.  Social modulation of learning in rats. , 2010, Learning & memory.

[93]  Colin Camerer,et al.  A framework for studying the neurobiology of value-based decision making , 2008, Nature Reviews Neuroscience.

[94]  A. Öhman,et al.  Other People as Means to a Safe End , 2013, Psychological science.

[95]  G. Fernández,et al.  Reinforcement Learning Signal Predicts Social Conformity , 2009, Neuron.

[96]  E. Fehr,et al.  The neurobiology of rewards and values in social decision making , 2014, Nature Reviews Neuroscience.

[97]  Matthew F.S. Rushworth,et al.  The Anterior Cingulate Gyrus and Social Cognition: Tracking the Motivation of Others , 2016, Neuron.

[98]  T. Bem,et al.  Observational learning of a spatial discrimination task by rats: learning from the mistakes of others? , 2018, Animal Behaviour.

[99]  N. Schutte,et al.  Psychological Outcomes in Reaction to Media Exposure to Disasters and Large-Scale Violence: A Meta-Analysis , 2017 .

[100]  Andreas Olsson,et al.  Beliefs about Others’ Abilities Alter Learning from Observation , 2017, Scientific Reports.

[101]  D. Katz,et al.  Temporary basolateral amygdala lesions disrupt acquisition of socially transmitted food preferences in rats. , 2006, Learning & memory.

[102]  Jamil Zaki,et al.  Common and distinct neural correlates of personal and vicarious reward: A quantitative meta-analysis , 2015, NeuroImage.

[103]  R. Saxe,et al.  Disruption of the right temporoparietal junction with transcranial magnetic stimulation reduces the role of beliefs in moral judgments , 2010, Proceedings of the National Academy of Sciences.

[104]  S. Mineka,et al.  Observational conditioning of snake fear in rhesus monkeys. , 1984, Journal of abnormal psychology.

[105]  P. Tobler,et al.  How learning shapes the empathic brain , 2015, Proceedings of the National Academy of Sciences.

[106]  The interplay of social group biases in social threat learning , 2017, Scientific Reports.

[107]  T. Robbins,et al.  Associative Processes in Addiction and Reward The Role of Amygdala‐Ventral Striatal Subsystems , 1999, Annals of the New York Academy of Sciences.

[108]  Claus Lamm,et al.  Meta-analytic evidence for common and distinct neural networks associated with directly experienced pain and empathy for pain , 2011, NeuroImage.

[109]  Garet P Lahvis,et al.  Differential influence of social versus isolate housing on vicarious fear learning in adolescent mice. , 2016, Behavioral neuroscience.

[110]  Paul J. Colombo,et al.  The orbitofrontal cortex is not necessary for acquisition or remote recall of socially transmitted food preferences , 2010, Behavioural Brain Research.

[111]  P. H. Duerfeldt,et al.  Some relevant variables in observational learning of the rat , 1971 .

[112]  M. Martí-Nicolovius,et al.  Muscarinic transmission in the basolateral amygdala is necessary for the acquisition of socially transmitted food preferences in rats , 2009, Neurobiology of Learning and Memory.

[113]  Wolfgang M. Pauli,et al.  Neural computations underlying inverse reinforcement learning in the human brain , 2017, eLife.

[114]  Andreas Olsson,et al.  Learned Fear of “Unseen” Faces after Pavlovian, Observational, and Instructed Fear , 2004, Psychological science.

[115]  Francisco Sotres-Bayon,et al.  Prefrontal control of fear: more than just extinction , 2010, Current Opinion in Neurobiology.

[116]  Björn Lindström,et al.  Mechanisms of social avoidance learning can explain the emergence of adaptive and arbitrary behavioral traditions in humans. , 2015, Journal of experimental psychology. General.

[117]  Joseph E LeDoux,et al.  Extinction Learning in Humans Role of the Amygdala and vmPFC , 2004, Neuron.

[118]  F. Guimarães,et al.  Involvement of the insular cortex in the consolidation and expression of contextual fear conditioning , 2013, The European journal of neuroscience.

[119]  J. Blair,et al.  Prediction errors to emotional expressions: the roles of the amygdala in social referencing. , 2015, Social cognitive and affective neuroscience.

[120]  L. Chittka,et al.  Learning by Observation Emerges from Simple Associations in an Insect Model , 2013, Current Biology.

[121]  B. Balleine,et al.  The Effect of Lesions of the Basolateral Amygdala on Instrumental Conditioning , 2003, The Journal of Neuroscience.

[122]  Christian Büchel,et al.  The periaqueductal gray and Bayesian integration in placebo analgesia , 2018, eLife.

[123]  M. Roesch,et al.  Observation of Reward Delivery to a Conspecific Modulates Dopamine Release in Ventral Striatum , 2014, Current Biology.

[124]  R. Dolan,et al.  Dorsal striatal dopamine D1 receptor availability predicts an instrumental bias in action learning , 2018, Proceedings of the National Academy of Sciences.

[125]  S. Preston,et al.  Mammalian empathy: behavioural manifestations and neural basis , 2017, Nature Reviews Neuroscience.

[126]  T. Roper,et al.  Social transmission of food-preferences in adult rats , 1983, Animal Behaviour.

[127]  W. Schultz,et al.  Neural mechanisms of observational learning , 2010, Proceedings of the National Academy of Sciences.

[128]  Christian Büchel,et al.  How initial confirmatory experience potentiates the detrimental influence of bad advice , 2013, NeuroImage.

[129]  D. Haun,et al.  Conformity in nonhuman primates: fad or fact? , 2013 .

[130]  B. Balleine,et al.  Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning , 2004, The European journal of neuroscience.

[131]  R. Davidson,et al.  The integration of negative affect, pain and cognitive control in the cingulate cortex , 2011, Nature Reviews Neuroscience.

[132]  B. Englis,et al.  Expectations of Cooperation and Competition and Their Effects on Observers' Vicarious Emotional Responses , 1989 .

[133]  J. O'Doherty,et al.  Empathic neural responses are modulated by the perceived fairness of others , 2006, Nature.

[134]  S. Mineka,et al.  Mechanisms involved in the observational conditioning of fear. , 1993, Journal of experimental psychology. General.

[135]  Christian Keysers,et al.  Experience Modulates Vicarious Freezing in Rats: A Model for Empathy , 2011, PloS one.

[136]  J. O'Doherty,et al.  Dissociable Brain Systems Mediate Vicarious Learning of Stimulus–Response and Action–Outcome Contingencies , 2012, The Journal of Neuroscience.

[137]  I. Huang,et al.  Observational Learning of a Bar-Press by Rats. , 1983, The Journal of general psychology.

[138]  Andreas Olsson,et al.  A common neural network differentially mediates direct and social fear learning , 2018, NeuroImage.

[139]  A. Dickinson Actions and habits: the development of behavioural autonomy , 1985 .

[140]  Mark D'Esposito,et al.  Behavioral / Systems / Cognitive Amygdala Response to Facial Expressions Reflects Emotional Learning , 2006 .

[141]  I. Fried,et al.  Observational learning computations in neurons of the human anterior cingulate cortex , 2016, Nature Communications.

[142]  N. Daw,et al.  Rethinking Extinction , 2015, Neuron.

[143]  Julian Jara-Ettinger,et al.  Theory of mind as inverse reinforcement learning , 2019, Current Opinion in Behavioral Sciences.

[144]  Joseph J. Paton,et al.  The primate amygdala represents the positive and negative value of visual stimuli during learning , 2006, Nature.

[145]  E. van de Waal,et al.  Potent Social Learning and Conformity Shape a Wild Primate’s Foraging Decisions , 2013, Science.

[146]  C. Heyes Who Knows? Metacognitive Social Learning Strategies , 2016, Trends in Cognitive Sciences.

[147]  Christian Grillon,et al.  Assessing fear and anxiety in humans using the threat of predictable and unpredictable aversive events (the NPU-threat test) , 2012, Nature Protocols.

[148]  Joseph E LeDoux,et al.  The lateral amygdaloid nucleus: sensory interface of the amygdala in fear conditioning , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[149]  Randall C. O'Reilly,et al.  Assembling Old Tricks for New Tasks: A Neural Model of Instructional Learning and Control , 2013, Journal of Cognitive Neuroscience.

[150]  J. Pearce,et al.  Not-so-social learning strategies , 2015, Proceedings of the Royal Society B: Biological Sciences.

[151]  A. Field,et al.  Vicarious learning and the development of fears in childhood. , 2007, Behaviour research and therapy.

[152]  B. Harrison,et al.  Fear extinction in the human brain: A meta-analysis of fMRI studies in healthy participants , 2018, Neuroscience & Biobehavioral Reviews.

[153]  H. Ruley,et al.  Observational fear learning involves affective pain system and Cav1.2 Ca2+ channels in ACC , 2010, Nature Neuroscience.

[154]  Matthew D. Lieberman,et al.  The dorsal anterior cingulate cortex is selective for pain: Results from large-scale reverse inference , 2015, Proceedings of the National Academy of Sciences.

[155]  M. Roesch,et al.  Neural Activity in Ventral Medial Prefrontal Cortex Is Modulated More Before Approach Than Avoidance During Reinforced and Extinction Trial Blocks , 2018, The Journal of Neuroscience.

[156]  K. Craig,et al.  Learning about pain from others: an observational learning account. , 2011, The journal of pain : official journal of the American Pain Society.

[157]  W. Schultz,et al.  Neuronal activity in monkey ventral striatum related to the expectation of reward , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[158]  P. Tobler,et al.  Social threat learning transfers to decision making in humans , 2019, Proceedings of the National Academy of Sciences.

[159]  H. Eichenbaum,et al.  Acetylcholine in the orbitofrontal cortex is necessary for the acquisition of a socially transmitted food preference. , 2005, Learning & memory.

[160]  Joseph E LeDoux,et al.  Different lateral amygdala outputs mediate reactions and actions elicited by a fear-arousing stimulus , 2000, Nature Neuroscience.

[161]  A. Roberts,et al.  Uncoupling of behavioral and autonomic responses after lesions of the primate orbitofrontal cortex , 2008, Proceedings of the National Academy of Sciences.

[162]  P. Dayan,et al.  Model-based and model-free Pavlovian reward learning: Revaluation, revision, and revelation , 2014, Cognitive, affective & behavioral neuroscience.

[163]  Hauke R. Heekeren,et al.  The Neural Basis of Following Advice , 2011, PLoS biology.

[164]  Kevin N. Laland,et al.  Conformist learning in nine-spined sticklebacks' foraging decisions , 2010, Biology Letters.

[165]  Haiyan Wu,et al.  Neural signatures of social conformity: A coordinate-based activation likelihood estimation meta-analysis of functional brain imaging studies , 2016, Neuroscience & Biobehavioral Reviews.

[166]  M. Roitman,et al.  Nucleus Accumbens Neurons Are Innately Tuned for Rewarding and Aversive Taste Stimuli, Encode Their Predictors, and Are Linked to Motor Output , 2005, Neuron.

[167]  James M. Otis,et al.  Prefrontal cortex output circuits guide reward seeking through divergent cue encoding , 2017, Nature.

[168]  Peter Dayan,et al.  Non-commercial Research and Educational Use including without Limitation Use in Instruction at Your Institution, Sending It to Specific Colleagues That You Know, and Providing a Copy to Your Institution's Administrator. All Other Uses, Reproduction and Distribution, including without Limitation Comm , 2022 .

[169]  G. Quirk,et al.  Fear extinction as a model for translational neuroscience: ten years of progress. , 2012, Annual review of psychology.

[170]  Thomas R. Zentall,et al.  Imitation of a passive avoidance response in the rat , 1980 .

[171]  Andreas Olsson,et al.  Learning fears by observing others: the neural systems of social fear transmission. , 2007, Social cognitive and affective neuroscience.

[172]  Jonathan Yi,et al.  Endogenous opioids regulate social threat learning in humans , 2017, Nature Communications.

[173]  Rebecca Saxe,et al.  Formalizing emotion concepts within a Bayesian model of theory of mind. , 2017, Current opinion in psychology.

[174]  B. Harrison,et al.  Neural signatures of human fear conditioning: an updated and extended meta-analysis of fMRI studies , 2016, Molecular Psychiatry.

[175]  A. Craig,et al.  How do you feel — now? The anterior insula and human awareness , 2009, Nature Reviews Neuroscience.

[176]  G. Hesslow The current status of the simulation theory of cognition , 2012, Brain Research.

[177]  K. Laland Social learning strategies , 2004, Learning & behavior.

[178]  Hailan Hu Reward and Aversion. , 2016, Annual review of neuroscience.

[179]  Emma Flynn,et al.  Whom do children copy? Model-based biases in social learning , 2013 .

[180]  K. Deisseroth,et al.  Input-specific control of reward and aversion in the ventral tegmental area , 2012, Nature.

[181]  Christian Büchel,et al.  Blockade of Endogenous Opioid Neurotransmission Enhances Acquisition of Conditioned Fear in Humans , 2008, The Journal of Neuroscience.

[182]  S. Ghirlanda,et al.  Social learning through associative processes: a computational theory , 2018, bioRxiv.

[183]  Alexander Vostroknutov,et al.  The Role of Intelligence in Social Learning , 2018, Scientific Reports.

[184]  E. Covey,et al.  Social Transmission of Fear in Rats: The Role of 22-kHz Ultrasonic Distress Vocalization , 2010, PloS one.

[185]  Carolyn Parkinson,et al.  The repurposed social brain , 2015, Trends in Cognitive Sciences.

[186]  G. Preti,et al.  Carbon disulfide: A semiochemical mediating socially-induced diet choice in rats , 1988, Physiology & Behavior.

[187]  Ş. Berber Conditioning through vicarious instigation. , 1962, Psychological review.

[188]  S. Haber,et al.  The Reward Circuit: Linking Primate Anatomy and Human Imaging , 2010, Neuropsychopharmacology.

[189]  C. Heyes Enquire within: cultural evolution and cognitive science , 2018, Philosophical Transactions of the Royal Society B: Biological Sciences.

[190]  K. Tye,et al.  From circuits to behaviour in the amygdala , 2015, Nature.

[191]  Edmund C Schwartz,et al.  Neural Representations of Unconditioned Stimuli in Basolateral Amygdala Mediate Innate and Learned Responses , 2015, Cell.

[192]  Luca Passamonti,et al.  A Key Role for Similarity in Vicarious Reward , 2009, Science.

[193]  Steve W. C. Chang,et al.  Social learning through prediction error in the brain , 2017, npj Science of Learning.

[194]  K. Miyazaki,et al.  Nucleus accumbens , 2018, Radiopaedia.org.

[195]  Jon Evan Del Russo,et al.  Observational learning of discriminative avoidance in hooded rats , 1975 .

[196]  Kevin J. Miller,et al.  Habits without Values , 2016, bioRxiv.

[197]  Alice M Stamatakis,et al.  Excitatory transmission from the amygdala to nucleus accumbens facilitates reward seeking. , 2011, Nature.

[198]  Christian Keysers,et al.  Emotional Mirror Neurons in the Rat’s Anterior Cingulate Cortex , 2019, Current Biology.

[199]  Peter A. Bos,et al.  The Basolateral Amygdala Is Essential for Rapid Escape: A Human and Rodent Study , 2018, Cell.

[200]  Shuo Wang,et al.  The human amygdala parametrically encodes the intensity of specific facial emotions and their categorical ambiguity , 2017, Nature Communications.

[201]  C. Heyes,et al.  A Demonstration of Observational Learning in Rats using a Bidirectional Control , 1990, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[202]  Johan D. Carlin,et al.  The neural basis of eye gaze processing , 2013, Current Opinion in Neurobiology.

[203]  R. Adolphs,et al.  Toward a Neural Basis for Social Behavior , 2013, Neuron.

[204]  S. Tonegawa,et al.  Activating positive memory engrams suppresses depression-like behaviour , 2015, Nature.

[205]  Justin L. Gardner,et al.  Learning to Simulate Others' Decisions , 2012, Neuron.

[206]  Ian R. Wickersham,et al.  A Circuit Mechanism for Differentiating Positive and Negative Associations , 2015, Nature.

[207]  Y. Mori,et al.  Identification of a pheromone that increases anxiety in rats , 2014, Proceedings of the National Academy of Sciences of the United States of America.

[208]  Michele Pignatelli,et al.  Antagonistic negative and positive neurons of the basolateral amygdala , 2016, Nature Neuroscience.

[209]  Jennifer S. Beer,et al.  Viewpoints: Dialogues on the functional role of the ventromedial prefrontal cortex , 2016, Nature Neuroscience.

[210]  J. O'Doherty,et al.  The involvement of model-based but not model-free learning signals during observational reward learning in the absence of choice. , 2016, Journal of neurophysiology.

[211]  Kevin N. Laland,et al.  The role of conformity in foraging when personal and social information conflict , 2004 .

[212]  Seymour M. Berger,et al.  Conditioning through vicarious instigation. , 1962 .

[213]  Kai Li,et al.  Computational approaches to fMRI analysis , 2017, Nature Neuroscience.

[214]  N. Tottenham,et al.  The Neuro-Environmental Loop of Plasticity: A Cross-Species Analysis of Parental Effects on Emotion Circuitry Development Following Typical and Adverse Caregiving , 2016, Neuropsychopharmacology.

[215]  Lydia M. Hopper,et al.  Chimpanzees copy dominant and knowledgeable individuals: implications for cultural diversity. , 2015, Evolution and human behavior : official journal of the Human Behavior and Evolution Society.

[216]  Vincent D Costa,et al.  From threat to safety: instructed reversal of defensive reactions. , 2015, Psychophysiology.

[217]  K. Berridge,et al.  Positive and Negative Motivation in Nucleus Accumbens Shell: Bivalent Rostrocaudal Gradients for GABA-Elicited Eating, Taste “Liking”/“Disliking” Reactions, Place Preference/Avoidance, and Fear , 2002, The Journal of Neuroscience.

[218]  Karl J. Friston,et al.  Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning , 2004, Science.

[219]  Andreas Olsson,et al.  Social Fear Learning: from Animal Models to Human Function , 2017, Trends in Cognitive Sciences.

[220]  A. Field,et al.  Learning to fear a second-order stimulus following vicarious learning , 2017, Cognition & emotion.

[221]  J. Masserman,et al.  "ALTRUISTIC" BEHAVIOR IN RHESUS MONKEYS. , 1964, The American journal of psychiatry.

[222]  J. Zaki,et al.  Empathy: a motivated account. , 2014, Psychological bulletin.

[223]  Joseph E LeDoux,et al.  Contributions of the Amygdala to Emotion Processing: From Animal Models to Human Behavior , 2005, Neuron.

[224]  T. Zentall,et al.  Imitation of conditional discriminations in pigeons (Columba livia). , 2002, Journal of comparative psychology.

[225]  C. Heyes What's social about social learning? , 2012, Journal of comparative psychology.

[226]  A. Olsson,et al.  Social learning of fear and safety is determined by the demonstrator's racial group , 2015, Biology Letters.

[227]  J. Rosenkranz,et al.  An intra-amygdala circuit specifically regulates social fear learning , 2016, Nature Neuroscience.

[228]  M. Delgado,et al.  How instructed knowledge modulates the neural systems of reward learning , 2010, Proceedings of the National Academy of Sciences.

[229]  S. Mineka,et al.  Fears, phobias, and preparedness: toward an evolved module of fear and fear learning. , 2001, Psychological review.

[230]  C. Frith,et al.  Meeting of minds: the medial frontal cortex and social cognition , 2006, Nature Reviews Neuroscience.

[231]  M. Kavaliers,et al.  Kinship, familiarity and social status modulate social learning about “micropredators” (biting flies) in deer mice , 2005, Behavioral Ecology and Sociobiology.

[232]  E. Phelps,et al.  Prepared stimuli enhance aversive learning without weakening the impact of verbal instructions , 2018, Learning & memory.