Frontostriatal development and probabilistic reinforcement learning during adolescence

HighlightsThis review summarizes current research on the neural mechanisms of adolescent learning.This review focuses on frontostriatal connections that develop during adolescence.Normative changes in dopamine‐rich circuitry support learning during adolescence. Abstract Adolescence has traditionally been viewed as a period of vulnerability to increased risk‐taking and adverse outcomes, which have been linked to neurobiological maturation of the frontostriatal reward system. However, growing research on the role of developmental changes in the adolescent frontostriatal system in facilitating learning will provide a more nuanced view of adolescence. In this review, we discuss the implications of existing research on this topic for learning during adolescence, and suggest that the very neural changes that render adolescents vulnerable to social pressure and risky decision making may also stand to play a role in scaffolding the ability to learn from rewards and from performance‐related feedback.

[1]  A. Galván.  Insights about Adolescent Behavior, Plasticity, and Policy from Neuroscience Research , 2014, Neuron.

[2]  Gary H. Glover,et al.  Sensitivity of the nucleus accumbens to violations in expectation of reward , 2007, NeuroImage.

[3]  L. Nystrom,et al.  Tracking the hemodynamic responses to reward and punishment in the striatum. , 2000, Journal of neurophysiology.

[4]  A. Galván,et al.  Neural representation of expected value in the adolescent brain , 2014, Proceedings of the National Academy of Sciences.

[5]  G. Glover,et al.  Risk-taking and the adolescent brain: who is at risk? , 2007, Developmental science.

[6]  S. Inati,et al.  An fMRI study of reward-related probability learning , 2005, NeuroImage.

[7]  J. O'Doherty,et al.  Multiple Systems for the Motivational Control of Behavior and Associated Neural Substrates in Humans. , 2015, Current topics in behavioral neurosciences.

[8]  Beatriz Luna,et al.  The role of experience in adolescent cognitive development: Integration of executive, memory, and mesolimbic systems , 2016, Neuroscience & Biobehavioral Reviews.

[9]  Michael X. Cohen,et al.  Striatum-medial prefrontal cortex connectivity predicts developmental changes in reinforcement learning. , 2012, Cerebral cortex.

[10]  Jane R. Garrison,et al.  Prediction error in reinforcement learning: A meta-analysis of neuroimaging studies , 2013, Neuroscience & Biobehavioral Reviews.

[11]  Adriana Galván,et al.  The use of functional and effective connectivity techniques to understand the developing brain , 2015, Developmental Cognitive Neuroscience.

[12]  Juliet Y. Davidow,et al.  Title An Upside to Reward Sensitivity : The Hippocampus Supports Enhanced Reinforcement Learning in Adolescence Permalink , 2016 .

[13]  M. Delgado,et al.  Modulation of Caudate Activity by Action Contingency , 2004, Neuron.

[14]  Mark A. Elliott,et al.  Being right is its own reward: Load and performance related ventral striatum activation to correct responses during a working memory task in youth , 2012, NeuroImage.

[15]  L. Steinberg.  A Social Neuroscience Perspective on Adolescent Risk-Taking. , 2008, Developmental review : DR.

[16]  Elizabeth Tricomi,et al.  Effects of intrinsic motivation on feedback processing during learning , 2015, NeuroImage.

[17]  Ashley R. Smith,et al.  The dual systems model: Review, reappraisal, and reaffirmation , 2015, Developmental Cognitive Neuroscience.

[18]  Adriana Galvan,et al.  Adolescent development of the reward system , 2022 .

[19]  Adriana Galván,et al.  Stress and the adolescent brain Amygdala-prefrontal cortex circuitry and ventral striatum as developmental targets , 2016, Neuroscience & Biobehavioral Reviews.

[20]  Adriana Galván,et al.  Beyond simple models of adolescence to an integrated circuit-based account: A commentary , 2015, Developmental Cognitive Neuroscience.

[21]  Timothy Edward John Behrens,et al.  The Neural Network Underlying Incentive-Based Learning: Implications for Interpreting Circuit Disruptions in Psychiatric Disorders , 2014, Neuron.

[22]  Nicholas B. Allen,et al.  Arrested development? Reconsidering dual-systems models of brain function in adolescence and disorders , 2012, Trends in Cognitive Sciences.

[23]  J. O'Doherty,et al.  Reward representations and reward-related learning in the human brain: insights from neuroimaging , 2004, Current Opinion in Neurobiology.

[24]  M. Phillips,et al.  Healthy adolescents' neural response to reward: associations with puberty, positive affect, and depressive symptoms. , 2010, Journal of the American Academy of Child and Adolescent Psychiatry.

[25]  Eveline A. Crone,et al.  Testing a dual-systems model of adolescent brain development using resting-state connectivity analyses , 2016, NeuroImage.

[26]  S. Pollmann,et al.  Comparing the Neural Basis of Monetary Reward and Cognitive Feedback during Information-Integration Category Learning , 2010, The Journal of Neuroscience.

[27]  L. Spear.  The adolescent brain and age-related behavioral manifestations , 2000, Neuroscience & Biobehavioral Reviews.

[28]  A. Toga,et al.  In vivo evidence for post-adolescent brain maturation in frontal and striatal regions , 1999, Nature Neuroscience.

[29]  A. V. van Duijvenvoorde,et al.  Evaluating the Negative or Valuing the Positive? Neural Mechanisms Supporting Feedback-Based Learning across Development , 2008, The Journal of Neuroscience.

[30]  Jay N. Giedd,et al.  The influence of puberty on subcortical brain development , 2014, NeuroImage.

[31]  S. Rombouts,et al.  Better than Expected or as Bad as You Thought? The Neurocognitive Development of Probabilistic Feedback Processing , 2009, Front. Hum. Neurosci..

[32]  G. Glover,et al.  Earlier Development of the Accumbens Relative to Orbitofrontal Cortex Might Underlie Risk-Taking Behavior in Adolescents , 2006, The Journal of Neuroscience.

[33]  Juliet Y. Davidow,et al.  An Upside to Reward Sensitivity: The Hippocampus Supports Enhanced Reinforcement Learning in Adolescence , 2016, Neuron.

[34]  Jocham Gerhard,et al.  Dopamine-mediated reinforcement learning signals in the striatum and ventromedial prefrontal cortex underlie value-based choices , 2011 .

[35]  Alan C. Evans,et al.  Brain development during childhood and adolescence: a longitudinal MRI study , 1999, Nature Neuroscience.

[36]  M. Gluck,et al.  Cortico-striatal contributions to feedback-based learning: converging data from neuroimaging and neuropsychology. , 2004, Brain : a journal of neurology.

[37]  J. O'Doherty,et al.  Contributions of the striatum to learning, motivation, and performance: an associative account , 2012, Trends in Cognitive Sciences.

[38]  James L. McClelland,et al.  Performance Feedback Drives Caudate Activation in a Phonological Learning Task , 2006, Journal of Cognitive Neuroscience.

[39]  R. Poldrack,et al.  Ventral–striatal/nucleus–accumbens sensitivity to prediction errors during classification learning , 2006, Human brain mapping.

[40]  Dirk J. Heslenfeld,et al.  Activity in human reward-sensitive brain areas is strongly context dependent , 2005, NeuroImage.

[41]  Matthijs A. A. van der Meer,et al.  Expectancies in Decision Making, Reinforcement Learning, and Ventral Striatum , 2009, Frontiers in neuroscience.

[42]  S. Andersen.  Trajectories of brain development: point of vulnerability or window of opportunity? , 2003, Neuroscience & Biobehavioral Reviews.

[43]  Hartwig R. Siebner,et al.  Chasing probabilities — Signaling negative and positive prediction errors across domains , 2016, NeuroImage.

[44]  M. Luciana.  Adolescent brain development in normality and psychopathology , 2013, Development and Psychopathology.

[45]  Daniel Brandeis,et al.  Cognitive flexibility in adolescence: Neural and behavioral mechanisms of reward prediction error processing in adaptive decision making during development , 2015, NeuroImage.

[46]  S. Blakemore,et al.  The Developmental Mismatch in Structural Brain Maturation during Adolescence , 2014, Developmental Neuroscience.

[47]  A. V. van Duijvenvoorde,et al.  Longitudinal Changes in Adolescent Risk-Taking: A Comprehensive Study of Neural Responses to Rewards, Pubertal Development, and Risk-Taking Behavior , 2015, The Journal of Neuroscience.

[48]  B. B. Doll,et al.  Experiential reward learning outweighs instruction prior to adulthood , 2015, Cognitive, affective & behavioral neuroscience.

[49]  T. Hare,et al.  The Adolescent Brain , 2008, Annals of the New York Academy of Sciences.

[50]  B. Luna,et al.  In vivo evidence of neurophysiological maturation of the human adolescent striatum , 2014, Developmental Cognitive Neuroscience.

[51]  E. Tricomi,et al.  Goals and task difficulty expectations modulate striatal responses to feedback , 2014, Cognitive, Affective, & Behavioral Neuroscience.

[52]  V. Reyna,et al.  Current Theories of Risk and Rational Decision Making. , 2008, Developmental review : DR.

[53]  P. Schattschneider.  Beyond Simple Models , 1986 .

[54]  Russell A. Poldrack,et al.  A unique adolescent response to reward prediction errors , 2010, Nature Neuroscience.

[55]  N. Daw,et al.  Reinforcement Learning Signals in the Human Striatum Distinguish Learners from Nonlearners during Reward-Based Decision Making , 2007, The Journal of Neuroscience.

[56]  G. Glover,et al.  The Role of Ventral Frontostriatal Circuitry in Reward-Based Learning in Humans , 2005, The Journal of Neuroscience.