Charting the Expansion of Strategic Exploratory Behavior During Adolescence

Although models of exploratory decision making implicate a suite of strategies that guide the pursuit of information, the developmental emergence of these strategies remains poorly understood. This study takes an interdisciplinary perspective, merging computational decision making and developmental approaches to characterize age-related shifts in exploratory strategy from adolescence to young adulthood. Participants were 149 12–28-year-olds who completed a computational explore–exploit paradigm that manipulated reward value, information value, and decision horizon (i.e., the utility that information holds for future choices). Strategic directed exploration, defined as information seeking selective for long time horizons, emerged during adolescence and maintained its level through early adulthood. This age difference was partially driven by adolescents valuing immediate reward over new information. Strategic random exploration, defined as stochastic choice behavior selective for long time horizons, was invoked at comparable levels over the age range, and predicted individual differences in attitudes toward risk taking in daily life within the adolescent portion of the sample. Collectively, these findings reveal an expansion of the diversity of strategic exploration over development, implicate distinct mechanisms for directed and random exploratory strategies, and suggest novel mechanisms for adolescent-typical shifts in decision making.

[1]  W. R. Thompson ON THE LIKELIHOOD THAT ONE UNKNOWN PROBABILITY EXCEEDS ANOTHER IN VIEW OF THE EVIDENCE OF TWO SAMPLES , 1933 .

[2]  J. Nunnally,et al.  Exploratory Behavior and Human Development , 1974 .

[3]  J. Gittins Bandit processes and dynamic allocation indices , 1979 .

[4]  John S. Bridle,et al.  Training Stochastic Model Recognition Algorithms as Networks can Lead to Maximum Mutual Information Estimation of Parameters , 1989, NIPS.

[5]  G. Laviola,et al.  Elevated novelty seeking and peculiar d-amphetamine sensitization in periadolescent mice compared with adult mice. , 1998, Behavioral neuroscience.

[6]  G. Aston-Jones,et al.  Locus coeruleus and regulation of behavioral flexibility and attention. , 2000, Progress in brain research.

[7]  L. Spear The adolescent brain and age-related behavioral manifestations , 2000, Neuroscience & Biobehavioral Reviews.

[8]  Martin H. Teicher,et al.  Dopamine receptor pruning in prefrontal cortex during the periadolescent period in rats , 2000, Synapse.

[9]  L. Steinberg,et al.  Adolescent Development , 2001, Journal of Cognitive Education and Psychology.

[10]  G. Laviola,et al.  Risk taking during exploration of a plus-maze is greater in adolescent than in juvenile or adult mice , 2002, Animal Behaviour.

[11]  L. Steinberg Risk Taking in Adolescence: What Changes, and Why? , 2004, Annals of the New York Academy of Sciences.

[12]  Peter Auer,et al.  Finite-time Analysis of the Multiarmed Bandit Problem , 2002, Machine Learning.

[13]  R. Hertwig,et al.  Decisions from Experience and the Effect of Rare Events in Risky Choice , 2004, Psychological science.

[14]  Jonathan D. Cohen,et al.  An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. , 2005, Annual review of neuroscience.

[15]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[16]  B. J. Casey,et al.  Imaging the developing brain: what have we learned about cognitive development? , 2005, Trends in Cognitive Sciences.

[17]  E. Weber,et al.  A Domain-Specific Risk-Taking (DOSPERT) Scale for Adult Populations , 2006, Judgment and Decision Making.

[18]  G. Glover,et al.  Earlier Development of the Accumbens Relative to Orbitofrontal Cortex Might Underlie Risk-Taking Behavior in Adolescents , 2006, The Journal of Neuroscience.

[19]  P. Dayan,et al.  Cortical substrates for exploratory decisions in humans , 2006, Nature.

[20]  Laurence Steinberg,et al.  Age differences in future orientation and delay discounting. , 2009, Child development.

[21]  M. Frank,et al.  Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. , 2009, Nature neuroscience.

[22]  L. Somerville,et al.  Developmental neurobiology of cognitive control and motivational systems , 2010, Current Opinion in Neurobiology.

[23]  E. Weber,et al.  Who Takes Risks When and Why? , 2011 .

[24]  Michael J. Brammer,et al.  Maturation of limbic corticostriatal activation and connectivity associated with developmental changes in temporal discounting , 2011, NeuroImage.

[25]  E. Crone,et al.  Understanding adolescence as a period of social–affective engagement and goal flexibility , 2012, Nature Reviews Neuroscience.

[26]  Nicole M. Long,et al.  Supplemental Figure , 2013 .

[27]  Alan C. Evans,et al.  Total and regional brain volumes in a population-based normative sample from 4 to 18 years: the NIH MRI Study of Normal Brain Development. , 2012, Cerebral cortex.

[28]  P. Glimcher,et al.  Adolescents’ risk-taking behavior is driven by tolerance to ambiguity , 2012, Proceedings of the National Academy of Sciences.

[29]  G. Glover,et al.  The Medial Prefrontal Cortex and the Emergence of Self-Conscious Emotion in Adolescence , 2013, Psychological science.

[30]  Michael J. Brammer,et al.  Neural and Psychological Maturation of Decision-making in Adolescence and Young Adulthood , 2013, Journal of Cognitive Neuroscience.

[31]  Jonathan D. Cohen,et al.  Humans use directed and random exploration to solve the explore-exploit dilemma. , 2014, Journal of experimental psychology. General.

[32]  K. Branson,et al.  Behavioral Variability through Stochastic Choice and Its Gating by Anterior Cingulate Cortex , 2014, Cell.

[33]  Vincent D Costa,et al.  Dopamine modulates novelty seeking behavior during decision making. , 2014, Behavioral neuroscience.

[34]  M. V. van Aken,et al.  A meta-analysis on age differences in risky decision making: adolescents versus children and adults. , 2015, Psychological bulletin.

[35]  Christian A. Rodriguez,et al.  Adolescent impatience decreases with increased frontostriatal connectivity , 2015, Proceedings of the National Academy of Sciences.

[36]  Catherine A. Hartley,et al.  The neuroscience of adolescent decision-making , 2015, Current Opinion in Behavioral Sciences.

[37]  T. Hare,et al.  Transcranial Stimulation over Frontopolar Cortex Elucidates the Choice Attributes and Neural Mechanisms Used to Resolve Exploration–Exploitation Trade-Offs , 2015, The Journal of Neuroscience.

[38]  A. V. van Duijvenvoorde,et al.  Longitudinal Changes in Adolescent Risk-Taking: A Comprehensive Study of Neural Responses to Rewards, Pubertal Development, and Risk-Taking Behavior , 2015, The Journal of Neuroscience.

[39]  Eva H. Telzer,et al.  Exploration-exploitation strategy is dependent on early experience. , 2015, Developmental psychobiology.

[40]  A. V. van Duijvenvoorde,et al.  Dealing With Uncertainty: Testing Risk- and Ambiguity-Attitude Across Adolescence , 2016, Developmental neuropsychology.

[41]  Michael J. Frank,et al.  A Neural Correlate of Strategic Exploration at the Onset of Adolescence , 2016, Journal of Cognitive Neuroscience.

[42]  Eduardo E. Benarroch,et al.  Locus coeruleus , 2017, Cell and Tissue Research.