Rule activation and ventromedial prefrontal engagement support accurate stopping in self-paced learning

&NA; When weighing evidence for a decision, individuals are continually faced with the choice of whether to gather more information or act on what has already been learned. The present experiment employed a self‐paced category learning task and fMRI to examine the neural mechanisms underlying stopping of information search and how they contribute to choice accuracy. Participants learned to classify triads of face, object, and scene cues into one of two categories using a rule based on one of the stimulus dimensions. After each trial, participants were given the option to explicitly solve the rule or continue learning. Representational similarity analysis (RSA) was used to examine activation of rule‐relevant information on trials leading up to a decision to solve the rule. We found that activation of rule‐relevant information increased leading up to participants' stopping decisions. Stopping was associated with widespread activation that included medial prefrontal cortex and visual association areas. Engagement of ventromedial prefrontal cortex (vmPFC) was associated with accurate stopping, and activation in this region was functionally coupled with signal in dorsolateral prefrontal cortex (dlPFC). Results suggest that activating rule information when deciding whether to stop an information search increases choice accuracy, and that the response profile of vmPFC during such decisions may provide an index of effective learning. HighlightsExamined the neural mechanisms associated with stopping an information search.Learned selective attention to predictive information was measured using MVPA.Accurate stopping decisions are preceded by enhanced attention to predictive cues.Ventromedial prefrontal engagement tracks the accuracy of stopping decisions.

[1]  J. Daunizeau,et al.  Automatic integration of confidence in the brain valuation signal , 2015, Nature Neuroscience.

[2]  Carol A. Seger,et al.  Categorical evidence, confidence, and urgency during probabilistic categorization , 2016, NeuroImage.

[3]  R Turner,et al.  Optimized EPI for fMRI studies of the orbitofrontal cortex , 2003, NeuroImage.

[4]  B. Love,et al.  Striatal and hippocampal entropy and recognition signals in category learning: simultaneous processes revealed by model-based fMRI. , 2012, Journal of experimental psychology. Learning, memory, and cognition.

[5]  Jonathan D. Power,et al.  Statistical improvements in functional magnetic resonance imaging analyses produced by censoring high‐motion data points , 2014, Human brain mapping.

[6]  Dagmar Zeithamova,et al.  Hippocampal and Ventral Medial Prefrontal Activation during Retrieval-Mediated Learning Supports Novel Inference , 2012, Neuron.

[7]  Tyler Davis,et al.  From Concrete Examples to Abstract Relations: The Rostrolateral Prefrontal Cortex Integrates Novel Examples into Relational Categories , 2016, Cerebral cortex.

[8]  Alice J. O'Toole,et al.  Partially Distributed Representations of Objects and Faces in Ventral Temporal Cortex , 2005, Journal of Cognitive Neuroscience.

[9]  W. T. Maddox,et al.  Delayed feedback disrupts the procedural-learning system but not the hypothesis-testing system in perceptual category learning. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[10]  Thomas E. Nichols,et al.  Can parametric statistical methods be trusted for fMRI based group studies? , 2015, 1511.01863.

[11]  R. Poldrack,et al.  Quantifying the internal structure of categories using a neural typicality measure. , 2014, Cerebral cortex.

[12]  R. Nosofsky Attention, similarity, and the identification-categorization relationship. , 1986, Journal of experimental psychology. General.

[13]  Carol A. Seger,et al.  Category learning in the brain. , 2010, Annual review of neuroscience.

[14]  Kristina M. Visscher,et al.  A Core System for the Implementation of Task Sets , 2006, Neuron.

[15]  V. Menon,et al.  A critical role for the right fronto-insular cortex in switching between central-executive and default-mode networks , 2008, Proceedings of the National Academy of Sciences.

[16]  M. Gluck,et al.  Interactive memory systems in the human brain , 2001, Nature.

[17]  W. T. Maddox,et al.  Dual-task interference in perceptual category learning , 2006, Memory & cognition.

[18]  Hans Knutsson,et al.  Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates , 2016, Proceedings of the National Academy of Sciences.

[19]  Dmitrii Paniukov,et al.  The evaluative role of rostrolateral prefrontal cortex in rule-based category learning , 2018, NeuroImage.

[20]  R. Deichmann,et al.  Optimized EPI for fMRI studies of the orbitofrontal cortex: compensation of susceptibility-induced gradients in the readout direction , 2007, Magnetic Resonance Materials in Physics, Biology and Medicine.

[21]  J. Frank Yates,et al.  Judgment and Decision Making , 1990 .

[22]  Klaus Oberauer,et al.  Neural Evidence for a Distinction between Short-term Memory and the Focus of Attention , 2012, Journal of Cognitive Neuroscience.

[23]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[24]  Natalia Karelaia,et al.  Thirst for confirmation in multi-attribute choice: Does search for consistency impair decision performance? , 2006 .

[25]  J. Rieskamp,et al.  Deciding When to Decide: Time-Variant Sequential Sampling Models Explain the Emergence of Value-Based Decisions in the Human Brain , 2012, The Journal of Neuroscience.

[26]  J. Hirsch,et al.  A Neural Representation of Categorization Uncertainty in the Human Brain , 2006, Neuron.

[27]  R. Nosofsky,et al.  Rule-plus-exception model of classification learning. , 1994, Psychological review.

[28]  W. T. Maddox,et al.  Annals of the New York Academy of Sciences Human Category Learning 2.0 Brief Review of First-generation Research , 2022 .

[29]  Michael L. Mack,et al.  Decoding the Brain’s Algorithm for Categorization from Its Neural Implementation , 2013, Current Biology.

[30]  R. Dolan,et al.  Confidence in value-based choice , 2012, Nature Neuroscience.

[31]  B. Newell,et al.  Take the best or look at the rest? Factors influencing "one-reason" decision making. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[32]  Robert C. Wilson,et al.  Reinforcement Learning in Multidimensional Environments Relies on Attention Mechanisms , 2015, The Journal of Neuroscience.

[33]  Carol A. Seger,et al.  Dynamics of frontal, striatal, and hippocampal systems during rule learning. , 2005, Cerebral cortex.

[34]  Sabrina M. Tom,et al.  The Neural Basis of Loss Aversion in Decision-Making Under Risk , 2007, Science.

[35]  Antonio Rangel,et al.  The Decision Value Computations in the vmPFC and Striatum Use a Relative Value Code That is Guided by Visual Attention , 2011, The Journal of Neuroscience.

[36]  C. White,et al.  Perceptual Criteria in the Human Brain , 2012, The Journal of Neuroscience.

[37]  B. Newell,et al.  Search strategies in decision making: the success of “success” , 2004 .

[38]  G Gigerenzer,et al.  Reasoning the fast and frugal way: models of bounded rationality. , 1996, Psychological review.

[39]  Russell A. Poldrack,et al.  What do differences between multi-voxel and univariate analysis mean? How subject-, voxel-, and trial-level variance impact fMRI analysis , 2014, NeuroImage.

[40]  Daniel Hausmann,et al.  Sequential evidence accumulation in decision making: The individual desired level of confidence can explain the extent of information acquisition , 2008, Judgment and Decision Making.

[41]  Adam Gazzaley,et al.  Measuring functional connectivity during distinct stages of a cognitive task , 2004, NeuroImage.

[42]  Mieke Verfaellie,et al.  The Role of VMPC in Metamemorial Judgments of Content Retrievability , 2005, Journal of Cognitive Neuroscience.

[43]  Ulrike Basten,et al.  How the brain integrates costs and bene fi ts during decision making , 2010 .

[44]  T. Hare,et al.  Behavioral / Cognitive Interactions between Dorsolateral and Ventromedial Prefrontal Cortex Underlie Context-Dependent Stimulus Valuation in Goal-Directed Choice , 2017 .

[45]  Michael L. Mack,et al.  Dynamic updating of hippocampal object representations reflects new conceptual knowledge , 2016, Proceedings of the National Academy of Sciences.

[46]  J B Poline,et al.  The neural system that bridges reward and cognition in humans: An fMRI study , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[47]  M. D’Esposito,et al.  Distinct mechanisms in visual category learning , 2007, Cognitive, affective & behavioral neuroscience.

[48]  Russell A. Poldrack,et al.  Deconvolving BOLD activation in event-related designs for multivoxel pattern classification analyses , 2012, NeuroImage.

[49]  Jakob Heinzle,et al.  Decoding different roles for vmPFC and dlPFC in multi-attribute decision making , 2011, NeuroImage.

[50]  Vincent D Costa,et al.  Frontal-parietal and limbic-striatal activity underlies information sampling in the best choice problem. , 2015, Cerebral cortex.

[51]  Leslie G. Ungerleider,et al.  A general mechanism for perceptual decision-making in the human brain , 2004, Nature.

[52]  J. Kruschke,et al.  ALCOVE: an exemplar-based connectionist model of category learning. , 1992, Psychological review.

[53]  Oury Monchi,et al.  Fronto-striatal contribution to lexical set-shifting. , 2011, Cerebral cortex.

[54]  Nikolaus Kriegeskorte,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[55]  Gareth Roberts,et al.  From Concrete Examples to Abstract Relations: A model-based neuroscience approach to how people learn new categories , 2017, CogSci.

[56]  M. D’Esposito,et al.  Frontal Cortex and the Discovery of Abstract Action Rules , 2010, Neuron.

[57]  N. Kanwisher,et al.  Mental Imagery of Faces and Places Activates Corresponding Stimulus-Specific Brain Regions , 2000, Journal of Cognitive Neuroscience.

[58]  M. Smith,et al.  The Core System , 2017 .

[59]  O. Svenson Differentiation and consolidation theory of human decision making: A frame of reference for the study of pre- and post-decision processes , 1992 .

[60]  E. Fehr,et al.  Dorsolateral and ventromedial prefrontal cortex orchestrate normative choice , 2011, Nature Neuroscience.

[61]  Carol A. Seger,et al.  Neural networks supporting switching, hypothesis testing, and rule application , 2015, Neuropsychologia.

[62]  Keqin Liu,et al.  Automatic Integration , 2020, 2006.15210.

[63]  Joseph W. Kable,et al.  The valuation system: A coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value , 2013, NeuroImage.

[64]  Carol A. Seger,et al.  Generalization in Category Learning: The Roles of Representational and Decisional Uncertainty , 2015, The Journal of Neuroscience.

[65]  R. Shepard,et al.  Learning and memorization of classifications. , 1961 .

[66]  Jonathan R. Folstein,et al.  Category learning increases discriminability of relevant object dimensions in visual cortex. , 2013, Cerebral cortex.

[67]  Helen C. Barron,et al.  Reassessing VMPFC: full of confidence? , 2015, Nature Neuroscience.

[68]  Joseph W. Kable,et al.  The valuation system: a coordinate-based meta-analysis examining BOLD correlates of subjective value , 2013 .