Neural Computations Underlying Arbitration between Model-Based and Model-free Learning

[1]  B. Porr,et al.  Reinforcement learning , 2020, Scholarpedia.

[2]  Krzysztof J. Gorgolewski,et al.  Medial and Lateral Networks in Anterior Prefrontal Cortex Support Metacognitive Ability for Memory and Perception , 2013, The Journal of Neuroscience.

[3]  Christian Büchel,et al.  How initial confirmatory experience potentiates the detrimental influence of bad advice , 2013, NeuroImage.

[4]  G. Feng,et al.  Optogenetic Stimulation of Lateral Orbitofronto-Striatal Pathway Suppresses Compulsive Behaviors , 2013, Science.

[5]  R. Dolan,et al.  Confidence in value-based choice , 2012, Nature Neuroscience.

[6]  Kyle S. Smith,et al.  Reversible online control of habitual behavior by optogenetic perturbation of medial prefrontal cortex , 2012, Proceedings of the National Academy of Sciences.

[7]  K. R. Ridderinkhof,et al.  Corticostriatal Connectivity Underlies Individual Differences in the Balance between Habitual and Goal-Directed Action Control , 2012, The Journal of Neuroscience.

[8]  P. Dayan,et al.  Mapping value based planning and extensively trained choice in the human brain , 2012, Nature Neuroscience.

[9]  Nicole M. Long,et al.  Supplemental Figure , 2013 .

[10]  Colin Camerer,et al.  Transformation of stimulus value signals into motor commands during simple choice , 2011, Proceedings of the National Academy of Sciences.

[11]  N. Daw,et al.  Differential roles of human striatum and amygdala in associative learning , 2011, Nature Neuroscience.

[12]  Ulrik R. Beierholm,et al.  Separate encoding of model-based and model-free valuations in the human brain , 2011, NeuroImage.

[13]  Robert C. Wilson,et al.  Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex , 2011, Nature Neuroscience.

[14]  Antonio Rangel,et al.  The Decision Value Computations in the vmPFC and Striatum Use a Relative Value Code That is Guided by Visual Attention , 2011, The Journal of Neuroscience.

[15]  T. Robbins,et al.  Disruption in the Balance Between Goal-Directed Behavior and Habit Learning in Obsessive-Compulsive Disorder , 2011, The American journal of psychiatry.

[16]  M. Walton,et al.  Frontal Cortex and Reward-Guided Learning and Decision-Making , 2011, Neuron.

[17]  Peter Bossaerts,et al.  Risk, Unexpected Uncertainty, and Estimation Uncertainty: Bayesian Learning in Unstable Settings , 2011, PLoS Comput. Biol..

[18]  A. R. Plastino,et al.  Diverging Fano factors , 2010 .

[19]  James B. Rowe,et al.  Action selection: A race model for selected and non-selected actions distinguishes the contribution of premotor and prefrontal areas , 2010, NeuroImage.

[20]  P. Dayan,et al.  States versus Rewards: Dissociable Neural Prediction Error Signals Underlying Model-Based and Model-Free Reinforcement Learning , 2010, Neuron.

[21]  Benjamin J. Tamber-Rosenau,et al.  Avoiding non-independence in fMRI data analysis: Leave one subject out , 2010, NeuroImage.

[22]  Guillem R. Esber,et al.  Neural Correlates of Variations in Event Processing during Learning in Basolateral Amygdala , 2010, The Journal of Neuroscience.

[23]  Peter N. C. Mohr,et al.  Genetic variation in dopaminergic neuromodulation influences the ability to rapidly and flexibly adapt decisions , 2009, Proceedings of the National Academy of Sciences.

[24]  J. O'Doherty,et al.  Evidence for a Common Representation of Decision Values for Dissimilar Goods in Human Ventromedial Prefrontal Cortex , 2009, The Journal of Neuroscience.

[25]  A. Dickinson,et al.  Differential Engagement of the Ventromedial Prefrontal Cortex by Goal-Directed and Habitual Behavior toward Food Pictures in Humans , 2009, The Journal of Neuroscience.

[26]  D. Koller,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[27]  Karl J. Friston,et al.  Bayesian model selection for group studies , 2009, NeuroImage.

[28]  Timothy Edward John Behrens,et al.  How Green Is the Grass on the Other Side? Frontopolar Cortex and the Evidence in Favor of Alternative Courses of Action , 2009, Neuron.

[29]  B. Balleine,et al.  A specific role for posterior dorsolateral striatum in human habit learning , 2009, The European journal of neuroscience.

[30]  Colin Camerer,et al.  Self-control in decision-making involves modulation of the vmPFC valuation system , 2009, NeuroImage.

[31]  Timothy D. Hanks,et al.  Probabilistic Population Codes for Bayesian Decision Making , 2008, Neuron.

[32]  R. Poldrack,et al.  Neural Substrates for Reversing Stimulus–Outcome and Stimulus–Response Associations , 2008, The Journal of Neuroscience.

[33]  B. Balleine,et al.  Calculating Consequences: Brain Systems That Encode the Causal Effects of Actions , 2008, The Journal of Neuroscience.

[34]  A. Graybiel.  Habits, rituals, and the evaluative brain. , 2008, Annual review of neuroscience.

[35]  S. Quartz,et al.  Human Insula Activation Reflects Risk Prediction Errors As Well As Risk , 2008, The Journal of Neuroscience.

[36]  E. Koechlin,et al.  Anterior Prefrontal Function and the Limits of Human Decision-Making , 2007, Science.

[37]  Vivian V. Valentin,et al.  Determining the Neural Substrates of Goal-Directed Learning in the Human Brain , 2007, The Journal of Neuroscience.

[38]  Shimon Ullman,et al.  Faculty Opinions recommendation of Bayesian inference with probabilistic population codes. , 2007 .

[39]  J. O'Doherty,et al.  The Role of the Ventromedial Prefrontal Cortex in Abstract State-Based Inference during Decision Making in Humans , 2006, The Journal of Neuroscience.

[40]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[41]  T. Robbins,et al.  Neural systems of reinforcement for drug addiction: from actions to habits to compulsion , 2005, Nature Neuroscience.

[42]  B. Balleine,et al.  The role of the dorsomedial striatum in instrumental conditioning , 2005, The European journal of neuroscience.

[43]  M. Pelley.  The Role of Associative History in Models of Associative Learning: A Selective Review and a Hybrid Model: , 2004 .

[44]  M. L. Le Pelley.  The Role of Associative History in Models of Associative Learning: A Selective Review and a Hybrid Model , 2004, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[45]  B. Knowlton,et al.  Contributions of striatal subregions to place and response learning. , 2004, Learning & memory.

[46]  Karl J. Friston,et al.  Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning , 2004, Science.

[47]  T. Robbins,et al.  Inhibition and the right inferior frontal cortex , 2004, Trends in Cognitive Sciences.

[48]  B. Balleine,et al.  Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning , 2004, The European journal of neuroscience.

[49]  S. Killcross,et al.  Inactivation of the infralimbic prefrontal cortex reinstates goal-directed responding in overtrained rats , 2003, Behavioural Brain Research.

[50]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[51]  Samuel M. McClure,et al.  Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum , 2003, Neuron.

[52]  Karl J. Friston,et al.  Temporal Difference Models and Reward-Related Learning in the Human Brain , 2003, Neuron.

[53]  T. Robbins,et al.  Stop-signal inhibition disrupted by damage to right inferior frontal gyrus in humans , 2003, Nature Neuroscience.

[54]  T. Robbins,et al.  Defining the Neural Mechanisms of Probabilistic Reversal Learning Using Event-Related Functional Magnetic Resonance Imaging , 2002, The Journal of Neuroscience.

[55]  Mitsuo Kawato,et al.  Multiple Model-Based Reinforcement Learning , 2002, Neural Computation.

[56]  E. Stein,et al.  Right hemispheric dominance of inhibitory control: an event-related functional MRI study. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[57]  A. Barto.  Reinforcement learning , 1998 .

[58]  Jeffrey C. Lagarias,et al.  Convergence Properties of the Nelder-Mead Simplex Method in Low Dimensions , 1998, SIAM J. Optim..

[59]  B. Balleine,et al.  Goal-directed instrumental action: contingency and incentive learning and their cortical substrates , 1998, Neuropharmacology.

[60]  Karl J. Friston,et al.  Psychophysiological and Modulatory Interactions in Neuroimaging , 1997, NeuroImage.

[61]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[62]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[63]  P. Dayan,et al.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[64]  Richard S. Sutton,et al.  Adapting Bias by Gradient Descent: An Incremental Version of Delta-Bar-Delta , 1992, AAAI.

[65]  Christopher D. Adams,et al.  Instrumental Responding following Reinforcer Devaluation , 1981 .

[66]  J. Pearce,et al.  A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. , 1980, Psychological review.

[67]  R. Duncan Luce,et al.  Individual Choice Behavior: A Theoretical Analysis , 1979 .

[68]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[69]  H. Akaike.  A new look at the statistical model identification , 1974 .

[70]  R. Luce,et al.  Individual Choice Behavior: A Theoretical Analysis. , 1960 .

[71]  P. Dayan,et al.  NIH-PA Author Manuscript NIH-PA Author Manuscript NIH-PA Author Manuscript NIH Public Access Author Manuscript Neuron. Author manuscript. , 2011 .

[72]  B. Balleine,et al.  Human and Rodent Homologies in Action Control: Corticostriatal Determinants of Goal-Directed and Habitual Action , 2010, Neuropsychopharmacology.

[73]  J. Tanji,et al.  Role of the lateral prefrontal cortex in executive behavioral control. , 2008, Physiological reviews.

[74]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[75]  J. Janesick,et al.  Scientific Charge-Coupled Devices , 2001 .

[76]  J. O'Doherty,et al.  Annals of the New York Academy of Sciences Contributions of the Ventromedial Prefrontal Cortex to Goal-directed Action Selection , 2022 .