Goal-oriented and habitual decisions: Neural signatures of model-based and model-free learning

[1]  E. Holman.  Some conditions for the dissociation of consummatory and instrumental behavior in rats , 1975 .

[2]  P Pasik,et al.  A Golgi and ultrastructural study of the monkey globus pallidus , 1982, The Journal of comparative neurology.

[3]  A. Dickinson.  Actions and habits: the development of behavioural autonomy , 1985 .

[4]  R. Rescorla,et al.  Associations between the discriminative stimulus and the reinforcer in instrumental learning. , 1988 .

[5]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[6]  B. Balleine,et al.  Goal-directed instrumental action: contingency and incentive learning and their cortical substrates , 1998, Neuropharmacology.

[7]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[8]  B. Balleine,et al.  The Role of the Nucleus Accumbens in Instrumental Conditioning: Evidence of a Functional Dissociation between Accumbens Core and Shell , 2001, The Journal of Neuroscience.

[9]  W. Schultz.  Book Review: Reward Signaling by Dopamine Neurons , 2001, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[10]  Peter Olausson,et al.  Impairments of Reversal Learning and Response Perseveration after Repeated, Intermittent Cocaine Administrations to Monkeys , 2002, Neuropsychopharmacology.

[11]  Guinevere F. Eden,et al.  Meta-Analysis of the Functional Neuroanatomy of Single-Word Reading: Method and Validation , 2002, NeuroImage.

[12]  S. Killcross,et al.  Coordination of actions and habits in the medial prefrontal cortex of rats. , 2003, Cerebral cortex.

[13]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[14]  C. Padoa-Schioppa,et al.  Neurons in the orbitofrontal cortex encode economic value , 2006, Nature.

[15]  H. Uylings,et al.  Reduced orbitofrontal-striatal activity on a reversal learning task in obsessive-compulsive disorder. , 2006, Archives of general psychiatry.

[16]  Vivian V. Valentin,et al.  Determining the Neural Substrates of Goal-Directed Learning in the Human Brain , 2007, The Journal of Neuroscience.

[17]  D. Schacter,et al.  Remembering the past to imagine the future: the prospective brain , 2007, Nature Reviews Neuroscience.

[18]  T. Robbins,et al.  Orbitofrontal Dysfunction in Patients with Obsessive-Compulsive Disorder and Their Unaffected Relatives , 2008, Science.

[19]  B. Balleine,et al.  Calculating Consequences: Brain Systems That Encode the Causal Effects of Actions , 2008, The Journal of Neuroscience.

[20]  J. Kwon,et al.  Neural correlates of cognitive inflexibility during task-switching in obsessive-compulsive disorder. , 2007, Brain : a journal of neurology.

[21]  B. Balleine,et al.  A specific role for posterior dorsolateral striatum in human habit learning , 2009, The European journal of neuroscience.

[22]  Geoffrey Schoenbaum,et al.  Neural substrates of cognitive inflexibility after chronic cocaine exposure , 2009, Neuropharmacology.

[23]  K. Zilles,et al.  Coordinate‐based activation likelihood estimation meta‐analysis of neuroimaging data: A random‐effects approach based on empirical estimates of spatial uncertainty , 2009, Human brain mapping.

[24]  A. Dickinson,et al.  Differential Engagement of the Ventromedial Prefrontal Cortex by Goal-Directed and Habitual Behavior toward Food Pictures in Humans , 2009, The Journal of Neuroscience.

[25]  Adam Johnson,et al.  Triple Dissociation of Information Processing in Dorsal Striatum, Ventral Striatum, and Hippocampus on a Learned Spatial Decision Task , 2010, Neuron.

[26]  P. Dayan,et al.  States versus Rewards: Dissociable Neural Prediction Error Signals Underlying Model-Based and Model-Free Reinforcement Learning , 2010, Neuron.

[27]  B. Balleine,et al.  Human and Rodent Homologies in Action Control: Corticostriatal Determinants of Goal-Directed and Habitual Action , 2010, Neuropsychopharmacology.

[28]  Carol A. Seger,et al.  Category learning in the brain. , 2010, Annual review of neuroscience.

[29]  Daniel S Pine,et al.  Cognitive inflexibility and frontal-cortical activation in pediatric obsessive-compulsive disorder. , 2010, Journal of the American Academy of Child and Adolescent Psychiatry.

[30]  Ulrik R. Beierholm,et al.  Separate encoding of model-based and model-free valuations in the human brain , 2011, NeuroImage.

[31]  Dylan A. Simon,et al.  Neural Correlates of Forward Planning in a Spatial Decision Task in Humans , 2011, The Journal of Neuroscience.

[32]  P. Dayan,et al.  Model-based influences on humans’ choices and striatal prediction errors , 2011, Neuron.

[33]  B. Balleine,et al.  The General and Outcome-Specific Forms of Pavlovian-Instrumental Transfer Are Differentially Mediated by the Nucleus Accumbens Core and Shell , 2011, The Journal of Neuroscience.

[34]  J. O'Doherty,et al.  Annals of the New York Academy of Sciences Contributions of the Ventromedial Prefrontal Cortex to Goal-directed Action Selection , 2022 .

[35]  N. Daw,et al.  Dissociating hippocampal and striatal contributions to sequential prediction learning , 2012, The European journal of neuroscience.

[36]  N. Daw,et al.  The ubiquity of model-based reinforcement learning , 2012, Current Opinion in Neurobiology.

[37]  P. Dayan,et al.  Mapping value based planning and extensively trained choice in the human brain , 2012, Nature Neuroscience.

[38]  Simon B Eickhoff,et al.  Minimizing within‐experiment and within‐group effects in activation likelihood estimation meta‐analyses , 2012, Human brain mapping.

[39]  N. Daw,et al.  Generalization of value in reinforcement learning by humans , 2012, The European journal of neuroscience.

[40]  Jane R. Garrison,et al.  Prediction error in reinforcement learning: A meta-analysis of neuroimaging studies , 2013, Neuroscience & Biobehavioral Reviews.

[41]  Nathaniel D. Daw,et al.  Cortical and Hippocampal Correlates of Deliberation during Model-Based Decisions for Rewards in Humans , 2013, PLoS Comput. Biol..

[42]  Alice Y. Chiang,et al.  Working-memory capacity protects model-based learning from stress , 2013, Proceedings of the National Academy of Sciences.

[43]  Nathaniel J. Blanco,et al.  The influence of depression symptoms on exploratory decision-making , 2013, Cognition.

[44]  T. Robbins,et al.  Goal-directed learning and obsessive–compulsive disorder , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[45]  Bharath Chandrasekaran,et al.  Elevated depressive symptoms enhance reflexive but not reflective auditory category learning , 2014, Cortex.

[46]  Simon Schwab,et al.  Unconscious relational encoding depends on hippocampus , 2014, Brain : a journal of neurology.

[47]  Shinsuke Shimojo,et al.  Neural Computations Underlying Arbitration between Model-Based and Model-free Learning , 2013, Neuron.

[48]  Dylan A. Simon,et al.  Model-based choices involve prospective neural activity , 2015, Nature Neuroscience.

[49]  A. Villringer,et al.  Lateral prefrontal model-based signatures are reduced in healthy individuals with high trait impulsivity , 2015, Translational Psychiatry.

[50]  R. Dolan,et al.  Ventral striatal dopamine reflects behavioral and neural signatures of model-based control during sequential decision making , 2015, Proceedings of the National Academy of Sciences.

[51]  A. Villringer,et al.  The interaction of acute and chronic stress impairs model-based behavioral control , 2015, Psychoneuroendocrinology.

[52]  Daniel C. McNamee,et al.  Characterizing the Associative Content of Brain Structures Involved in Habitual and Goal-Directed Actions in Humans: A Multivariate fMRI Study , 2015, The Journal of Neuroscience.

[53]  Sara Medina,et al.  Striatal Dopamine Links Gastrointestinal Rerouting to Altered Sweet Appetite. , 2016, Cell metabolism.

[54]  Makoto Ito,et al.  Model-based action planning involves cortico-cerebellar and basal ganglia networks , 2016, Scientific Reports.

[55]  Catherine A. Hartley,et al.  From Creatures of Habit to Goal-Directed Learners , 2016, Psychological science.

[56]  J. O'Doherty,et al.  The involvement of model-based but not model-free learning signals during observational reward learning in the absence of choice. , 2016, Journal of neurophysiology.

[57]  Russell A. Poldrack,et al.  Neural correlates of state-based decision-making in younger and older adults , 2016, NeuroImage.

[58]  Kevin J. Miller,et al.  Dorsal hippocampus contributes to model-based planning , 2017, Nature Neuroscience.

[59]  L. Deserno,et al.  Impaired Flexible Reward-Based Decision-Making in Binge Eating Disorder: Evidence from Computational Modeling and Functional Neuroimaging , 2017, Neuropsychopharmacology.

[60]  Samuel Gershman,et al.  Predictive representations can link model-based reinforcement learning to model-free mechanisms , 2017, bioRxiv.

[61]  P. Dayan,et al.  Algorithms for survival: a comparative perspective on emotions , 2017, Nature Reviews Neuroscience.

[62]  Miriam Sebold,et al.  When Habits Are Dangerous: Alcohol Expectancies and Habitual Decision Making Predict Relapse in Alcohol Dependence , 2017, Biological Psychiatry.

[63]  Alexander L Green,et al.  The Cognitive Role of the Globus Pallidus interna; Insights from Disease States , 2017, Experimental Brain Research.

[64]  C. Pittenger,et al.  Cognitive inflexibility in Obsessive-Compulsive Disorder , 2017, Neuroscience.

[65]  N. Daw,et al.  Reinforcement Learning and Episodic Memory in Humans and Animals: An Integrative Framework , 2017, Annual review of psychology.

[66]  P. Fox,et al.  Implementation errors in the GingerALE Software: Description and recommendations , 2017, Human brain mapping.

[67]  Cyriel M A Pennartz,et al.  Model-based spatial navigation in the hippocampus-ventral striatum circuit: A computational analysis , 2018, PLoS Comput. Biol..

[68]  Joseph E LeDoux,et al.  Surviving threats: neural circuit and computational implications of a new taxonomy of defensive behaviour , 2018, Nature Reviews Neuroscience.

[69]  A. Heinz,et al.  No association of goal‐directed and habitual control with alcohol consumption in young adults , 2018, Addiction biology.

[70]  Stefan Glasauer,et al.  Neural signatures of reinforcement learning correlate with strategy adoption during spatial navigation , 2018, Scientific Reports.

[71]  Joel Z. Leibo,et al.  Prefrontal cortex as a meta-reinforcement learning system , 2018, bioRxiv.

[72]  Shakoor Pooseh,et al.  L-DOPA reduces model-free control of behavior by attenuating the transfer of value to action , 2016, NeuroImage.

[73]  Daeyeol Lee,et al.  Model-Free and Model-Based Influences in Addiction-Related Behaviors , 2019, Biological Psychiatry.

[74]  Michael R. Meager,et al.  Hippocampal Contributions to Model-Based Planning and Spatial Memory , 2019, Neuron.

[75]  Daniel Tranel,et al.  Model-based lesion mapping of cognitive control using the Wisconsin Card Sorting Test , 2019, Nature Communications.

[76]  Rongjun Yu,et al.  Fractionating adaptive learning: A meta-analysis of the reversal learning paradigm , 2019, Neuroscience & Biobehavioral Reviews.