Neural Mechanisms of Hierarchical Planning in a Virtual Subway Network

[1]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[2]  Samuel J. Gershman,et al.  Computational rationality: A converging paradigm for intelligence in brains, minds, and machines , 2015, Science.

[3]  Peter Dayan,et al.  Interplay of approximate planning strategies , 2015, Proceedings of the National Academy of Sciences.

[4]  C. Summerfield,et al.  Neural mechanisms of economic commitment in the human medial prefrontal cortex , 2014, eLife.

[5]  Alec Solway,et al.  Optimal Behavioral Hierarchy , 2014, PLoS Comput. Biol..

[6]  R. Knight,et al.  The Hippocampus and Entorhinal Cortex Encode the Path and Euclidean Distances to Goals during Navigation , 2014, Current Biology.

[7]  P. Dayan,et al.  Goals and Habits in the Brain , 2013, Neuron.

[8]  Jonathan D. Cohen,et al.  The Expected Value of Control: An Integrative Theory of Anterior Cingulate Cortex Function , 2013, Neuron.

[9]  M. Botvinick,et al.  Neural representations of events arise from temporal community structure , 2013, Nature Neuroscience.

[10]  R. N. Spreng,et al.  The Future of Memory: Remembering, Imagining, and the Brain , 2012, Neuron.

[11]  Timothy E. J. Behrens,et al.  Neural Mechanisms of Foraging , 2012, Science.

[12]  Peter Dayan,et al.  Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees , 2012, PLoS Comput. Biol..

[13]  P. Dayan,et al.  Mapping value based planning and extensively trained choice in the human brain , 2012, Nature Neuroscience.

[14]  Clay B. Holroyd,et al.  Motivation of extended behaviors by anterior cingulate cortex , 2012, Trends in Cognitive Sciences.

[15]  Joseph T. McGuire,et al.  A Neural Signature of Hierarchical Reinforcement Learning , 2011, Neuron.

[16]  John M. Pearson,et al.  Neuronal basis of sequential foraging decisions in a patchy environment , 2011, Nature Neuroscience.

[17]  Christian F. Doeller,et al.  Anterior Hippocampus and Goal-Directed Spatial Decision Making , 2011, The Journal of Neuroscience.

[18]  P. Dayan,et al.  Model-based influences on humans’ choices and striatal prediction errors , 2011, Neuron.

[19]  P. Dayan,et al.  States versus Rewards: Dissociable Neural Prediction Error Signals Underlying Model-Based and Model-Free Reinforcement Learning , 2010, Neuron.

[20]  M. D’Esposito,et al.  Frontal Cortex and the Discovery of Abstract Action Rules , 2010, Neuron.

[21]  M. Botvinick,et al.  Hierarchically organized behavior and its neural foundations: A reinforcement learning perspective , 2009, Cognition.

[22]  M. Roesch,et al.  A new perspective on the role of the orbitofrontal cortex in adaptive behaviour , 2009, Nature Reviews Neuroscience.

[23]  Matthew E. Taylor,et al.  Abstraction and Generalization in Reinforcement Learning: A Summary and Framework , 2009, ALA.

[24]  C. Summerfield,et al.  An information theoretical approach to prefrontal executive function , 2007, Trends in Cognitive Sciences.

[25]  D. Schacter,et al.  The cognitive neuroscience of constructive memory: remembering the past and imagining the future , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[26]  J. Reichenbach,et al.  The special involvement of the rostrolateral prefrontal cortex in planning abilities: An event-related fMRI study with the Tower of London paradigm , 2006, Neuropsychologia.

[27]  E. Koechlin,et al.  Broca's Area and the Hierarchical Organization of Human Behavior , 2006, Neuron.

[28]  A. Owen,et al.  Planning and problem solving: From neuropsychology to functional neuroimaging , 2006, Journal of Physiology-Paris.

[29]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[30]  Hanspeter A. Mallot,et al.  'Fine-to-Coarse' Route Planning and Navigation in Regionalized Environments , 2003, Spatial Cogn. Comput..

[31]  E. Koechlin,et al.  The Architecture of Cognitive Control in the Human Prefrontal Cortex , 2003, Science.

[32]  Frederik Barkhof,et al.  Frontostriatal system in planning complexity: a parametric functional magnetic resonance version of tower of london task , 2003, NeuroImage.

[33]  Thomas E. Nichols,et al.  Thresholding of Statistical Maps in Functional Neuroimaging Using the False Discovery Rate , 2002, NeuroImage.

[34]  Jonathan D. Cohen,et al.  Conflict monitoring versus selection-for-action in anterior cingulate cortex , 1999, Nature.

[35]  Andrew G. Barto,et al.  Reinforcement learning , 1998 .

[36]  S. Zeki,et al.  Three cortical stages of colour processing in the human brain. , 1998, Brain : a journal of neurology.

[37]  J. Feigenbaum,et al.  The effect of goal-subgoal conflict on planning ability after frontal- and temporal-lobe lesions in humans , 1997, Neuropsychologia.

[38]  G. Ward,et al.  Planning and Problem solving Using the Five disc Tower of London Task , 1997 .

[39]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[40]  Richard S. Sutton,et al.  Reinforcement Learning , 1992, Handbook of Machine Learning.

[41]  T. Shallice,et al.  Deficits in strategy application following frontal lobe damage in man. , 1991, Brain : a journal of neurology.

[42]  T. Robbins,et al.  Planning and spatial working memory following frontal lobe lesions in man , 1990, Neuropsychologia.

[43]  N. Newcombe,et al.  Barrier effects in the cognitive maps of children and adults. , 1982, Journal of experimental child psychology.

[44]  T. Shallice.  Specific impairments of planning. , 1982, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[45]  Albert C. Stevens,et al.  Distortions in judged spatial relations , 1978, Cognitive Psychology.

[46]  G. Miller,et al.  Plans and the structure of behavior , 1960 .

[47]  E. Tolman.  Cognitive maps in rats and men. , 1948, Psychological review.

[48]  Andrea Bergmann,et al.  Statistical Parametric Mapping The Analysis Of Functional Brain Images , 2016 .

[49]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[50]  Donald A. Norman,et al.  Attention to Action , 1986 .

[51]  D. Norman,et al.  Attention to action: Willed and automatic control , 1980 .