The principles of goal-directed decision-making: from neural mechanisms to computation and robotics

The brain has evolved to act in a complex and unpredictable world, and it must continuously select among many goals and action options. In the past 20 years, research in neuroscience and robotics has principally focused on the neural underpinnings of habitual choice, linked to stimulus–response

[1]  Giovanni Pezzulo,et al.  The Mixed Instrumental Controller: Using Value of Information to Combine Habitual Choice and Mental Simulation , 2013, Front. Psychol..

[2]  Nick Chater,et al.  Virtual bargaining: a theory of social decision-making , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[3]  J. Kalaska,et al.  Neural mechanisms for interacting with a world full of action choices. , 2010, Annual review of neuroscience.

[4]  M. Botvinick,et al.  Hierarchically organized behavior and its neural foundations: A reinforcement learning perspective , 2009, Cognition.

[5]  Karl J. Friston.  The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[6]  Paul F. M. J. Verschure,et al.  A real-world rational agent: unifying old and new AI , 2003 .

[7]  Michael J. Spivey,et al.  Computational Grounded Cognition: a new alliance between grounded cognition and computational modeling , 2013, Front. Psychology.

[8]  John Lisman,et al.  Two-phase model of the basal ganglia: implications for discontinuous control of the motor system , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[9]  T. Robbins,et al.  The hippocampal–striatal axis in learning, prediction and goal-directed behavior , 2011, Trends in Neurosciences.

[10]  Paul F. M. J. Verschure,et al.  A real-world rational agent: unifying old and new AI , 2003, Cogn. Sci..

[11]  Etienne Koechlin,et al.  An evolutionary computational theory of prefrontal executive function in decision-making , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[12]  Giovanni Pezzulo,et al.  Goals reconfigure cognition by modulating predictive processes in the brain. , 2014, The Behavioral and brain sciences.

[13]  John M. Pearson,et al.  Neuroethology of decision-making , 2012, Current Opinion in Neurobiology.

[14]  A. Redish,et al.  A functional difference in information processing between orbitofrontal cortex and ventral striatum during decision-making behaviour , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[15]  Angelo Cangelosi,et al.  The Mechanics of Embodiment: A Dialog on Embodiment and Computational Modeling , 2011, Front. Psychology.

[16]  Paul F. M. J. Verschure,et al.  The why, what, where, when and how of goal-directed choice: neuronal and computational principles , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[17]  T. Robbins,et al.  Goal-directed learning and obsessive–compulsive disorder , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[18]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[19]  Amir Dezfouli,et al.  Habits as action sequences: hierarchical action control and changes in outcome value , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[20]  G. Pezzulo,et al.  Thinking as the control of imagination: a conceptual framework for goal-directed systems , 2009, Psychological research.

[21]  G. Pezzulo.  Grounding Procedural and Declarative Knowledge in Sensorimotor Anticipation , 2011 .

[22]  Mathias Osvath,et al.  The future of future-oriented cognition in non-humans: theory and the empirical case of the great apes , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[23]  George Kachergis,et al.  A continuous-time neural model for sequential action , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[24]  C. Balkenius.  Natural intelligence in artificial creatures , 1995 .

[25]  Ari Weinstein,et al.  Model-based hierarchical reinforcement learning and human action control , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[26]  Seth A. Herd,et al.  Goal-Driven Cognition in the Brain: A Computational Framework , 2014, 1404.7591.

[27]  Aldo Genovesio,et al.  The influence of recent decisions on future goal selection , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[28]  G. Aschersleben,et al.  The Theory of Event Coding (TEC): a framework for perception and action planning. , 2001, The Behavioral and brain sciences.

[29]  Paul Cisek,et al.  On the challenges and mechanisms of embodied decisions , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[30]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[31]  R. Passingham,et al.  The Neurobiology of the Prefrontal Cortex: Anatomy, Evolution, and the Origin of Insight , 2012 .

[32]  Matthijs A. A. van der Meer,et al.  Internally generated sequences in learning and executing goal-directed behavior , 2014, Trends in Cognitive Sciences.

[33]  E. Miller,et al.  Goal-direction and top-down control , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[34]  R. O’Reilly,et al.  Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain , 2000 .

[35]  J. O'Doherty,et al.  Uncovering the spatio-temporal dynamics of value-based decision-making in the human brain: a combined fMRI–EEG study , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[36]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[37]  Paul F. M. J. Verschure,et al.  Environmentally mediated synergy between perception and behaviour in mobile robots , 2003, Nature.

[38]  Raymond J. Dolan,et al.  The anatomy of choice: dopamine and decision-making , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[39]  P. Dayan,et al.  The algorithmic anatomy of model-based evaluation , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[40]  Michael Milford,et al.  Principles of goal-directed spatial robot navigation in biomimetic models , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.