The Meaning of Behavior: Discriminating Reflex and Volition in the Brain

The ability to establish behaviorally what psychological capacity an animal is deploying-to discern accurately what an animal is doing-is key to functional analyses of the brain. Our current understanding of these capacities suggests, however, that this task is complex; there is evidence that multiple capacities are engaged simultaneously and contribute independently to the control of behavior. As such, establishing the contribution of a cell, circuit, or neural system to any one function requires careful dissection of that role from its influence on other functions and, therefore, the careful selection and design of behavioral tasks fit for that purpose. Here I describe recent research that has sought to utilize behavioral tools to investigate the neural bases of instrumental conditioning, particularly the circuits and systems supporting the capacity for goal-directed action, as opposed to conditioned reflexes and habits, and how these sources of action control interact to generate adaptive behavior.

[1]  Arif Ahmed,et al.  Evidence, Decision and Causality , 2014 .

[2]  K. Berridge The debate over dopamine’s role in reward: the case for incentive salience , 2007, Psychopharmacology.

[3]  C. Gerfen,et al.  GENSAT BAC Cre-Recombinase Driver Lines to Study the Functional Organization of Cerebral Cortical and Basal Ganglia Circuits , 2013, Neuron.

[4]  Bernard W. Balleine,et al.  Aging-Related Dysfunction of Striatal Cholinergic Interneurons Produces Conflict in Action Selection , 2016, Neuron.

[5]  B. Balleine,et al.  Actions and responses: The dual psychology of behaviour. , 1993 .

[6]  Andreas Klaus,et al.  What, If, and When to Move: Basal Ganglia Circuits and Self-Paced Action Initiation. , 2019, Annual review of neuroscience.

[7]  A. Dickinson Associative learning and animal cognition , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[8]  B. Balleine,et al.  Still at the Choice‐Point , 2007, Annals of the New York Academy of Sciences.

[9]  B. Balleine,et al.  Learning and Motivational Processes Contributing to Pavlovian-Instrumental Transfer and Their Neural Bases: Dopamine and Beyond. , 2016, Current topics in behavioral neurosciences.

[10]  S. Killcross,et al.  Functional heterogeneity within the rodent lateral orbitofrontal cortex dissociates outcome devaluation and reversal learning deficits , 2018, eLife.

[11]  A. Dickinson,et al.  Omission Learning after Instrumental Pretraining , 1998 .

[12]  K. Amunts,et al.  How to Characterize the Function of a Brain Region , 2018, Trends in Cognitive Sciences.

[13]  Kyle S. Smith,et al.  A dual operator view of habitual behavior reflecting cortical and striatal dynamics. , 2013, Neuron.

[14]  P. Phillips,et al.  Pavlovian valuation systems in learning and decision making , 2012, Current Opinion in Neurobiology.

[15]  Y. Loewenstein,et al.  Striatal action-value neurons reconsidered , 2017, bioRxiv.

[16]  A. Grace,et al.  Cortico-Basal Ganglia Reward Network: Microcircuitry , 2010, Neuropsychopharmacology.

[17]  D. Wolpert,et al.  Computations underlying sensorimotor learning , 2016, Current Opinion in Neurobiology.

[18]  D. Surmeier,et al.  Cholinergic Interneurons Amplify Thalamostriatal Excitation of Striatal Indirect Pathway Neurons in Parkinson’s Disease Models , 2019, Neuron.

[19]  T. Robinson,et al.  A selective role for dopamine in reward learning , 2010, Nature.

[20]  L. Jacoby A process dissociation framework: Separating automatic from intentional uses of memory , 1991 .

[21]  L. J. Hammond The effect of contingency upon the appetitive conditioning of free-operant behavior. , 1980, Journal of the experimental analysis of behavior.

[22]  B. Balleine,et al.  δ-Opioid and Dopaminergic Processes in Accumbens Shell Modulate the Cholinergic Control of Predictive Learning and Choice , 2014, The Journal of Neuroscience.

[23]  A. Berényi,et al.  Coding of self-motion-induced and self-independent visual motion in the rat dorsomedial striatum , 2018, PLoS biology.

[24]  Huanmian Chen,et al.  Recurrent Inhibitory Network among Striatal Cholinergic Interneurons , 2008, The Journal of Neuroscience.

[25]  B. Balleine,et al.  Inactivation of dorsolateral striatum enhances sensitivity to changes in the action–outcome contingency in instrumental conditioning , 2006, Behavioural Brain Research.

[26]  Y. Smith,et al.  Cholinergic interneurons in the dorsal and ventral striatum: anatomical and functional considerations in normal and diseased conditions , 2015, Annals of the New York Academy of Sciences.

[27]  L. Wilbrecht,et al.  Transient stimulation of distinct subpopulations of striatal neurons mimics changes in action value , 2012, Nature Neuroscience.

[28]  JaneR . Taylor,et al.  Infralimbic prefrontal cortex interacts with nucleus accumbens shell to unmask expression of outcome-selective Pavlovian-to-instrumental transfer , 2015, Learning & memory.

[29]  B. Balleine,et al.  Ventral Pallidal Projections to Mediodorsal Thalamus and Ventral Tegmental Area Play Distinct Roles in Outcome-Specific Pavlovian-Instrumental Transfer , 2015, The Journal of Neuroscience.

[30]  R. Naik Ramesh,et al.  Homeostatic circuits selectively gate food cue responses in insular cortex , 2017, Nature.

[31]  Arif A. Hamid,et al.  Dissociable dopamine dynamics for learning and motivation. , 2019, Nature.

[32]  R. Rescorla,et al.  Associative Structures In Instrumental Learning , 1986 .

[33]  M. Fuccillo,et al.  Striatal Low-Threshold Spiking Interneurons Regulate Goal-Directed Learning , 2019, Neuron.

[34]  R. Douglas,et al.  Neuronal circuits of the neocortex. , 2004, Annual review of neuroscience.

[35]  Kyle S. Smith,et al.  An omission procedure reorganizes the microstructure of sign-tracking while preserving incentive salience , 2016, Learning & memory.

[36]  Y. Xuan,et al.  A whole-brain atlas of monosynaptic input targeting four different cell types in the medial prefrontal cortex of the mouse , 2019, Nature Neuroscience.

[37]  T. McNeill,et al.  Unilateral skill acquisition induces bilateral NMDA receptor subunit composition shifts in the rat sensorimotor striatum , 2013, Brain Research.

[38]  B. Balleine,et al.  At the limbic–motor interface: disconnection of basolateral amygdala from nucleus accumbens core and shell reveals dissociable components of incentive motivation , 2010, The European journal of neuroscience.

[39]  B. Balleine,et al.  Plasticity in striatopallidal projection neurons mediates the acquisition of habitual actions , 2015, The European journal of neuroscience.

[40]  B. Balleine,et al.  Learning-Related Translocation of δ-Opioid Receptors on Ventral Striatal Cholinergic Interneurons Mediates Choice between Goal-Directed Actions , 2013, The Journal of Neuroscience.

[41]  D. S. Zahm,et al.  Functional‐anatomical Implications of the Nucleus Accumbens Core and Shell Subterritories , 1999, Annals of the New York Academy of Sciences.

[42]  T. Robbins,et al.  Drug Addiction: Updating Actions to Habits to Compulsions Ten Years On. , 2016, Annual review of psychology.

[43]  B. Balleine,et al.  Parallel incentive processing: an integrated view of amygdala function , 2006, Trends in Neurosciences.

[44]  B. Balleine,et al.  Blockade of NMDA receptors in the dorsomedial striatum prevents action–outcome learning in instrumental conditioning , 2005, The European journal of neuroscience.

[45]  R. Costa,et al.  Endocannabinoid Signaling is Critical for Habit Formation , 2007, Frontiers in integrative neuroscience.

[46]  D. Plenz,et al.  Inverted-U Profile of Dopamine–NMDA-Mediated Spontaneous Avalanche Recurrence in Superficial Layers of Rat Prefrontal Cortex , 2006, The Journal of Neuroscience.

[47]  Laura A. Bradfield,et al.  The Thalamostriatal Pathway and Cholinergic Control of Goal-Directed Action: Interlacing New with Existing Learning in the Striatum , 2013, Neuron.

[48]  G. Shepherd,et al.  The neocortical circuit: themes and variations , 2015, Nature Neuroscience.

[49]  B. Balleine The Motivation of Action and the Origins of Reward , 2018 .

[50]  B. Balleine,et al.  Appetitive Pavlovian-instrumental Transfer: A review , 2016, Neuroscience & Biobehavioral Reviews.

[51]  Anatol C. Kreitzer,et al.  Distinct roles for direct and indirect pathway striatal neurons in reinforcement , 2012, Nature Neuroscience.

[52]  Shauna L. Parkes,et al.  Interaction of Insular Cortex and Ventral Striatum Mediates the Effect of Incentive Memory on Choice Between Goal-Directed Actions , 2015, Journal of Neuroscience.

[53]  Paul Leonard Gabbott,et al.  Prefrontal cortex in the rat: Projections to subcortical autonomic, motor, and limbic centers , 2005, The Journal of comparative neurology.

[54]  Ilana B. Witten,et al.  Reward prediction error does not explain movement selectivity in DMS-projecting dopamine neurons , 2018, bioRxiv.

[55]  B. Balleine,et al.  The Role of the Nucleus Accumbens in Instrumental Conditioning: Evidence of a Functional Dissociation between Accumbens Core and Shell , 2001, The Journal of Neuroscience.

[56]  S. Killcross,et al.  Coordination of actions and habits in the medial prefrontal cortex of rats. , 2003, Cerebral cortex.

[57]  Earl K. Miller,et al.  Working Memory 2.0 , 2018, Neuron.

[58]  David M. Lovinger,et al.  Parallel, but Dissociable, Processing in Discrete Corticostriatal Inputs Encodes Skill Learning , 2017, Neuron.

[59]  A. Bonci,et al.  Bidirectional Modulation of Intrinsic Excitability in Rat Prelimbic Cortex Neuronal Ensembles and Non-Ensembles after Operant Learning , 2017, The Journal of Neuroscience.

[60]  M. Walton,et al.  Re‐evaluating the role of the orbitofrontal cortex in reward and reinforcement , 2012, The European journal of neuroscience.

[61]  B. Balleine,et al.  The Role of the Dorsal Striatum in Reward and Decision-Making , 2007, The Journal of Neuroscience.

[62]  E. J. Capaldi,et al.  A review of contemporary ideomotor theory. , 2010, Psychological bulletin.

[63]  B. Balleine,et al.  Habits, action sequences and reinforcement learning , 2012, The European journal of neuroscience.

[64]  A. Graybiel Habits, rituals, and the evaluative brain. , 2008, Annual review of neuroscience.

[65]  B. Balleine,et al.  Human and Rodent Homologies in Action Control: Corticostriatal Determinants of Goal-Directed and Habitual Action , 2010, Neuropsychopharmacology.

[66]  Paul G Anastasiades,et al.  Reciprocal Circuits Linking the Prefrontal Cortex with Dorsal and Ventral Thalamic Nuclei , 2018, Neuron.

[67]  P. Haggard Human volition: towards a neuroscience of will , 2008, Nature Reviews Neuroscience.

[68]  M. Vandecasteele,et al.  Region-specific and state-dependent action of striatal GABAergic interneurons , 2018, Nature Communications.

[69]  A. Delamater,et al.  Exploring the relationship between actions, habits, and automaticity in an action sequence task , 2019, Learning & memory.

[70]  B. Balleine,et al.  Orbitofrontal Cortex Mediates Outcome Encoding in Pavlovian But Not Instrumental Conditioning , 2007, The Journal of Neuroscience.

[71]  Colin Camerer,et al.  A framework for studying the neurobiology of value-based decision making , 2008, Nature Reviews Neuroscience.

[72]  B. Balleine,et al.  The role of the dorsomedial striatum in instrumental conditioning , 2005, The European journal of neuroscience.

[73]  P. Holland,et al.  Differential effects of omission contingencies on various components of Pavlovian appetitive conditioned responding in rats. , 1979, Journal of experimental psychology. Animal behavior processes.

[74]  R. Rescorla,et al.  Postconditioning devaluation of a reinforcer affects instrumental responding. , 1985 .

[75]  K. Tsutsui,et al.  Comparative Overview of Visuospatial Working Memory in Monkeys and Rats , 2016, Front. Syst. Neurosci..

[76]  Matthew R Bailey,et al.  Decreasing Striatopallidal Pathway Function Enhances Motivation by Energizing the Initiation of Goal-Directed Action , 2016, The Journal of Neuroscience.

[77]  Laura A. Bradfield,et al.  Inferring action-dependent outcome representations depends on anterior but not posterior medial orbitofrontal cortex , 2018, Neurobiology of Learning and Memory.

[78]  B. Balleine,et al.  Substance P and dopamine interact to modulate the distribution of delta‐opioid receptors on cholinergic interneurons in the striatum , 2018, The European journal of neuroscience.

[79]  Benjamin T. Saunders,et al.  Dopamine neurons create Pavlovian conditioned stimuli with circuit-defined motivational properties , 2018, Nature Neuroscience.

[80]  A. Zador,et al.  Selective corticostriatal plasticity during acquisition of an auditory discrimination task , 2014, Nature.

[81]  B. Balleine,et al.  Differential Involvement of the Basolateral Amygdala and Mediodorsal Thalamus in Instrumental Action Selection , 2008, The Journal of Neuroscience.

[82]  Christopher D. Adams,et al.  Instrumental Responding following Reinforcer Devaluation , 1981 .

[83]  E. Bracci,et al.  Mutual Control of Cholinergic and Low-Threshold Spike Interneurons in the Striatum , 2016, Front. Cell. Neurosci..

[84]  A. Dickinson,et al.  Contingency Effects with Maintained Instrumental Reinforcement , 1985 .

[85]  Bernard W Balleine,et al.  Thalamic Control of Dorsomedial Striatum Regulates Internal State to Guide Goal-Directed Action Selection , 2017, The Journal of Neuroscience.

[86]  Jung Hoon Sul,et al.  Role of Striatum in Updating Values of Chosen Actions , 2009, The Journal of Neuroscience.

[87]  Bernard W. Balleine,et al.  The Bilateral Prefronto-striatal Pathway Is Necessary for Learning New Goal-Directed Actions , 2018, Current Biology.

[88]  David M. Huberdeau,et al.  Dual-process decomposition in human sensorimotor adaptation , 2015, Current Opinion in Neurobiology.

[89]  Sara E. Morrison,et al.  Sign Tracking, but Not Goal Tracking, is Resistant to Outcome Devaluation , 2015, Front. Neurosci..

[90]  B. Balleine,et al.  Disruption of endogenous opioid activity during instrumental learning enhances habit acquisition , 2009, Neuroscience.

[91]  Wolfgang M. Pauli,et al.  Learning, Reward, and Decision Making , 2017, Annual review of psychology.

[92]  JaneR . Taylor,et al.  Going and stopping: dichotomies in behavioral control by the prefrontal cortex , 2016, Nature Neuroscience.

[93]  A. Haith,et al.  Skill Acquisition and Habit Formation as Distinct Effects of Practice , 2017 .

[94]  Joseph J. Paton,et al.  Big behavioral data: psychology, ethology and the foundations of neuroscience , 2014, Nature Neuroscience.

[95]  B. Balleine,et al.  Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning , 2004, The European journal of neuroscience.

[96]  M. A. MacIver,et al.  Neuroscience Needs Behavior: Correcting a Reductionist Bias , 2017, Neuron.

[97]  Ian R. Wickersham,et al.  Dichotomous parvalbumin interneuron populations in dorsolateral and dorsomedial striatum , 2018, The Journal of physiology.

[98]  Bernard W. Balleine,et al.  Contributions of ERK signaling in the striatum to instrumental learning and performance , 2011, Behavioural Brain Research.

[99]  B. Balleine,et al.  Reward‐guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico‐basal ganglia networks , 2008, The European journal of neuroscience.

[100]  G. Davey,et al.  Autoshaping in the rat: Effects of omission on the form of the response. , 1981, Journal of the experimental analysis of behavior.

[101]  N. Heintz,et al.  Cell-Type-Specific Contributions of Medial Prefrontal Neurons to Flexible Behaviors , 2018, The Journal of Neuroscience.

[102]  Laura A. Bradfield,et al.  Prefrontal Corticostriatal Disconnection Blocks the Acquisition of Goal-Directed Action , 2018, The Journal of Neuroscience.

[103]  Laura A. Bradfield,et al.  Medial Orbitofrontal Cortex Mediates Outcome Retrieval in Partially Observable Task Situations , 2015, Neuron.

[104]  A. Haith,et al.  Time-dependent competition between habitual and goal-directed response preparation , 2018 .

[105]  E. Tolman Purposive behavior in animals and men , 1932 .

[106]  B. Balleine,et al.  Annals of the New York Academy of Sciences the Orbitofrontal Cortex, Predicted Value, and Choice , 2022 .

[107]  Robert A. Rescorla,et al.  Effect of reinforcer devaluation on discriminative control of instrumental behavior. , 1990, Journal of experimental psychology. Animal behavior processes.

[108]  Richard G. Brown,et al.  Negative symptoms: the ‘pathology’ of motivation and goal-directed behaviour , 2000, Trends in Neurosciences.

[109]  A. Faure,et al.  Lesion to the Nigrostriatal Dopamine System Disrupts Stimulus-Response Habit Formation , 2005, The Journal of Neuroscience.

[110]  E. Koechlin,et al.  The Architecture of Cognitive Control in the Human Prefrontal Cortex , 2003, Science.

[111]  Andrew T. Marshall,et al.  Mesolimbic dopamine projections mediate cue-motivated reward seeking but not reward retrieval in rats , 2018, eLife.

[112]  Laura A. Bradfield,et al.  Hierarchical and binary associations compete for behavioral control during instrumental biconditional discrimination. , 2013, Journal of experimental psychology. Animal behavior processes.

[113]  B. Balleine,et al.  From learning to action: the integration of dorsal striatal input and output pathways in instrumental conditioning , 2018, The European journal of neuroscience.

[115]  Ashesh K Dhawale,et al.  Motor Cortex Is Required for Learning but Not for Executing a Motor Skill , 2015, Neuron.

[116]  Christopher D. Adams Variations in the Sensitivity of Instrumental Responding to Reinforcer Devaluation , 1982 .

[117]  D James Surmeier,et al.  Recurrent Collateral Connections of Striatal Medium Spiny Neurons Are Disrupted in Models of Parkinson's Disease , 2008, The Journal of Neuroscience.

[118]  R. Costa,et al.  Dopamine systems adaptation during acquisition and consolidation of a skill , 2014, Front. Integr. Neurosci..

[119]  Justin K. O’Hare,et al.  Pathway-Specific Striatal Substrates for Habitual Behavior , 2016, Neuron.

[120]  A. Mcgeorge,et al.  The organization of the projection from the cerebral cortex to the striatum in the rat , 1989, Neuroscience.

[121]  Shauna L. Parkes,et al.  Insular and Ventrolateral Orbitofrontal Cortices Differentially Contribute to Goal-Directed Behavior in Rodents , 2018, Cerebral cortex.

[122]  Etienne Coutureau,et al.  A Role for Medial Prefrontal Dopaminergic Innervation in Instrumental Conditioning , 2009, The Journal of Neuroscience.

[123]  D. Lovinger,et al.  Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill , 2009, Nature Neuroscience.

[124]  Richard P. Cooper,et al.  Beyond Single-Level Accounts: The Role of Cognitive Architectures in Cognitive Scientific Explanation , 2015, Top. Cogn. Sci..

[125]  Steven S. Vogel,et al.  Concurrent Activation of Striatal Direct and Indirect Pathways During Action Initiation , 2013, Nature.

[126]  C. Cepeda,et al.  Basolateral Amygdala to Orbitofrontal Cortex Projections Enable Cue-Triggered Reward Expectations , 2017, The Journal of Neuroscience.

[127]  Bernard W Balleine,et al.  The Acquisition of Goal-Directed Actions Generates Opposing Plasticity in Direct and Indirect Pathways in Dorsomedial Striatum , 2014, The Journal of Neuroscience.

[128]  J. Wickens,et al.  A silent eligibility trace enables dopamine‐dependent synaptic plasticity for reinforcement learning in the mouse striatum , 2018, The European journal of neuroscience.

[129]  G. Shepherd Corticostriatal connectivity and its role in disease , 2013, Nature Reviews Neuroscience.

[130]  B. Everitt,et al.  Limbic cortical-ventral striatal systems underlying appetitive conditioning. , 2000, Progress in brain research.

[131]  M. Bouton,et al.  Contextual control of instrumental actions and habits. , 2015, Journal of experimental psychology. Animal learning and cognition.

[132]  C. Gerfen,et al.  Modulation of striatal projection systems by dopamine. , 2011, Annual review of neuroscience.

[133]  J. Searle Intentionality: An Essay in the Philosophy of Mind , 1983 .

[134]  J. Maze The Meaning of Behaviour , 2019 .

[135]  B. Balleine,et al.  Consolidation of Goal-Directed Action Depends on MAPK/ERK Signaling in Rodent Prelimbic Cortex , 2016, The Journal of Neuroscience.

[136]  J. Wickens,et al.  A cellular mechanism of reward-related learning , 2001, Nature.

[137]  Ilana B. Witten,et al.  Reward and choice encoding in terminals of midbrain dopamine neurons depends on striatal target , 2016, Nature Neuroscience.

[138]  B. Balleine Neural bases of food-seeking: Affect, arousal and reward in corticostriatolimbic circuits , 2005, Physiology & Behavior.

[139]  G. Schoenbaum,et al.  Cholinergic Interneurons Use Orbitofrontal Input to Track Beliefs about Current State , 2016, The Journal of Neuroscience.

[140]  P. Holland Conditioned stimulus as a determinant of the form of the Pavlovian conditioned response. , 1977, Journal of experimental psychology. Animal behavior processes.

[141]  B. Balleine,et al.  Differential dependence of Pavlovian incentive motivation and instrumental incentive learning processes on dopamine signaling. , 2011, Learning & memory.

[142]  Wendy Wood,et al.  Psychology of Habit. , 2016, Annual review of psychology.

[143]  B. Balleine,et al.  Amygdala Central Nucleus Interacts with Dorsolateral Striatum to Regulate the Acquisition of Habits , 2012, The Journal of Neuroscience.

[144]  L. Paninski,et al.  The Spatiotemporal Organization of the Striatum Encodes Action Space , 2017, Neuron.

[145]  Howard Eichenbaum,et al.  Orbitofrontal Cortex Encodes Memories within Value-Based Schemas and Represents Contexts That Guide Memory Retrieval , 2015, The Journal of Neuroscience.

[146]  Daniel K. Leventhal,et al.  Arkypallidal Cells Send a Stop Signal to Striatum , 2016, Neuron.

[147]  B. Balleine,et al.  The integrative function of the basal ganglia in instrumental conditioning , 2009, Behavioural Brain Research.

[148]  D. James Surmeier,et al.  Thalamic Gating of Corticostriatal Signaling by Cholinergic Interneurons , 2010, Neuron.

[149]  Vikaas S Sohal,et al.  Tonic or Phasic Stimulation of Dopaminergic Projections to Prefrontal Cortex Causes Mice to Maintain or Deviate from Previously Learned Behavioral Strategies , 2017, The Journal of Neuroscience.

[150]  Masahiko Watanabe,et al.  Monitoring and Updating of Action Selection for Goal-Directed Behavior through the Striatal Direct and Indirect Pathways , 2018, Neuron.

[151]  Joseph E LeDoux,et al.  A higher-order theory of emotional consciousness , 2017, Proceedings of the National Academy of Sciences.

[152]  D. Bindra A motivational view of learning, performance, and behavior modification. , 1974, Psychological review.

[153]  William W. Taylor,et al.  Dorsolateral Striatum Engagement Interferes with Early Discrimination Learning , 2018, Cell reports.

[154]  J. Wickens,et al.  Dopamine reverses the depression of rat corticostriatal synapses which normally follows high-frequency stimulation of cortex In vitro , 1996, Neuroscience.

[155]  L. Brown,et al.  Organizing principles of cortical integration in the rat neostriatum: Corticostriate map of the body surface is an ordered lattice of curved laminae and radial points , 1998, The Journal of comparative neurology.

[156]  B. Balleine,et al.  Lesions of Medial Prefrontal Cortex Disrupt the Acquisition But Not the Expression of Goal-Directed Learning , 2005, The Journal of Neuroscience.

[157]  Tianyi Mao,et al.  A comprehensive excitatory input map of the striatum reveals novel functional organization , 2016, eLife.

[158]  A. Dickinson,et al.  Reinforcer specificity of the suppression of instrumental performance on a non-contingent schedule , 1989, Behavioural Processes.

[159]  G. Davey,et al.  Food anticipation and lever-directed activities in rats , 1984 .

[160]  B. Balleine,et al.  Goal-directed instrumental action: contingency and incentive learning and their cortical substrates , 1998, Neuropharmacology.

[161]  A. Juavinett,et al.  Specialized Subpopulations of Deep-Layer Pyramidal Neurons in the Neocortex: Bridging Cellular Properties to Functional Consequences , 2018, The Journal of Neuroscience.

[162]  Silvia Arber,et al.  Motor Circuits in Action: Specification, Connectivity, and Function , 2012, Neuron.

[163]  J. D. A. M. E. Bitierman OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR DIFFERENTIAL REINFORCEMENT OF OTHER BEHAVIOR ( DRO ) : A YOKED-CONTROL COMPARISON ' , 2005 .

[164]  Glenn D. R. Watson,et al.  Sensory Processing in the Dorsolateral Striatum: The Contribution of Thalamostriatal Pathways , 2017, Front. Syst. Neurosci..

[165]  Shauna L. Parkes,et al.  Incentive Memory: Evidence the Basolateral Amygdala Encodes and the Insular Cortex Retrieves Outcome Values to Guide Choice between Goal-Directed Actions , 2013, The Journal of Neuroscience.

[166]  P. Dayan,et al.  Goals and Habits in the Brain , 2013, Neuron.

[167]  R. Costa,et al.  Orbitofrontal and striatal circuits dynamically encode the shift between goal-directed and habitual actions , 2013, Nature Communications.

[168]  Hong-wei Dong,et al.  Are the Dorsal and Ventral Hippocampus Functionally Distinct Structures? , 2010, Neuron.

[169]  G. La Camera,et al.  Processing of Hedonic and Chemosensory Features of Taste in Medial Prefrontal and Insular Networks , 2013, The Journal of Neuroscience.

[170]  B. Balleine,et al.  Dorsal and ventral streams: The distinct role of striatal subregions in the acquisition and performance of goal-directed actions , 2014, Neurobiology of Learning and Memory.

[171]  S. Eickhoff,et al.  On the functional anatomy of the urge-for-action , 2011, Cognitive neuroscience.