Systems Neuroscience

The current paper briefly outlines the historical development of the concept of habit learning and discusses its relationship to the basal ganglia. Habit learning has been studied in many different fields of neuroscience using different species, tasks, and methodologies, and as a result it has taken on a wide range of definitions from these various perspectives. We identify five common but not universal, definitional features of habit learning: that it is inflexible, slow or incremental, unconscious, automatic, and insensitive to reinforcer devaluation. We critically evaluate for each of these how it has been defined, its utility for research in both humans and non-human animals, and the evidence that it serves as an accurate description of basal ganglia function. In conclusion, we propose a multi-faceted approach to habit learning and its relationship to the basal ganglia, emphasizing the need for formal definitions that will provide directions for future research.

[1]  D. Spalding The Principles of Psychology , 1873, Nature.

[2]  C. L. Hull The concept of the habit-family hierarchy, and maze learning. Part I. , 1934 .

[3]  A. Reber Implicit learning of artificial grammars , 1967 .

[4]  Terry Winograd,et al.  Understanding natural language , 1974 .

[5]  R. Hirsh The hippocampus and contextual retrieval of information from memory: a theory. , 1974, Behavioral biology.

[6]  A. Baddeley,et al.  What can amnesic patients learn? , 1976, Neuropsychologia.

[7]  R. F. Thompson,et al.  The search for the engram. , 1976, The American psychologist.

[8]  R. Shiffrin,et al.  Controlled and automatic human information processing: I , 1977 .

[9]  Walter Schneider,et al.  Controlled and Automatic Human Information Processing: 1. Detection, Search, and Attention. , 1977 .

[10]  L. Squire,et al.  Preserved learning and retention of pattern-analyzing skill in amnesia: dissociation of knowing how and knowing that. , 1980, Science.

[11]  T. Shallice Specific impairments of planning. , 1982, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[12]  John R. Anderson Acquisition of cognitive skill. , 1982 .

[13]  D. Schacter,et al.  Implicit and explicit memory for new associations in normal and amnesic subjects. , 1985, Journal of experimental psychology. Learning, memory, and cognition.

[14]  A. Dickinson Actions and habits: the development of behavioural autonomy , 1985 .

[15]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.

[16]  M. Nissen,et al.  Attentional requirements of learning: Evidence from performance measures , 1987, Cognitive Psychology.

[17]  D. Schacter Implicit memory: History and current status. , 1987 .

[18]  L. Squire,et al.  Memory: brain systems and behavior , 1988, Trends in Neurosciences.

[19]  L. Jacoby A process dissociation framework: Separating automatic from intentional uses of memory , 1991 .

[20]  J D Gabrieli,et al.  Evidence for a dissociation between perceptual and conceptual priming in Alzheimer's disease. , 1991, Behavioral neuroscience.

[21]  L. Squire,et al.  The medial temporal lobe memory system , 1991, Science.

[22]  Seth J. Ramus,et al.  Intact Artificial Grammar Learning in Amnesia: Dissociation of Classification Learning and Explicit Memory for Specific Instances , 1992 .

[23]  L. Squire,et al.  The learning of categories: parallel brain systems for item memory and category knowledge. , 1993, Science.

[24]  Carol A. Seger,et al.  Implicit Learning , 2019 .

[25]  Suzanne Corkin,et al.  Acquisition of motor skill after bilateral medial temporal-lobe excision , 1996 .

[26]  Gregory Ashby,et al.  A neuropsychological theory of multiple systems in category learning. , 1998, Psychological review.

[27]  K. Nakano,et al.  Neural circuits and functional organization of the striatum , 2000, Journal of Neurology.

[28]  R. Poldrack,et al.  Characterizing the neural mechanisms of skill learning and repetition priming: evidence from mirror reading. , 2001, Brain : a journal of neurology.

[29]  W. Schultz Getting Formal with Dopamine and Reward , 2002, Neuron.

[30]  Michael J. Frank,et al.  Transitivity, flexibility, conjunctive representations, and the hippocampus. II. A computational analysis , 2003, Hippocampus.

[31]  M. Gluck,et al.  Dissociating Hippocampal versus Basal Ganglia Contributions to Learning and Transfer , 2003, Journal of Cognitive Neuroscience.

[32]  C. Stern,et al.  An fMRI Study of the Role of the Medial Temporal Lobe in Implicit and Explicit Sequence Learning , 2003, Neuron.

[33]  S. Wise,et al.  Comparison of learning‐related neuronal activity in the dorsal premotor cortex and striatum , 2004, The European journal of neuroscience.

[34]  Ira Driscoll,et al.  Damage to the hippocampal formation does not disrupt representational flexibility as measured by a novelty transfer test. , 2004, Behavioral neuroscience.

[35]  Sabrina M. Tom,et al.  The Neural Correlates of Motor Skill Automaticity , 2005, The Journal of Neuroscience.

[36]  E. Miller,et al.  Different time courses of learning-related activity in the prefrontal cortex and striatum , 2005, Nature.

[37]  Carol A. Seger,et al.  The Roles of the Caudate Nucleus in Human Classification Learning , 2005, The Journal of Neuroscience.

[38]  Axel Cleeremans,et al.  The neural correlates of implicit and explicit sequence learning: Interacting networks revealed by the process dissociation procedure. , 2005, Learning & memory.

[39]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[40]  Michael J. Frank,et al.  Dynamic Dopamine Modulation in the Basal Ganglia: A Neurocomputational Account of Cognitive Deficits in Medicated and Nonmedicated Parkinsonism , 2005, Journal of Cognitive Neuroscience.

[41]  M. Kawato,et al.  Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus-action-reward association learning. , 2006, Journal of neurophysiology.

[42]  W. T. Maddox,et al.  Dual-task interference in perceptual category learning , 2006, Memory & cognition.

[43]  Ziv M. Williams,et al.  Selective enhancement of associative learning by microstimulation of the anterior caudate , 2006, Nature Neuroscience.

[44]  H. Yin,et al.  The role of the basal ganglia in habit formation , 2006, Nature Reviews Neuroscience.

[45]  Howard Eichenbaum,et al.  Essential Role of the Hippocampal Formation in Rapid Learning of Higher-Order Sequential Associations , 2006, The Journal of Neuroscience.

[46]  M. Gluck,et al.  l-dopa impairs learning, but spares generalization, in Parkinson's disease , 2006, Neuropsychologia.

[47]  Russell A Poldrack,et al.  Modulation of competing memory systems by distraction. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[48]  Ivan Toni,et al.  Cerebral Changes during Performance of Overlearned Arbitrary Visuomotor Associations , 2006, The Journal of Neuroscience.

[49]  Carol A. Seger,et al.  Dynamics of frontal, striatal, and hippocampal systems during rule learning. , 2005, Cerebral cortex.

[50]  F. Gregory Ashby,et al.  THE ROLE OF THE BASAL GANGLIA IN CATEGORY LEARNING , 2006 .

[51]  William L. Gross,et al.  Hippocampal differentiation without recognition: an fMRI analysis of the contextual cueing task. , 2007, Learning & memory.

[52]  John M. Ennis,et al.  A neurobiological theory of automaticity in perceptual categorization. , 2007, Psychological review.

[53]  Vivian V. Valentin,et al.  Determining the Neural Substrates of Goal-Directed Learning in the Human Brain , 2007, The Journal of Neuroscience.

[54]  D. Linden,et al.  The Working Memory Networks of the Human Brain , 2007, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[55]  M. Gluck,et al.  Basal ganglia and dopamine contributions to probabilistic category learning , 2008, Neuroscience & Biobehavioral Reviews.

[56]  Axel Cleeremans,et al.  Measuring consciousness: relating behavioural and neurophysiological approaches , 2008, Trends in Cognitive Sciences.

[57]  A. Graybiel Habits, rituals, and the evaluative brain. , 2008, Annual review of neuroscience.

[58]  Jonathan Evans Dual-processing accounts of reasoning, judgment, and social cognition. , 2008, Annual review of psychology.

[59]  M. Gluck,et al.  Probabilistic categorization: How do normal participants and amnesic patients do it? , 2008, Neuroscience & Biobehavioral Reviews.

[60]  Carol A. Seger,et al.  How do the basal ganglia contribute to categorization? Their roles in generalization, response selection, and learning via feedback , 2008, Neuroscience & Biobehavioral Reviews.

[61]  R. Dolan,et al.  Subliminal Instrumental Conditioning Demonstrated in the Human Brain , 2008, Neuron.

[62]  J. Kerr,et al.  Dopamine Receptor Activation Is Required for Corticostriatal Spike-Timing-Dependent Plasticity , 2008, The Journal of Neuroscience.

[63]  Howard Eichenbaum,et al.  The neurobiology of memory based predictions , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[64]  Kristen L. Mackiewicz,et al.  Cognitive control mechanisms, emotion and memory: A neural perspective with implications for psychopathology , 2009, Neuroscience & Biobehavioral Reviews.

[65]  Carol A. Seger,et al.  The Involvement of Corticostriatal Loops in Learning Across Tasks, Species, and Methodologies , 2009 .

[66]  Hannah S. Locke,et al.  Flexible neural mechanisms of cognitive control within human prefrontal cortex , 2009, Proceedings of the National Academy of Sciences.

[67]  Marjan Jahanshahi,et al.  The role of the basal ganglia and its cortical connections in sequence learning: Evidence from implicit and explicit sequence learning in Parkinson's disease , 2009, Neuropsychologia.

[68]  K. Lashley Basic Neural Mechanisms in Behavior , 2009 .

[69]  B. Balleine,et al.  The integrative function of the basal ganglia in instrumental conditioning , 2009, Behavioural Brain Research.

[70]  Michael X. Cohen,et al.  Neurocomputational models of basal ganglia function in learning, memory and choice , 2009, Behavioural Brain Research.

[71]  J. Doyon,et al.  Contributions of the basal ganglia and functionally related brain structures to motor learning , 2009, Behavioural Brain Research.

[72]  M. Packard Exhumed from thought: Basal ganglia and response learning in the plus-maze , 2009, Behavioural Brain Research.

[73]  Wolfgang M. Pauli,et al.  Computational models of cognitive control , 2010, Current Opinion in Neurobiology.

[74]  Luis Jiménez,et al.  Representing serial action and perception , 2010, Psychonomic bulletin & review.

[75]  Ethan S. Bromberg-Martin,et al.  Dopamine in Motivational Control: Rewarding, Aversive, and Alerting , 2010, Neuron.

[76]  Erik J. Peterson,et al.  Dissociating the contributions of independent corticostriatal systems to visual categorization learning through the use of reinforcement learning modeling and Granger causality modeling , 2010, NeuroImage.

[77]  D. Shohamy,et al.  Dopamine and adaptive memory , 2010, Trends in Cognitive Sciences.

[78]  F. Gregory Ashby,et al.  Evidence for Cortical Automaticity in Rule-Based Categorization , 2010, The Journal of Neuroscience.

[79]  Benjamin O. Turner,et al.  Cortical and basal ganglia contributions to habit learning and automaticity , 2010, Trends in Cognitive Sciences.

[80]  Catherine E. Myers,et al.  A neural model of hippocampal–striatal interactions in associative learning and transfer generalization in various neurological and psychiatric patients , 2010, Brain and Cognition.

[81]  C. Lebiere,et al.  Conditional routing of information to the cortex: a model of the basal ganglia's role in cognitive coordination. , 2010, Psychological review.

[82]  Carol A. Seger,et al.  Category learning in the brain. , 2010, Annual review of neuroscience.

[83]  N. Lavie Attention, Distraction, and Cognitive Control Under Load , 2010 .

[84]  H. Bergman,et al.  Goal-directed and habitual control in the basal ganglia: implications for Parkinson's disease , 2010, Nature Reviews Neuroscience.

[85]  Erik J. Peterson,et al.  Dissociating hippocampal and basal ganglia contributions to category learning using stimulus novelty and subjective judgments , 2011, NeuroImage.

[86]  Earl K. Miller,et al.  Rapid Association Learning in the Primate Prefrontal Cortex in the Absence of Behavioral Reversals , 2011, Journal of Cognitive Neuroscience.

[87]  F. Gregory Ashby,et al.  Cortical and striatal contributions to automaticity in information-integration categorization , 2011, NeuroImage.

[88]  Carol A. Seger,et al.  Interactions within and between Corticostriatal Loops during Component Processes of Category Learning , 2011, Journal of Cognitive Neuroscience.