On the Role of Cortex-Basal Ganglia Interactions for Category Learning: A Neurocomputational Approach

In addition to the prefrontal cortex (PFC), the basal ganglia (BG) have been increasingly often reported to play a fundamental role in category learning, but the circuit mechanisms mediating their interaction remain to be explored. We developed a novel neurocomputational model of category learning that particularly addresses the BG–PFC interplay. We propose that the BG bias PFC activity by removing the inhibition of cortico–thalamo–cortical loop and thereby provide a teaching signal to guide the acquisition of category representations in the corticocortical associations to the PFC. Our model replicates key behavioral and physiological data of macaque monkey learning a prototype distortion task from Antzoulatos and Miller (2011). Our simulations allowed us to gain a deeper insight into the observed drop of category selectivity in striatal neurons seen in the experimental data and in the model. The simulation results and a new analysis of the experimental data based on the model's predictions show that the drop in category selectivity of the striatum emerges as the variability of responses in the striatum rises when confronting the BG with an increasingly larger number of stimuli to be classified. The neurocomputational model therefore provides new testable insights of systems-level brain circuits involved in category learning that may also be generalized to better understand other cortico–BG–cortical loops. SIGNIFICANCE STATEMENT Inspired by the idea that basal ganglia (BG) teach the prefrontal cortex (PFC) to acquire category representations, we developed a novel neurocomputational model and tested it on a task that was recently applied in monkey experiments. As an advantage over previous models of category learning, our model allows to compare simulation data with single-cell recordings in PFC and BG. We not only derived model predictions, but already verified a prediction to explain the observed drop in striatal category selectivity. When testing our model with a simple, real-world face categorization task, we observed that the fast striatal learning with a performance of 85% correct responses can teach the slower PFC learning to push the model performance up to almost 100%.

[1]  Stephen Grossberg,et al.  How laminar frontal cortex and basal ganglia circuits interact to control planned and reactive saccades , 2004, Neural Networks.

[2]  J. Price,et al.  Prefrontal cortical projections to the striatum in macaque monkeys: Evidence for an organization related to prefrontal networks , 2000, The Journal of comparative neurology.

[3]  P. J. Sjöström,et al.  Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity , 2001, Neuron.

[4]  W. T. Maddox,et al.  Dissociable Prototype Learning Systems: Evidence from Brain Imaging and Behavior , 2008, The Journal of Neuroscience.

[5]  Carol A. Seger,et al.  Dissociation between Striatal Regions while Learning to Categorize via Feedback and via Observation , 2007, Journal of Cognitive Neuroscience.

[6]  F. Hamker,et al.  Dysfunctional and compensatory synaptic plasticity in Parkinson's disease , 2014, The European journal of neuroscience.

[7]  Tal Hassner,et al.  Face recognition in unconstrained videos with matched background similarity , 2011, CVPR 2011.

[8]  Carol A. Seger,et al.  The Roles of the Caudate Nucleus in Human Classification Learning , 2005, The Journal of Neuroscience.

[9]  W. T. Maddox,et al.  Neural correlates of rule-based and information-integration visual category learning. , 2006, Cerebral cortex.

[10]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[11]  E. Miller,et al.  Differences between Neural Activity in Prefrontal Cortex and Striatum during Learning of Novel Abstract Categories , 2011, Neuron.

[12]  Carol A. Seger,et al.  Category learning in the brain. , 2010, Annual review of neuroscience.

[13]  O. Hikosaka,et al.  Effects of caudate nucleus stimulation on substantia nigra cell activity in monkey , 2004, Experimental Brain Research.

[14]  Thomas Serre,et al.  Models of visual categorization. , 2016, Wiley interdisciplinary reviews. Cognitive science.

[15]  Michael J. Frank,et al.  Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia , 2006, Neural Computation.

[16]  Carol A. Seger,et al.  Striatal activation during acquisition of a cognitive skill. , 1999, Neuropsychology.

[17]  Earl K Miller,et al.  Synchronous beta rhythms of frontoparietal networks support only behaviorally relevant representations , 2016, eLife.

[18]  M. Gluck,et al.  Interactive memory systems in the human brain , 2001, Nature.

[19]  H. Braak,et al.  Cortico-basal ganglia-cortical circuitry in Parkinson's disease reconsidered , 2008, Experimental Neurology.

[20]  J. Walters,et al.  Apomorphine and dopamine D1 receptor agonists increase the firing rates of subthalamic nucleus neurons , 1996, Neuroscience.

[21]  R. Romo,et al.  Functional properties of primate putamen neurons during the categorization of tactile stimuli. , 1997, Journal of neurophysiology.

[22]  D. Surmeier,et al.  D1 and D2 dopamine-receptor modulation of striatal glutamatergic signaling in striatal medium spiny neurons , 2007, Trends in Neurosciences.

[23]  Maximilian Riesenhuber,et al.  Perceptual category learning and visual processing: An exercise in computational cognitive neuroscience , 2017, Neural Networks.

[24]  Giacomo Koch,et al.  Hebbian and Anti-Hebbian Spike-Timing-Dependent Plasticity of Human Cortico-Cortical Connections , 2013, The Journal of Neuroscience.

[25]  P. Greengard,et al.  Dichotomous Dopaminergic Control of Striatal Synaptic Plasticity , 2008, Science.

[26]  E. Miller,et al.  Different time courses of learning-related activity in the prefrontal cortex and striatum , 2005, Nature.

[27]  Shawn W. Ell,et al.  Learning robust cortico-cortical associations with the basal ganglia: An integrative review , 2015, Cortex.

[28]  Anatol C. Kreitzer,et al.  Control of Basal Ganglia Output by Direct and Indirect Pathway Projection Neurons , 2013, The Journal of Neuroscience.

[29]  D. Durstewitz,et al.  The ability of the mesocortical dopamine system to operate in distinct temporal modes , 2007, Psychopharmacology.

[30]  F. Hamker,et al.  Combined lesions of direct and indirect basal ganglia pathways but not changes in dopamine levels explain learning deficits in patients with Huntington's disease , 2015, The European journal of neuroscience.

[31]  Henning Schroll,et al.  Working memory and response selection: A computational account of interactions among cortico-basalganglio-thalamic loops , 2012, Neural Networks.

[32]  W. Schultz,et al.  Neuronal activity in monkey striatum related to the expectation of predictable environmental events. , 1992, Journal of neurophysiology.

[33]  E. Miller,et al.  Rules through Recursion: How Interactions between the Frontal Cortex and Basal Ganglia May Build Abstract, Complex Rules from Concrete, Simple Ones , 2007 .

[34]  Fred H. Hamker,et al.  Computational models of basal-ganglia pathway functions: focus on functional neuroanatomy , 2013, Front. Syst. Neurosci..

[35]  E. Miller,et al.  From rule to response: neuronal processes in the premotor and prefrontal cortex. , 2003, Journal of neurophysiology.

[36]  David J. Freedman,et al.  A Comparison of Primate Prefrontal and Inferior Temporal Cortices during Visual Categorization , 2003, The Journal of Neuroscience.

[37]  S. Haber The primate basal ganglia: parallel and integrative networks , 2003, Journal of Chemical Neuroanatomy.

[38]  J. Mink THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS , 1996, Progress in Neurobiology.

[39]  Julien Vitay,et al.  ANNarchy: a code generation approach to neural simulations on parallel hardware , 2015, Front. Neuroinform..

[40]  Emilio Salinas,et al.  Perceptual Decision Making , 2014, Encyclopedia of Computational Neuroscience.

[41]  Jonathan D. Wallis,et al.  A Comparison of Abstract Rules in the Prefrontal Cortex, Premotor Cortex, Inferior Temporal Cortex, and Striatum , 2006, Journal of Cognitive Neuroscience.

[42]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.

[43]  J. Dostrovsky,et al.  Levodopa enhances synaptic plasticity in the substantia nigra pars reticulata of Parkinson's disease patients. , 2009, Brain : a journal of neurology.

[44]  David J. Freedman,et al.  Categorical representation of visual stimuli in the primate prefrontal cortex. , 2001, Science.

[45]  Simon D. Fisher,et al.  Reinforcement determines the timing dependence of corticostriatal synaptic plasticity in vivo , 2017, Nature Communications.

[46]  Jennifer J. Richler,et al.  Visual category learning. , 2014, Wiley interdisciplinary reviews. Cognitive science.

[47]  David J. Freedman,et al.  Visual categorization and the primate prefrontal cortex: neurophysiology and behavior. , 2002, Journal of neurophysiology.

[48]  R. O’Reilly,et al.  Computational principles of learning in the neocortex and hippocampus , 2000, Hippocampus.

[49]  K. C. Anderson,et al.  Single neurons in prefrontal cortex encode abstract rules , 2001, Nature.

[50]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[51]  A. Nambu,et al.  Functional significance of the cortico–subthalamo–pallidal ‘hyperdirect’ pathway , 2002, Neuroscience Research.

[52]  Julien Vitay,et al.  Timing and expectation of reward: a neuro-computational model of the afferents to the ventral tegmental area , 2014, Front. Neurorobot..

[53]  E. Oja Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.