Modeling fast stimulus–response association learning along the occipito-parieto-frontal pathway following rule instructions

On the basis of instructions, humans are able to set up associations between sensory and motor areas of the brain separated by several neuronal relays, within a few seconds. This paper proposes a model of fast learning along the dorsal pathway, from primary visual areas to pre-motor cortex. A new synaptic learning rule is proposed where synaptic efficacies converge rapidly toward a specific value determined by the number of active inputs of a neuron, respecting a principle of resource limitation in terms of total synaptic input efficacy available to a neuron. The efficacies are stable with regards to repeated arrival of spikes in a spike train. This rule reproduces the inverse relationship between initial and final synaptic efficacy observed in long-term potentiation (LTP) experiments. Simulations of learning experiments are conducted in a multilayer network of leaky integrate-and-fire (LIF) spiking neuron models. It is proposed that cortical feedback connections convey a top-down learning-enabling signal that guides bottom-up learning in "hidden" neurons that are not directly exposed to input or output activity. Simulations of repeated presentation of the same stimulus-response pair, show that, under conditions of fast learning with probabilistic synaptic transmission, the networks tend to recruit a new sub-network at each presentation to represent the association, rather than re-using a previously trained one. This increasing allocation of neural resources results in progressively shorter execution times, in line with experimentally observed reduction in response time with practice. This article is part of a Special Issue entitled: Neural Coding.

[1]  A. Thomson,et al.  Functional Maps of Neocortical Local Circuitry , 2007, Front. Neurosci..

[2]  K. Grieve,et al.  Effects of feedback projections from area 18 layers 2/3 to area 17 layers 2/3 in the cat visual cortex. , 1999, Journal of neurophysiology.

[3]  M. Tovée,et al.  Processing speed in the cerebral cortex and the neurophysiology of visual masking , 1994, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[4]  Thomas K. Berger,et al.  Heterogeneity in the pyramidal network of the medial prefrontal cortex , 2006, Nature Neuroscience.

[5]  D Yves von Cramon,et al.  “What” Becoming “Where”: Functional Magnetic Resonance Imaging Evidence for Pragmatic Relevance Driving Premotor Cortex , 2004, The Journal of Neuroscience.

[6]  Hannes Ruge,et al.  Rapid formation of pragmatic rule representations in the human brain during instruction-based learning. , 2010, Cerebral cortex.

[7]  John Duncan,et al.  Target Detection by Opponent Coding in Monkey Prefrontal Cortex , 2010, Journal of Cognitive Neuroscience.

[8]  W. Singer,et al.  Different voltage-dependent thresholds for inducing long-term depression and long-term potentiation in slices of rat visual cortex , 1990, Nature.

[9]  E. Miller,et al.  A Neural Circuit Model of Flexible Sensorimotor Mapping: Learning and Forgetting on Multiple Timescales , 2007, Neuron.

[10]  Thomas P. Trappenberg,et al.  The Trouble with Weight-Dependent STDP , 2007, 2007 International Joint Conference on Neural Networks.

[11]  G. Rizzolatti,et al.  The Cortical Motor System , 2001, Neuron.

[12]  Reza Shadmehr,et al.  Catastrophic Interference in Human Motor Learning , 1994, NIPS.

[13]  Guido Bugmann,et al.  Role of Temporal Integration and Fluctuation Detection in the Highly Irregular Firing of a Leaky Integrator Neuron Model with Partial Reset , 1997, Neural Computation.

[14]  P. Pavlidis,et al.  Pair Recordings Reveal All-Silent Synaptic Connections and the Postsynaptic Expression of Long-Term Potentiation , 2001, Neuron.

[15]  D. Ferster,et al.  Neural mechanisms of orientation selectivity in the visual cortex. , 2000, Annual review of neuroscience.

[16]  S. Royer,et al.  Conservation of total synaptic weight through balanced synaptic depression and potentiation , 2003, Nature.

[17]  Guido Bugmann The Neuronal Computation Time , 1992 .

[18]  S. Shipp Structure and function of the cerebral cortex , 2007, Current Biology.

[19]  P. J. Sjöström,et al.  Dendritic excitability and synaptic plasticity. , 2008, Physiological reviews.

[20]  C. Reid,et al.  Postsynaptic expression of long‐term potentiation in the rat dentate gyrus demonstrated by variance‐mean analysis , 1999, The Journal of physiology.

[21]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[22]  Jeffrey L. Krichmar,et al.  Spatial navigation and causal analysis in a brain-based device modeling cortical-hippocampal interactions , 2007, Neuroinformatics.

[23]  Anupam Shukla,et al.  Artificial Neural Networks II , 2010 .

[24]  Marcel Brass,et al.  Neural Correlates of Overcoming Interference from Instructed and Implemented Stimulus–Response Associations , 2009, The Journal of Neuroscience.

[25]  M. Makuuchi,et al.  Brain activation during ideomotor praxis: imitation and movements executed by verbal command , 2004, Journal of Neurology, Neurosurgery & Psychiatry.

[26]  M. Brass,et al.  Neural Circuitry Underlying Rule Use in Humans and Nonhuman Primates , 2005, The Journal of Neuroscience.

[27]  D. Pandya,et al.  Architecture and Connections of Cortical Association Areas , 1985 .

[28]  Adam M Sillito,et al.  Corticothalamic interactions in the transfer of visual information. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[29]  Shigeru Tanaka,et al.  Constraint on the Number of Synaptic Inputs to a Visual Cortical Neuron Controls Receptive Field Formation , 2009, Neural Computation.

[30]  Tao Xiong,et al.  A combined SVM and LDA approach for classification , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[31]  H. Barbas,et al.  Diversity of laminar connections linking periarcuate and lateral intraparietal areas depends on cortical structure , 2006, The European journal of neuroscience.

[32]  Johannes Partzsch,et al.  Rate and Pulse Based Plasticity Governed by Local Synaptic State Variables , 2010, Front. Syn. Neurosci..

[33]  E. Vaadia,et al.  Emergence of Novel Representations in Primary Motor Cortex and Premotor Neurons during Associative Learning , 2008, The Journal of Neuroscience.

[34]  Niraj S. Desai,et al.  Homeostatic Plasticity and STDP: Keeping a Neuron's Cool in a Fluctuating World , 2010, Front. Syn. Neurosci..

[35]  G. Turrigiano The Self-Tuning Neuron: Synaptic Scaling of Excitatory Synapses , 2008, Cell.

[36]  S. Wise,et al.  The premotor cortex of the monkey , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[37]  P. Strick,et al.  Cerebellar output: motor and cognitive channels , 1998, Trends in Cognitive Sciences.

[38]  R Caminiti,et al.  Making arm movements within different parts of space: the premotor and motor cortical representation of a coordinate system for reaching to visual targets , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[39]  C. Galletti,et al.  The cortical visual area V6: brain location and visual topography , 1999, The European journal of neuroscience.

[40]  Joachim Hermsdörfer,et al.  Formation and decay of sensorimotor and associative memory in object lifting , 2007, European Journal of Applied Physiology.

[41]  S. Shipp The importance of being agranular: a comparative account of visual and motor cortex , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[42]  E. Rolls,et al.  INVARIANT FACE AND OBJECT RECOGNITION IN THE VISUAL SYSTEM , 1997, Progress in Neurobiology.

[43]  Friedemann Pulvermüller,et al.  Recruitment and Consolidation of Cell Assemblies for Words by Way of Hebbian Learning and Competition in a Multi-Layer Neural Network , 2009, Cognitive Computation.

[44]  K. Miller,et al.  Synaptic Economics: Competition and Cooperation in Synaptic Plasticity , 1996, Neuron.

[45]  P. J. Sjöström,et al.  Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity , 2001, Neuron.

[46]  Benjamin O. Turner,et al.  Cortical and basal ganglia contributions to habit learning and automaticity , 2010, Trends in Cognitive Sciences.

[47]  Ivan Toni,et al.  Contrasting the Dorsal and Ventral Visual Systems: Guidance of Movement versus Decision Making , 2001, NeuroImage.

[48]  Paul Antoine Salin,et al.  Projections from Areas 18 and 19 to Cat Striate Cortex: Divergence and Laminar Specificity , 1991, The European journal of neuroscience.

[49]  J. Assad,et al.  Dynamic coding of behaviourally relevant stimuli in parietal cortex , 2002, Nature.

[50]  R. Andersen,et al.  Dorsal Premotor Neurons Encode the Relative Position of the Hand, Eye, and Goal during Reach Planning , 2006, Neuron.

[51]  H. Markram,et al.  The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[52]  R. Douglas,et al.  A functional microcircuit for cat visual cortex. , 1991, The Journal of physiology.

[53]  Guido Bugmann Synaptic depression increases the selectivity of a neuron to its preferred pattern and binarizes the neural code. , 2002, Bio Systems.

[54]  J. Bullier,et al.  Reaching beyond the classical receptive field of V1 neurons: horizontal or feedback axons? , 2003, Journal of Physiology-Paris.

[55]  S. Kosslyn,et al.  Brain areas underlying visual mental imagery and visual perception: an fMRI study. , 2004, Brain research. Cognitive brain research.

[56]  Mark Laubach,et al.  Top-Down Control of Motor Cortex Ensembles by Dorsomedial Prefrontal Cortex , 2006, Neuron.

[57]  J B Poline,et al.  Transient Activity in the Human Calcarine Cortex During Visual-Mental Imagery: An Event-Related fMRI Study , 2000, Journal of Cognitive Neuroscience.

[58]  M. Stryker,et al.  Neural plasticity without postsynaptic action potentials: less-active inputs become dominant when kitten visual cortical cells are pharmacologically inhibited. , 1988, Proceedings of the National Academy of Sciences of the United States of America.

[59]  P. Dixon,et al.  Topographically divergent and convergent connectivity between premotor and primary motor cortex. , 2006, Cerebral cortex.

[60]  Andreas Burkhalter,et al.  Distinct GABAergic Targets of Feedforward and Feedback Connections Between Lower and Higher Areas of Rat Visual Cortex , 2003, The Journal of Neuroscience.

[61]  Simon J. Thorpe,et al.  Ultra-Rapid Scene Categorization with a Wave of Spikes , 2002, Biologically Motivated Computer Vision.

[62]  Vittorio Gallese,et al.  Listening to Action-related Sentences Activates Fronto-parietal Motor Circuits , 2005, Journal of Cognitive Neuroscience.

[63]  Michael W. Cole,et al.  Prefrontal Dynamics Underlying Rapid Instructed Task Learning Reverse with Practice , 2010, The Journal of Neuroscience.

[64]  M. Carandini,et al.  Stimulus dependence of two-state fluctuations of membrane potential in cat visual cortex , 2000, Nature Neuroscience.