Learning sensory maps with real-world stimuli in real time using a biophysically realistic learning rule

We present a real-time model of learning in the auditory cortex that is trained using real-world stimuli. The system consists of a peripheral and a central cortical network of spiking neurons. The synapses formed by peripheral neurons on the central ones are subject to synaptic plasticity. We implemented a biophysically realistic learning rule that depends on the precise temporal relation of pre- and postsynaptic action potentials. We demonstrate that this biologically realistic real-time neuronal system forms stable receptive fields that accurately reflect the spectral content of the input signals and that the size of these representations can be biased by global signals acting on the local learning mechanism. In addition, we show that this learning mechanism shows fast acquisition and is robust in the presence of large imbalances in the probability of occurrence of individual stimuli and noise.

[1]  W. N. Ross,et al.  IPSPs modulate spike backpropagation and associated [Ca2+]i changes in the dendrites of hippocampal CA1 pyramidal neurons. , 1996, Journal of neurophysiology.

[2]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[3]  B. Sakmann,et al.  A new cellular mechanism for coupling inputs arriving at different cortical layers , 1999, Nature.

[4]  D. Norman Learning and Memory , 1982 .

[5]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  T. Bliss,et al.  A synaptic model of memory: long-term potentiation in the hippocampus , 1993, Nature.

[7]  G. Stent A physiological mechanism for Hebb's postulate of learning. , 1973, Proceedings of the National Academy of Sciences of the United States of America.

[8]  T. Freund,et al.  gamma-Aminobutyric acid-containing basal forebrain neurons innervate inhibitory interneurons in the neocortex. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[9]  N. Suga,et al.  Auditory System , 2020, Definitions.

[10]  A. J. Hudspeth,et al.  Transneuronal transport in the auditory system of the cat , 1978, Brain Research.

[11]  J. Deuchars,et al.  Large, deep layer pyramid-pyramid single axon EPSPs in slices of rat motor cortex display paired pulse and frequency-dependent depression, mediated presynaptically and self-facilitation, mediated postsynaptically. , 1993, Journal of neurophysiology.

[12]  Steven G. Johnson,et al.  FFTW: an adaptive software architecture for the FFT , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[13]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[14]  Terrence J. Sejnowski,et al.  Unsupervised Learning , 2018, Encyclopedia of GIS.

[15]  B. Sakmann,et al.  Active propagation of somatic action potentials into neocortical pyramidal cell dendrites , 1994, Nature.

[16]  Paul F. M. J. Verschure,et al.  Local and Global Gating of Synaptic Plasticity , 2000, Neural Computation.

[17]  S. Grossberg,et al.  How does a brain build a cognitive code? , 1980, Psychological review.

[18]  G. Buzsáki,et al.  Somadendritic backpropagation of action potentials in cortical pyramidal cells of the awake rat. , 1998, Journal of neurophysiology.

[19]  J. Deuchars,et al.  Temporal and spatial properties of local circuits in neocortex , 1994, Trends in Neurosciences.

[20]  Konrad P. Körding,et al.  A learning rule for dynamic recruitment and decorrelation , 2000, Neural Networks.

[21]  T. Sejnowski,et al.  Storing covariance with nonlinearly interacting neurons , 1977, Journal of mathematical biology.

[22]  J. P. Rauschecker,et al.  Central core control of developmental plasticity in the kitten visual cortex: II. Electrical activation of mesencephalic and diencephalic projections , 2004, Experimental Brain Research.

[23]  D. Buonomano,et al.  Cortical plasticity: from synapses to maps. , 1998, Annual review of neuroscience.

[24]  Peter Blood,et al.  The effect of cladding layer thickness on large optical cavity 650-nm lasers , 2002 .

[25]  Rajesh P. N. Rao,et al.  An optimal estimation approach to visual perception and learning , 1999, Vision Research.

[26]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[27]  L. F. Abbott Learning in neural network memories , 1990 .

[28]  Wulfram Gerstner,et al.  Why spikes? Hebbian learning and retrieval of time-resolved excitation patterns , 1993, Biological Cybernetics.

[29]  L. Abbott,et al.  A Quantitative Description of Short-Term Plasticity at Excitatory Synapses in Layer 2/3 of Rat Primary Visual Cortex , 1997, The Journal of Neuroscience.

[30]  H. Markram,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997, Science.

[31]  I. Jolliffe Principal Component Analysis , 2002 .

[32]  T. SHALLICE,et al.  Learning and Memory , 1970, Nature.

[33]  Paul F. M. J. Verschure,et al.  On the Role of Biophysical Properties of Cortical Neurons in Binding and Segmentation of Visual Scenes , 1999, Neural Computation.

[34]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[35]  Roland Baddeley,et al.  An efficient code in V1? , 1996, Nature.

[36]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[37]  Thomas H. Brown,et al.  Hebbian Synaptic Plasticity: Evolution of the Contemporary Concept , 1994 .

[38]  Yves Frégnac Hebbian synaptic plasticity: comparative and developmental aspects , 1998 .

[39]  B. Sakmann,et al.  Calcium dynamics in single spines during coincident pre- and postsynaptic activity depend on relative timing of back-propagating action potentials and subthreshold excitatory postsynaptic potentials. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[40]  M. Kilgard,et al.  Cortical map reorganization enabled by nucleus basalis activity. , 1998, Science.

[41]  S. Grossberg How does a brain build a cognitive code , 1980 .

[42]  N. Weinberger Learning-induced changes of auditory receptive fields , 1993, Current Opinion in Neurobiology.

[43]  Pieter R. Roelfsema,et al.  How Precise is Neuronal Synchronization? , 1995, Neural Computation.

[44]  N Burgess,et al.  Group Report: Representations in Natural and Artificial Systems , 1998, Zeitschrift fur Naturforschung. C, Journal of biosciences.

[45]  L. Abbott,et al.  Synaptic Depression and Cortical Gain Control , 1997, Science.

[46]  Thomas H. Brown,et al.  Hebbian synaptic plasticity , 1998 .

[47]  S. J. Martin,et al.  Synaptic plasticity and memory: an evaluation of the hypothesis. , 2000, Annual review of neuroscience.

[48]  Paul F. M. J. Verschure,et al.  What Can Robots Tell Us About Brains? A Synthetic Approach Towards the Study of Learning and Problem Solving , 1999, Reviews in the neurosciences.

[49]  D. Johnston,et al.  Electrical and calcium signaling in dendrites of hippocampal pyramidal neurons. , 1998, Annual review of physiology.

[50]  N. Spruston,et al.  Activity-dependent action potential invasion and calcium influx into hippocampal CA1 dendrites. , 1995, Science.

[51]  T. Freund,et al.  GABAergic interneurons containing calbindin D28K or somatostatin are major targets of GABAergic basal forebrain afferents in the rat neocortex , 1991, The Journal of comparative neurology.

[52]  W. Regehr,et al.  Short-term synaptic plasticity. , 2002, Annual review of physiology.

[53]  R. Baddeley Visual perception. An efficient code in V1? , 1996, Nature.

[54]  N. Weinberger,et al.  Long-term retention of learning-induced receptive-field plasticity in the auditory cortex. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[55]  A. Dickinson,et al.  Neuronal coding of prediction errors. , 2000, Annual review of neuroscience.

[56]  Joe Z Tsien,et al.  Linking Hebb’s coincidence-detection to memory formation , 2000, Current Opinion in Neurobiology.

[57]  D. Johnston,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997 .

[58]  Henry Markram,et al.  Neural Networks with Dynamic Synapses , 1998, Neural Computation.