A learning rule for dynamic recruitment and decorrelation

The interest in neuronal networks originates for a good part in the option not to construct, but to train them. The mechanisms governing synaptic modifications during such training are assumed to depend on signals locally available at the synapses. In contrast, the performance of a network is suitably measured on a global scale. Here we propose a learning rule that addresses this conflict. It is inspired by recent physiological experiments and exploits the interaction of inhibitory input and backpropagating action potentials in pyramidal neurons. This mechanism makes information on the global scale available as a local signal. As a result, several desirable features can be combined: the learning rule allows fast synaptic modifications approaching one-shot learning. Nevertheless, it leads to stable representations during ongoing learning. Furthermore, the response properties of the neurons are not globally correlated, but cover the whole stimulus space.

[1]  K. Miller,et al.  Ocular dominance column development: analysis and simulation. , 1989, Science.

[2]  Joseph J. Atick,et al.  What Does the Retina Know about Natural Scenes? , 1992, Neural Computation.

[3]  Eytan Ruppin,et al.  Memory Maintenance via Neuronal Regulation , 1998, Neural Computation.

[4]  J. J. Hopfield,et al.  Pattern recognition computation using action potential timing for stimulus representation , 1995, Nature.

[5]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[6]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[7]  G. Deco,et al.  An Information-Theoretic Approach to Neural Computing , 1997, Perspectives in Neural Computing.

[8]  Pieter R. Roelfsema,et al.  How Precise is Neuronal Synchronization? , 1995, Neural Computation.

[9]  D. Johnston,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997 .

[10]  Buhmann Oscillations and low firing rates in associative memory neural networks. , 1989, Physical review. A, General physics.

[11]  D. Johnston,et al.  Electrical and calcium signaling in dendrites of hippocampal pyramidal neurons. , 1998, Annual review of physiology.

[12]  N. Spruston,et al.  Activity-dependent action potential invasion and calcium influx into hippocampal CA1 dendrites. , 1995, Science.

[13]  W. Singer,et al.  Different voltage-dependent thresholds for inducing long-term depression and long-term potentiation in slices of rat visual cortex , 1990, Nature.

[14]  W. N. Ross,et al.  IPSPs modulate spike backpropagation and associated [Ca2+]i changes in the dendrites of hippocampal CA1 pyramidal neurons. , 1996, Journal of neurophysiology.

[15]  Niraj S. Desai,et al.  Activity-dependent scaling of quantal amplitude in neocortical neurons , 1998, Nature.

[16]  E. Oja,et al.  Independent Component Analysis , 2013 .

[17]  G. Goodhill Stimulating issues in cortical map development. , 1997, Trends in neurosciences.

[18]  M. Bear,et al.  Experience-dependent modification of synaptic plasticity in visual cortex , 1996, Nature.

[19]  Andreas Wendemuth,et al.  Fast Learning Of Biased Patterns In Neural Networks , 1993, Int. J. Neural Syst..

[20]  M.N.O. Sadiku,et al.  Computing with neural networks , 1993, IEEE Potentials.

[21]  Klaus Schulten,et al.  Models of Orientation and Ocular Dominance Columns in the Visual Cortex: A Critical Comparison , 1995, Neural Computation.

[22]  Peter Földiák,et al.  Adaptation and decorrelation in the cortex , 1989 .

[23]  L C Katz,et al.  Development of local circuits in mammalian visual cortex. , 1992, Annual review of neuroscience.

[24]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[25]  S. Grossberg A neural model of attention, reinforcement and discrimination learning. , 1975, International review of neurobiology.

[26]  Günther Palm,et al.  How imprecise is neuronal synchronization? , 1999, Neurocomputing.

[27]  R C Reid,et al.  Efficient Coding of Natural Scenes in the Lateral Geniculate Nucleus: Experimental Test of a Computational Theory , 1996, The Journal of Neuroscience.

[28]  S. Lehky,et al.  Neural model of stereoacuity and depth interpolation based on a distributed representation of stereo disparity [published erratum appears in J Neurosci 1991 Mar;11(3):following Table of Contents] , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[29]  Richard Durbin,et al.  The computing neuron , 1989 .

[30]  K. Pawelzik,et al.  Organization of the visual cortex , 1996, Nature.

[31]  J. Nadal,et al.  Nonlinear feedforward networks with stochastic outputs: infomax implies redundancy reduction. , 1998, Network.

[32]  Terrence J. Sejnowski,et al.  Unsupervised Learning , 2018, Encyclopedia of GIS.

[33]  B. Sakmann,et al.  Active propagation of somatic action potentials into neocortical pyramidal cell dendrites , 1994, Nature.

[34]  H. B. Barlow,et al.  Finding Minimum Entropy Codes , 1989, Neural Computation.

[35]  T. Sejnowski,et al.  Storing covariance with nonlinearly interacting neurons , 1977, Journal of mathematical biology.

[36]  Pierre Comon Independent component analysis - a new concept? signal processing , 1994 .

[37]  Mark F. Bear,et al.  How do memories leave their mark? , 1997, Nature.

[38]  G. Stent A physiological mechanism for Hebb's postulate of learning. , 1973, Proceedings of the National Academy of Sciences of the United States of America.

[39]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.