Learning with two sites of synaptic integration

Since the classical work of D O Hebb 1949 The Organization of Behaviour (New York: Wiley) it is assumed that synaptic plasticity solely depends on the activity of the pre- and the post-synaptic cells. Synapses influence the plasticity of other synapses exclusively via the post-synaptic activity. This confounds effects on synaptic plasticity and neuronal activation and, thus, makes it difficult to implement networks which optimize global measures of performance. Exploring solutions to this problem, inspired by recent research on the properties of apical dendrites, we examine a network of neurons with two sites of synaptic integration. These communicate in such a way that one set of synapses mainly influences the neurons' activity; the other set gates synaptic plasticity. Analysing the system with a constant set of parameters reveals: (1) the afferents that gate plasticity act as supervisors, individual to every cell. (2) While the neurons acquire specific receptive fields the net activity remains constant for different stimuli. This ensures that all stimuli are represented and, thus, contributes to information maximization. (3) Mechanisms for maximization of coherent information can easily be implemented. Neurons with non-overlapping receptive fields learn to fire correlated and preferentially transmit information that is correlated over space. (4) We demonstrate how a new measure of performance can be implemented: cells learn to represent only the part of the input that is relevant to the processing at higher stages. This criterion is termed ‘relevant infomax’.

[1]  G. Stent.  A physiological mechanism for Hebb's postulate of learning. , 1973, Proceedings of the National Academy of Sciences of the United States of America.

[2]  T. Sejnowski,et al.  Storing covariance with nonlinearly interacting neurons , 1977, Journal of mathematical biology.

[3]  W. Singer,et al.  Requirements for the disruption of binocularity in the visual cortex of strabismic kittens , 1979, Brain Research.

[4]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[5]  S. Shipp,et al.  The functional logic of cortical connections , 1988, Nature.

[6]  W. Singer,et al.  Different voltage-dependent thresholds for inducing long-term depression and long-term potentiation in slices of rat visual cortex , 1990, Nature.

[7]  Geoffrey E. Hinton,et al.  Self-organizing neural network that discovers surfaces in random-dot stereograms , 1992, Nature.

[8]  M. Bear,et al.  Homosynaptic long-term depression in area CA1 of hippocampus and effects of N-methyl-D-aspartate receptor blockade. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Nathan Intrator,et al.  Objective function formulation of the BCM theory of visual cortical plasticity: Statistical connections, stability conditions , 1992, Neural Networks.

[10]  B. Connors,et al.  Regenerative activity in apical dendrites of pyramidal cells in neocortex. , 1993, Cerebral cortex.

[11]  Bartlett W. Mel.  Synaptic integration in an excitable dendritic tree. , 1993, Journal of neurophysiology.

[12]  C. Koch,et al.  Amplification and linearization of distal synaptic input to cortical pyramidal cells. , 1994, Journal of neurophysiology.

[13]  L. Cauller,et al.  Synaptic physiology of horizontal afferents to layer I in slices of rat SI neocortex , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  B. Sakmann,et al.  Active propagation of somatic action potentials into neocortical pyramidal cell dendrites , 1994, Nature.

[15]  R. Clay Reid,et al.  Visually evoked calcium action potentials in cat striate cortex , 1995, Nature.

[16]  Jim Kay,et al.  The discovery of structure by multi-stream networks of local processors with contextual guidance , 1995 .

[17]  P A Salin,et al.  Corticocortical connections in the visual system: structure and function. , 1995, Physiological reviews.

[18]  Suzanna Becker,et al.  Mutual information maximization: models of cortical self-organization. , 1996, Network.

[19]  W. Singer,et al.  In search of common foundations for cortical computation , 1997, Behavioral and Brain Sciences.

[20]  B. Sakmann,et al.  Action potential initiation and propagation in rat neocortical pyramidal neurons , 1997, The Journal of physiology.

[21]  Nathan Intrator,et al.  Learning as Extraction of Low-Dimensional Representations , 1997 .

[22]  B. Sakmann,et al.  Calcium action potentials restricted to distal apical dendrites of rat neocortical pyramidal neurons , 1997, The Journal of physiology.

[23]  M. Kilgard,et al.  Cortical map reorganization enabled by nucleus basalis activity. , 1998, Science.

[24]  G. Buzsáki,et al.  Somadendritic backpropagation of action potentials in cortical pyramidal cells of the awake rat. , 1998, Journal of neurophysiology.

[25]  Dario Floreano,et al.  Contextually guided unsupervised learning using local multivariate binary processors , 1998, Neural Networks.

[26]  Y. Frégnac,et al.  Activity‐dependent regulation of ‘on’ and ‘off’ responses in cat visual cortical receptive fields , 1998, The Journal of physiology.

[27]  Niraj S. Desai,et al.  Activity-dependent scaling of quantal amplitude in neocortical neurons , 1998, Nature.

[28]  N. Spruston,et al.  Determinants of Voltage Attenuation in Neocortical Pyramidal Neuron Dendrites , 1998, The Journal of Neuroscience.

[29]  B. Sakmann,et al.  A new cellular mechanism for coupling inputs arriving at different cortical layers , 1999, Nature.

[30]  O. Paulsen,et al.  Rapid report: postsynaptic bursting is essential for 'Hebbian' induction of associative long-term potentiation at excitatory synapses in rat hippocampus. , 1999, The Journal of physiology.

[31]  Konrad P. Körding,et al.  A learning rule for dynamic recruitment and decorrelation , 2000, Neural Networks.

[32]  Jane Barclay,et al.  Activity-dependent scaling of quantal amplitude inneocortical neurons , 2022 .