Spatial features of synaptic adaptation affecting learning performance

Recent studies have proposed that the diffusion of messenger molecules, such as monoamines, can mediate the plastic adaptation of synapses in supervised learning of neural networks. Based on these findings we developed a model for neural learning, where the signal for plastic adaptation is assumed to propagate through the extracellular space. We investigate the conditions allowing learning of Boolean rules in a neural network. Even fully excitatory networks show very good learning performances. Moreover, the investigation of the plastic adaptation features optimizing the performance suggests that learning is very sensitive to the extent of the plastic adaptation and the spatial range of synaptic connections.

[1]  Rik Van de Walle,et al.  Real-Time Reservoir Computing Network-Based Systems for Detection Tasks on Visual Contents , 2015, 2015 7th International Conference on Computational Intelligence, Communication Systems and Networks.

[2]  B. Roerig,et al.  Relationships of local inhibitory and excitatory circuits to orientation preference maps in ferret visual cortex. , 2002, Cerebral cortex.

[3]  A. Dickinson,et al.  Neuronal coding of prediction errors. , 2000, Annual review of neuroscience.

[4]  H. Seung,et al.  Learning in Spiking Neural Networks by Reinforcement of Stochastic Synaptic Transmission , 2003, Neuron.

[5]  E. Izhikevich.  Solving the distal reward problem through linkage of STDP and dopamine signaling , 2007, BMC Neuroscience.

[6]  Georg B. Keller,et al.  Neural processing of auditory feedback during vocal practice in a songbird , 2009, Nature.

[7]  Shi V. Liu.  Debating controversies can enhance creativity , 2000, Nature.

[8]  C. Grady,et al.  Blood Oxygen Level-Dependent Signal Variability Is More than Just Noise , 2010, The Journal of Neuroscience.

[9]  Hans J. Herrmann,et al.  Optimal percentage of inhibitory synapses in multi-task learning , 2015, Scientific Reports.

[10]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[11]  C. Grady,et al.  The Importance of Being Variable , 2011, The Journal of Neuroscience.

[12]  L. de Arcangelis,et al.  Learning as a phenomenon occurring in a critical state , 2010, Proceedings of the National Academy of Sciences.

[13]  J. F. Kolen,et al.  Backpropagation without weight transport , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[14]  Herbert Jaeger,et al.  The''echo state''approach to analysing and training recurrent neural networks , 2001 .

[15]  John N. J. Reynolds,et al.  Dopamine-dependent plasticity of corticostriatal synapses , 2002, Neural Networks.

[16]  Razvan V. Florian,et al.  Reinforcement Learning Through Modulation of Spike-Timing-Dependent Synaptic Plasticity , 2007, Neural Computation.

[17]  Natasa Kovacevic,et al.  Increased Brain Signal Variability Accompanies Lower Behavioral Variability in Development , 2008, PLoS Comput. Biol..

[18]  Mauro Dam,et al.  The discovery of central monoamine neurons gave volume transmission to the wired brain , 2010, Progress in Neurobiology.

[19]  Francis Crick,et al.  The recent excitement about neural networks , 1989, Nature.

[20]  W. A. van Leeuwen,et al.  Combining Hebbian and reinforcement learning in a minibrain model , 2004, Neural Networks.

[21]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[22]  Gordon Pipa,et al.  RM-SORN: a reward-modulated self-organizing recurrent neural network , 2015, Front. Comput. Neurosci..

[23]  D. G. Stork,et al.  Is backpropagation biologically plausible? , 1989, International 1989 Joint Conference on Neural Networks.

[24]  Georg B. Keller,et al.  Sensorimotor Mismatch Signals in Primary Visual Cortex of the Behaving Mouse , 2012, Neuron.

[25]  Yu Tian Wang,et al.  Direct protein–protein coupling enables cross-talk between dopamine D5 and γ-aminobutyric acid A receptors , 2000, Nature.

[26]  Randall C. O'Reilly,et al.  Biologically Plausible Error-Driven Learning Using Local Activation Differences: The Generalized Recirculation Algorithm , 1996, Neural Computation.

[27]  P. Bak,et al.  Adaptive learning by extremal dynamics and negative feedback. , 2000, Physical review. E, Statistical, nonlinear, and soft matter physics.

[28]  Colin J. Akerman,et al.  Random synaptic feedback weights support error backpropagation for deep learning , 2016, Nature Communications.

[29]  Viktor K. Jirsa,et al.  Noise during Rest Enables the Exploration of the Brain's Dynamic Repertoire , 2008, PLoS Comput. Biol..

[30]  P. Bak,et al.  Learning from mistakes , 1997, Neuroscience.