Learning Spike Time Codes Through Morphological Learning With Binary Synapses

In this brief, a neuron with nonlinear dendrites (NNLDs) and binary synapses that is able to learn temporal features of spike input patterns is considered. Since binary synapses are considered, learning happens through formation and elimination of connections between the inputs and the dendritic branches to modify the structure or morphology of the NNLD. A morphological learning algorithm inspired by the tempotron, i.e., a recently proposed temporal learning algorithm is presented in this brief. Unlike tempotron, the proposed learning rule uses a technique to automatically adapt the NNLD threshold during training. Experimental results indicate that our NNLD with 1-bit synapses can obtain accuracy similar to that of a traditional tempotron with 4-bit synapses in classifying single spike random latency and pairwise synchrony patterns. Hence, the proposed method is better suited for robust hardware implementation in the presence of statistical variations. We also present results of applying this rule to real-life spike classification problems from the field of tactile sensing.

[1]  Bartlett W. Mel,et al.  Capacity-Enhancing Synaptic Learning Rules in a Medial Temporal Lobe Online Learning Model , 2009, Neuron.

[2]  Shaista Hussain,et al.  Morphological learning: Increased memory capacity of neuromorphic systems with binary synapses exploiting AER based reconfiguration , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[3]  Kwabena Boahen,et al.  Point-to-point connectivity between neuromorphic chips using address events , 2000 .

[4]  Johannes Schemmel,et al.  A VLSI Implementation of the Adaptive Exponential Integrate-and-Fire Neuron Model , 2010, NIPS.

[5]  PonulakFilip,et al.  Supervised learning in spiking neural networks with resume , 2010 .

[6]  Giacomo Indiveri,et al.  Integration of nanoscale memristor synapses in neuromorphic computing architectures , 2013, Nanotechnology.

[7]  Razvan V. Florian,et al.  The Chronotron: A Neuron That Learns to Fire Temporally Precise Spike Patterns , 2010, PloS one.

[8]  Shaista Hussain,et al.  Hardware efficient, neuromorphic dendritically enhanced readout for liquid state machines , 2013, 2013 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[9]  Gregory Cohen,et al.  Synthesis of neural networks for spatio-temporal spike pattern recognition and processing , 2013, Front. Neurosci..

[10]  R. Johansson,et al.  First spikes in ensembles of human tactile afferents code complex spatial fingertip events , 2004, Nature Neuroscience.

[11]  Bartlett W. Mel,et al.  Impact of Active Dendrites and Structural Plasticity on the Memory Capacity of Neural Tissue , 2001, Neuron.

[12]  Shaista Hussain,et al.  Spike-timing dependent morphological learning for a neuron with nonlinear active dendrites , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[13]  D. Querlioz,et al.  Immunity to Device Variations in a Spiking Neural Network With Memristive Nanodevices , 2013, IEEE Transactions on Nanotechnology.

[14]  Subhrajit Roy,et al.  Liquid State Machine With Dendritically Enhanced Readout for Low-Power, Neuromorphic VLSI Implementations , 2014, IEEE Transactions on Biomedical Circuits and Systems.

[15]  N. V. Thakor,et al.  Bio-mimetic strategies for tactile sensing , 2013, 2013 IEEE SENSORS.

[16]  Arindam Basu,et al.  A Learning-Enabled Neuron Array IC Based Upon Transistor Channel Models of Biological Phenomena , 2013, IEEE Transactions on Biomedical Circuits and Systems.

[17]  Arindam Basu,et al.  Bifurcations in a silicon neuron , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[18]  Alain Destexhe,et al.  Tunable Neuromimetic Integrated System for Emulating Cortical Neuron Models , 2011, Front. Neurosci..

[19]  Kwabena Boahen,et al.  Synchrony in Silicon: The Gamma Rhythm , 2007, IEEE Transactions on Neural Networks.

[20]  Shaista Hussain,et al.  DELTRON: Neuromorphic architectures for delay based learning , 2012, 2012 IEEE Asia Pacific Conference on Circuits and Systems.

[21]  K. Roy,et al.  Spin-Based Neuron Model With Domain-Wall Magnets as Synapse , 2012, IEEE Transactions on Nanotechnology.

[22]  H. Sompolinsky,et al.  The tempotron: a neuron that learns spike timing–based decisions , 2006, Nature Neuroscience.

[23]  Sander M. Bohte,et al.  Error-backpropagation in temporally encoded networks of spiking neurons , 2000, Neurocomputing.

[24]  Andrzej J. Kasinski,et al.  Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification, and Spike Shifting , 2010, Neural Computation.

[25]  Narayan Srinivasa,et al.  A functional hybrid memristor crossbar-array/CMOS system for data storage and neuromorphic applications. , 2012, Nano letters.

[26]  Bernabé Linares-Barranco,et al.  Compact low-power calibration mini-DACs for neural arrays with programmable weights , 2003, IEEE Trans. Neural Networks.