Neuromorphic computing for temporal scientific data classification

In this work, we apply a spiking neural network model and an associated memristive neuromorphic implementation to an application in classifying temporal scientific data. We demonstrate that the spiking neural network model achieves comparable results to a previously reported convolutional neural network model, with significantly fewer neurons and synapses required.

[1]  Farnood Merrikh-Bayat,et al.  Training and operation of an integrated neuromorphic network based on metal-oxide memristors , 2014, Nature.

[2]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[3]  Ryad Benosman,et al.  Real-time event-driven spiking neural network object recognition on the SpiNNaker platform , 2015, 2015 IEEE International Symposium on Circuits and Systems (ISCAS).

[4]  Vincenzo Conti,et al.  Efficient MLP digital implementation on FPGA , 2005, 8th Euromicro Conference on Digital System Design (DSD'05).

[5]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[6]  Chiara Bartolozzi,et al.  What Can Neuromorphic Event-Driven Precise Timing Add to Spike-Based Pattern Recognition? , 2015, Neural Computation.

[7]  A. Dell'Acqua,et al.  Geant4 - A simulation toolkit , 2003 .

[8]  Yu Chen,et al.  Polymer memristor for information storage and neuromorphic applications , 2014 .

[9]  Nikola Kasabov,et al.  Dynamic evolving spiking neural networks for on-line spatio- and spectro-temporal pattern recognition. , 2013, Neural networks : the official journal of the International Neural Network Society.

[10]  V.P. Plagianakos,et al.  Spiking neural network training using evolutionary algorithms , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[11]  Wolfgang Maass,et al.  Networks of Spiking Neurons: The Third Generation of Neural Network Models , 1996, Electron. Colloquium Comput. Complex..

[12]  Catherine D. Schuman,et al.  Spatiotemporal Classification Using Neuroscience-Inspired Dynamic Architectures , 2014, BICA.

[13]  Cory Merkel,et al.  Design and Analysis of a Neuromemristive Reservoir Computing Architecture for Biosignal Processing , 2016, Front. Neurosci..

[14]  T. Serrano-Gotarredona,et al.  STDP and STDP variations with memristors for spiking neuromorphic learning systems , 2013, Front. Neurosci..

[15]  Catherine D. Schuman,et al.  Visual analytics for neuroscience-inspired dynamic architectures , 2014, 2014 IEEE Symposium on Foundations of Computational Intelligence (FOCI).

[16]  Victor Erokhin,et al.  Bio-inspired adaptive networks based on organic memristors , 2010, Nano Commun. Networks.

[17]  Steven R. Young,et al.  Vertex reconstruction of neutrino interactions using deep learning , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[18]  Stefano Fusi,et al.  Hebbian spike-driven synaptic plasticity for learning patterns of mean firing rates , 2002, Biological Cybernetics.

[19]  R. Hatcher,et al.  The GENIE * Neutrino Monte Carlo Generator , 2009, 0905.2517.

[20]  Mark E. Dean,et al.  A VLSI Design for Neuromorphic Computing , 2016, 2016 IEEE Computer Society Annual Symposium on VLSI (ISVLSI).

[21]  A. Dell'Acqua,et al.  Geant4—a simulation toolkit , 2003 .

[22]  Bernabé Linares-Barranco,et al.  Memristance can explain Spike-Time-Dependent-Plasticity in Neural Synapses , 2009 .

[23]  Patrick Garda,et al.  Fast triggering in high-energy physics experiments using hardware neural networks , 2003, IEEE Trans. Neural Networks.

[24]  Andres Upegui,et al.  An FPGA platform for on-line topology exploration of spiking neural networks , 2005, Microprocess. Microsystems.

[25]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[26]  Benjamin Schrauwen,et al.  Compact hardware liquid state machines on FPGA for real-time speech recognition , 2008, Neural Networks.

[27]  Catherine D. Schuman,et al.  DANNA: A neuromorphic software ecosystem ☆ , 2016, BICA 2016.

[28]  Gang Pan,et al.  Darwin: a neuromorphic hardware co-processor based on Spiking Neural Networks , 2015, Science China Information Sciences.

[29]  G. N. Perdue,et al.  Design, calibration, and performance of the MINERvA detector , 2013, 1305.5199.

[30]  Sander M. Bohte,et al.  Error-backpropagation in temporally encoded networks of spiking neurons , 2000, Neurocomputing.

[31]  Bernard Brezzo,et al.  TrueNorth: Design and Tool Flow of a 65 mW 1 Million Neuron Programmable Neurosynaptic Chip , 2015, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[32]  Ammar Belatreche,et al.  Challenges for large-scale implementations of spiking neural networks on FPGAs , 2007, Neurocomputing.

[33]  Jianguo Xin,et al.  Supervised learning with spiking neural networks , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[34]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[35]  Catherine D. Schuman,et al.  Parallel Evolutionary Optimization for Neuromorphic Network Training , 2016, 2016 2nd Workshop on Machine Learning in HPC Environments (MLHPC).

[36]  Nicholas Soures,et al.  Digital neuromorphic design of a Liquid State Machine for real-time processing , 2016, 2016 IEEE International Conference on Rebooting Computing (ICRC).

[37]  Catherine D. Schuman,et al.  A CAD System for Exploring Neuromorphic Computing with Emerging Technologies , 2017 .

[38]  Catherine D. Schuman,et al.  An evolutionary optimization framework for neural networks and neuromorphic architectures , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).