Reservoir Transfer on Analog Neuromorphic Hardware

Analog, unclocked, spiking neuromorphic microchips open new perspectives for implantable or wearable biosensors and biocontrollers, due to their low energy consumption and heat dissipation. However, the challenges from a computational point of view are formidable. Here we outline our solutions to realize the reservoir computing paradigm on such hardware and address the combined problems of low bit resolution, device mismatch, approximate neuron models, and timescale mismatch. The main contribution is a computational scheme, called Reservoir Transfer, which enables us to transfer the dynamical properties of a well-performing neural network which has been optimized on a digital computer, onto neuromorphic hardware that displays the abovementioned problematic properties. Here we present a case study of implementing an ECG heartbeat abnormality detector to showcase the proposed method.

[1]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[2]  Hlaing Minn,et al.  A Patient-Adaptive Profiling Scheme for ECG Beat Classification , 2010, IEEE Transactions on Information Technology in Biomedicine.

[3]  J. Stark,et al.  Delay Embeddings for Forced Systems. I. Deterministic Forcing , 1999 .

[4]  Victor Pikov,et al.  Bioelectronic medicines: a research roadmap , 2014, Nature Reviews Drug Discovery.

[5]  Giacomo Indiveri,et al.  A Scalable Multicore Architecture With Heterogeneous Memory Structures for Dynamic Neuromorphic Asynchronous Processors (DYNAPs) , 2017, IEEE Transactions on Biomedical Circuits and Systems.

[6]  Song Han,et al.  Trained Ternary Quantization , 2016, ICLR.

[7]  G.B. Moody,et al.  The impact of the MIT-BIH Arrhythmia Database , 2001, IEEE Engineering in Medicine and Biology Magazine.

[8]  Herbert Jaeger,et al.  Echo state network , 2007, Scholarpedia.

[9]  David S. Broomhead,et al.  Delay Embeddings for Forced Systems. II. Stochastic Forcing , 2003, J. Nonlinear Sci..

[10]  Benjamin Schrauwen,et al.  Memory in linear recurrent neural networks in continuous time , 2010, Neural Networks.

[11]  G.G. Cano,et al.  An approach to cardiac arrhythmia analysis using hidden Markov models , 1990, IEEE Transactions on Biomedical Engineering.

[12]  Giovanni Bortolan,et al.  ECG classification with neural networks and cluster analysis , 1991, [1991] Proceedings Computers in Cardiology.

[13]  Surya Ganguli,et al.  Memory traces in dynamical systems , 2008, Proceedings of the National Academy of Sciences.

[14]  Giacomo Indiveri,et al.  Memory and Information Processing in Neuromorphic Systems , 2015, Proceedings of the IEEE.

[15]  A. M. Torres,et al.  An efficient method for ECG beat classification and correction of ectopic beats , 2016, Comput. Electr. Eng..

[16]  Wilten Nicola,et al.  Supervised learning in spiking neural networks with FORCE training , 2016, Nature Communications.

[17]  W.J. Tompkins,et al.  A patient-adaptable ECG beat classifier using a mixture of experts approach , 1997, IEEE Transactions on Biomedical Engineering.

[18]  Gregory T. A. Kovacs,et al.  Robust Neural-Network-Based Classification of Premature Ventricular Contractions Using Wavelet Transform and Timing Interval Features , 2006, IEEE Transactions on Biomedical Engineering.

[19]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[20]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[21]  Mehmet Korürek,et al.  ECG beat classification using particle swarm optimization and radial basis function neural network , 2010, Expert Syst. Appl..

[22]  Narayanan Vijaykrishnan,et al.  Always-On Speech Recognition Using TrueNorth, a Reconfigurable, Neurosynaptic Processor , 2017, IEEE Transactions on Computers.

[23]  Moncef Gabbouj,et al.  Real-Time Patient-Specific ECG Classification by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Biomedical Engineering.

[24]  Romain Brette,et al.  The Brian Simulator , 2009, Front. Neurosci..