Comparing Neuromorphic Solutions in Action: Implementing a Bio-Inspired Solution to a Benchmark Classification Task on Three Parallel-Computing Platforms

Neuromorphic computing employs models of neuronal circuits to solve computing problems. Neuromorphic hardware systems are now becoming more widely available and “neuromorphic algorithms” are being developed. As they are maturing toward deployment in general research environments, it becomes important to assess and compare them in the context of the applications they are meant to solve. This should encompass not just task performance, but also ease of implementation, speed of processing, scalability, and power efficiency. Here, we report our practical experience of implementing a bio-inspired, spiking network for multivariate classification on three different platforms: the hybrid digital/analog Spikey system, the digital spike-based SpiNNaker system, and GeNN, a meta-compiler for parallel GPU hardware. We assess performance using a standard hand-written digit classification task. We found that whilst a different implementation approach was required for each platform, classification performances remained in line. This suggests that all three implementations were able to exercise the model's ability to solve the task rather than exposing inherent platform limits, although differences emerged when capacity was approached. With respect to execution speed and power consumption, we found that for each platform a large fraction of the computing time was spent outside of the neuromorphic device, on the host machine. Time was spent in a range of combinations of preparing the model, encoding suitable input spiking data, shifting data, and decoding spike-encoded results. This is also where a large proportion of the total power was consumed, most markedly for the SpiNNaker and Spikey systems. We conclude that the simulation efficiency advantage of the assessed specialized hardware systems is easily lost in excessive host-device communication, or non-neuronal parts of the computation. These results emphasize the need to optimize the host-device communication architecture for scalability, maximum throughput, and minimum latency. Moreover, our results indicate that special attention should be paid to minimize host-device communication when designing and implementing networks for efficient neuromorphic computing.

[1]  Michael Schmuker,et al.  A neuromorphic network for generic multivariate data classification , 2014, Proceedings of the National Academy of Sciences.

[2]  Bernabé Linares-Barranco,et al.  ConvNets experiments on SpiNNaker , 2015, 2015 IEEE International Symposium on Circuits and Systems (ISCAS).

[3]  Johannes Schemmel,et al.  Reward-based learning under hardware constraints—using a RISC processor embedded in a neuromorphic substrate , 2013, Front. Neurosci..

[4]  Pierre Yger,et al.  PyNN: A Common Interface for Neuronal Network Simulators , 2008, Front. Neuroinform..

[5]  Gert Cauwenberghs,et al.  Neuromorphic Silicon Neuron Circuits , 2011, Front. Neurosci.

[6]  Marina Cole,et al.  Rapid processing of chemosensor transients in a neuromorphic implementation of the insect macroglomerular complex , 2012, Front. Neurosci..

[7]  E. Izhikevich Solving the distal reward problem through linkage of STDP and dopamine signaling , 2007, BMC Neuroscience.

[8]  K. Boahen Neuromorphic Microchips. , 2005, Scientific American.

[9]  Thomas Nowotny,et al.  Classifying chemical sensor data using GPU-accelerated bio-mimetic neuronal networks based on the insect olfactory system , 2014, BMC Neuroscience.

[10]  Florentin Wörgötter,et al.  Improved stability and convergence with three factor learning , 2007, Neurocomputing.

[11]  Steve B. Furber,et al.  The Leaky Integrate-and-Fire neuron: A platform for synaptic model exploration on the SpiNNaker chip , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[12]  Sergio Davies,et al.  PyNN on SpiNNaker Software 2015.004 , 2015 .

[13]  Steve B. Furber,et al.  A framework for plasticity implementation on the SpiNNaker neural architecture , 2015, Front. Neurosci..

[14]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[15]  Jim D. Garside,et al.  Overview of the SpiNNaker System Architecture , 2013, IEEE Transactions on Computers.

[16]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[17]  John R. Carlson,et al.  Coding of Odors by a Receptor Repertoire , 2006, Cell.

[18]  Luis A. Plana,et al.  SpiNNaker: Mapping neural networks onto a massively-parallel chip multiprocessor , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[19]  Nikolai F Rulkov,et al.  Modeling of spiking-bursting neural behavior using two-dimensional map. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[20]  Bahadir Kasap,et al.  Self-organized lateral inhibition improves odor classification in an olfaction-inspired network , 2013, BMC Neuroscience.

[21]  J. Knott The organization of behavior: A neuropsychological theory , 1951 .

[22]  Johannes Schemmel,et al.  Six Networks on a Universal Neuromorphic Computing Substrate , 2012, Front. Neurosci..

[23]  Barry J. Dickson,et al.  Molecular, Anatomical, and Functional Organization of the Drosophila Olfactory System , 2005, Current Biology.

[24]  Kei Ito,et al.  Organization of antennal lobe‐associated neurons in adult Drosophila melanogaster brain , 2012, The Journal of comparative neurology.

[25]  M. Heisenberg Mushroom body memoir: from maps to models , 2003, Nature Reviews Neuroscience.

[26]  Johannes Schemmel,et al.  Is a 4-Bit Synaptic Weight Resolution Enough? – Constraints on Enabling Spike-Timing Dependent Plasticity in Neuromorphic Hardware , 2012, Front. Neurosci..

[27]  Jennifer Hasler,et al.  Finding a roadmap to achieve large neuromorphic hardware systems , 2013, Front. Neurosci..

[28]  F. Han,et al.  Expression of amygdala mineralocorticoid receptor and glucocorticoid receptor in the single-prolonged stress rats , 2014, BMC Neuroscience.

[29]  Gisbert Schneider,et al.  Processing and classification of chemical data inspired by insect olfaction , 2007, Proceedings of the National Academy of Sciences.

[30]  Johannes Schemmel,et al.  A wafer-scale neuromorphic hardware system for large-scale neural modeling , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[31]  Thomas Nowotny,et al.  Flexible neuronal network simulation framework using code generation for NVidia® CUDA™ , 2011, BMC Neuroscience.

[32]  Murray Shanahan,et al.  Accelerated simulation of spiking neural networks using GPUs , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[33]  Markus Knaden,et al.  Decoding odor quality and intensity in the Drosophila brain , 2014, eLife.