Scalable simulation of rate-coded and spiking neural networks on shared memory systems

The size and complexity of the neural networks investigated in computational neuroscience are increasing, leading to a need for efficient neural simulation tools to support their development. Several neuro-simulators have been developed over the years by the community, all with different scopes (rate-coded, spiking, mean-field), target platforms (CPU, GPU, clusters) or modeling principles (fixed model library, code generation). We compare here the current version of the neuro-simulator ANNarchy against other state-of-the-art simulators on ratecoded and spiking benchmarks with a focus on their parallel performance.

[1]  Moritz Helias,et al.  Integration of Continuous-Time Dynamics in a Spiking Neural Network Simulator , 2016, Front. Neuroinform..

[2]  Nicholas T. Carnevale,et al.  Simulation of networks of spiking neurons: A review of tools and strategies , 2006, Journal of Computational Neuroscience.

[3]  Romain Brette,et al.  Equation-oriented specification of neural models for simulations , 2013, Front. Neuroinform..

[4]  Romain Brette,et al.  Philosophy of the Spike: Rate-Based vs. Spike-Based Theories of the Brain , 2015, Front. Syst. Neurosci..

[5]  Julien Vitay,et al.  ANNarchy: a code generation approach to neural simulations on parallel hardware , 2015, Front. Neuroinform..

[6]  Marc-Oliver Gewaltig,et al.  NEST (NEural Simulation Tool) , 2007, Scholarpedia.

[7]  Fred H Hamker,et al.  Comparison of GPU- and CPU-implementations of mean-firing rate neural networks on parallel hardware , 2012, Network.

[8]  Romain Brette,et al.  Simulating spiking neural networks on GPU , 2012, Network.

[9]  Wulfram Gerstner,et al.  Limits to high-speed simulations of spiking neural networks using general-purpose computers , 2014, Front. Neuroinform..

[10]  Thomas Nowotny,et al.  Brian2GeNN: a system for accelerating a large variety of spiking neural networks with graphics hardware , 2018, bioRxiv.

[11]  Bernhard Rumpe,et al.  Code Generation in Computational Neuroscience: A Review of Tools and Techniques , 2018, Front. Neuroinform..

[12]  Erik De Schutter,et al.  Draculab: A Python Simulator for Firing Rate Neural Networks With Delayed Adaptive Connections , 2019, Front. Neuroinform..

[13]  Thomas Nowotny,et al.  GeNN: a code generation framework for accelerated brain simulations , 2016, Scientific Reports.

[14]  Tim P Vogels,et al.  Signal Propagation and Logic Gating in Networks of Integrate-and-Fire Neurons , 2005, The Journal of Neuroscience.