Accelerating Brain Simulations on Graphical Processing Units

NEural Simulation Tool(NEST) is a large scale spiking neuronal network simulator of the brain. In this work, we present a CUDA® implementation of NEST. We were able to gain a speedup of factor 20 for the computational parts of NEST execution using a different data structure than NEST's default. Our partial implementation shows the potential gains and limitations of such possible port. We discuss possible novel approaches to be able to adapt generic spiking neural network simulators such as NEST to run on commodity or high-end GPGPUs.

[1]  Wolfram Schenck,et al.  Performance Model for Large – Scale Neural Simulations with NEST , 2014 .

[2]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[3]  Moritz Helias,et al.  Neuroinformatics Original Research Article Pynest: a Convenient Interface to the Nest Simulator , 2022 .

[4]  Murray Shanahan,et al.  Accelerated simulation of spiking neural networks using GPUs , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[5]  Michael L. Hines,et al.  The NEURON Book , 2006 .

[6]  Narayan Srinivasa,et al.  HRLSim: A High Performance Spiking Neural Network Simulator for GPGPU Clusters , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[7]  James M. Bower,et al.  The Book of GENESIS , 1994, Springer New York.

[8]  Pierre Yger,et al.  PyNN: A Common Interface for Neuronal Network Simulators , 2008, Front. Neuroinform..

[9]  Marc-Oliver Gewaltig,et al.  NEST by Example: An Introduction to the Neural Simulation Tool NEST , 2012 .

[10]  Romain Brette,et al.  Simulating spiking neural networks on GPU , 2012, Network.

[11]  Tomoki Fukai,et al.  Spiking network simulation code for petascale computers , 2014, Front. Neuroinform..

[12]  Ruggero Scorcioni,et al.  GPGPU implementation of a synaptically optimized, anatomically accurate spiking network simulator , 2010, 2010 Biomedical Sciences and Engineering Conference.

[13]  Markus Diesmann,et al.  Meeting the Memory Challenges of Brain-Scale Network Simulation , 2012, Front. Neuroinform..

[14]  Marc-Oliver Gewaltig,et al.  NEST (NEural Simulation Tool) , 2007, Scholarpedia.