Simulating spiking neural networks on GPU

Modern graphics cards contain hundreds of cores that can be programmed for intensive calculations. They are beginning to be used for spiking neural network simulations. The goal is to make parallel simulation of spiking neural networks available to a large audience, without the requirements of a cluster. We review the ongoing efforts towards this goal, and we outline the main difficulties.

[1]  Vivek K. Pallipuram,et al.  Acceleration of spiking neural networks in emerging multi-core and GPU architectures , 2010, 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW).

[2]  A. F. Adams,et al.  The Survey , 2021, Dyslexia in Higher Education.

[3]  David P. Nickerson,et al.  An overview of the CellML API and its implementation , 2010, BMC Bioinformatics.

[4]  Tarek M. Taha,et al.  Neuromorphic models on a GPGPU cluster , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[5]  Arash Ahmadi,et al.  A GPU based simulation of multilayer spiking neural networks , 2011, 2011 19th Iranian Conference on Electrical Engineering.

[6]  Jens H. Krüger,et al.  A Survey of General‐Purpose Computation on Graphics Hardware , 2007, Eurographics.

[7]  Ruggero Scorcioni,et al.  GPGPU implementation of a synaptically optimized, anatomically accurate spiking network simulator , 2010, 2010 Biomedical Sciences and Engineering Conference.

[8]  CatanzaroBryan,et al.  PyCUDA and PyOpenCL , 2012 .

[9]  Sander Bohte,et al.  Streaming parallel GPU acceleration of large-scale filter-based spiking neural networks , 2012, Network.

[10]  Nicolas Pinto,et al.  PyCUDA: GPU Run-Time Code Generation for High-Performance Computing , 2009, ArXiv.

[11]  Murray Shanahan,et al.  Accelerated simulation of spiking neural networks using GPUs , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[12]  Tomaso Poggio,et al.  CNS: a GPU-based framework for simulating cortically-organized networks , 2010 .

[13]  Nicholas T. Carnevale,et al.  Expanding NEURON's Repertoire of Mechanisms with NMODL , 2000, Neural Computation.

[14]  Renaud Keriven,et al.  Spiking Neurons on GPUs , 2006, International Conference on Computational Science.

[15]  Nicholas T. Carnevale,et al.  Simulation of networks of spiking neurons: A review of tools and strategies , 2006, Journal of Computational Neuroscience.

[16]  Bertrand Fontaine,et al.  Fitting Neuron Models to Spike Trains , 2011, Front. Neurosci..

[17]  Nicolas Pinto,et al.  PyCUDA and PyOpenCL: A scripting-based approach to GPU run-time code generation , 2009, Parallel Comput..

[18]  Michael Garland,et al.  Implementing sparse matrix-vector multiplication on throughput-oriented processors , 2009, Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis.

[19]  M C Kohn,et al.  SCoP: an interactive simulation control program for micro- and minicomputers. , 1986, Bulletin of mathematical biology.

[20]  Thomas Nowotny,et al.  Flexible neuronal network simulation framework using code generation for NVidia® CUDA™ , 2011, BMC Neuroscience.

[21]  R. San Martin,et al.  Cellular Neural Networks simulation on a parallel graphics processing unit , 2008, 2008 11th International Workshop on Cellular Neural Networks and Their Applications.

[22]  Romain Brette,et al.  Neuroinformatics Original Research Article Brian: a Simulator for Spiking Neural Networks in Python , 2022 .

[23]  Nikil D. Dutt,et al.  Efficient simulation of large-scale Spiking Neural Networks using CUDA graphics processors , 2009, 2009 International Joint Conference on Neural Networks.

[24]  Wulfram Gerstner,et al.  Spiking Neuron Models , 2002 .

[25]  Romain Brette,et al.  The Brian Simulator , 2009, Front. Neurosci..

[26]  Cyrille Rossant,et al.  Automatic Fitting of Spiking Neuron Models to Electrophysiological Recordings , 2010, Front. Neuroinform..

[27]  Lazaros S. Iliadis,et al.  Artificial Neural Networks - ICANN 2010 - 20th International Conference, Thessaloniki, Greece, September 15-18, 2010, Proceedings, Part I , 2010, International Conference on Artificial Neural Networks.

[28]  Micheal V. Mascagni.  Numerical methods for neuronal modeling , 1989 .

[29]  Nikil D. Dutt,et al.  An Efficient Simulation Environment for Modeling Large-Scale Cortical Processing , 2011, Front. Neuroinform..

[30]  Nicolas Pinto,et al.  GPU Metaprogramming: A Case Study in Biologically Inspired Machine Vision , 2012 .

[31]  Michael L. Hines,et al.  NeuroML: A Language for Describing Data Driven Models of Neurons and Networks with a High Degree of Biological Detail , 2010, PLoS Comput. Biol..

[32]  Michael L. Hines,et al.  The NEURON Book , 2006 .

[33]  Dan F. M. Goodman.  Code Generation: A Strategy for Neural Network Simulators , 2010, Neuroinformatics.

[34]  A. Roli.  Artificial Neural Networks , 2012, Lecture Notes in Computer Science.

[35]  Murray Shanahan,et al.  NeMo: A Platform for Neural Modelling of Spiking Neurons Using GPUs , 2009, 2009 20th IEEE International Conference on Application-specific Systems, Architectures and Processors.

[36]  Michael Mascagni,et al.  A parallelizing algorithm for computing solutions to arbitrarily branched cable neuron models , 1991, Journal of Neuroscience Methods.

[37]  Tomoki Fukai,et al.  Real-time simulation of a spiking neural network model of the basal ganglia circuitry using general purpose computing on graphics processing units , 2011, Neural Networks.

[38]  Nikil D. Dutt,et al.  A configurable simulation environment for the efficient simulation of large-scale spiking neural networks on graphics processors , 2009, Neural Networks.

[39]  Martin Bogdan,et al.  Simulating Biological-Inspired Spiking Neural Networks with OpenCL , 2010, ICANN.

[40]  Robert Clewley,et al.  NineML: the network interchange for neuroscience modeling language , 2011, BMC Neuroscience.

[41]  Leon Reznik,et al.  GPU-based simulation of spiking neural networks with real-time performance & high accuracy , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[42]  Yao Zhang,et al.  Fast tridiagonal solvers on the GPU , 2010, PPoPP '10.

[43]  Rodrigo Weber dos Santos,et al.  CellML and associated tools and techniques , 2008, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[44]  Tarek M Taha,et al.  Acceleration of spiking neural network based pattern recognition on NVIDIA graphics processors. , 2010, Applied optics.

[45]  J. Mark Bull,et al.  Benchmarking Java against C and Fortran for scientific applications , 2001, JGI '01.

[46]  Peng Li,et al.  Simulation of large neuronal networks with biophysically accurate models on graphics processors , 2011, The 2011 International Joint Conference on Neural Networks.