Simulation Neurotechnologies for Advancing Brain Research: Parallelizing Large Networks in NEURON

Large multiscale neuronal network simulations are of increasing value as more big data are gathered about brain wiring and organization under the auspices of a current major research initiative, such as Brain Research through Advancing Innovative Neurotechnologies. The development of these models requires new simulation technologies. We describe here the current use of the NEURON simulator with message passing interface (MPI) for simulation in the domain of moderately large networks on commonly available high-performance computers (HPCs). We discuss the basic layout of such simulations, including the methods of simulation setup, the run-time spike-passing paradigm, and postsimulation data storage and data management approaches. Using the Neuroscience Gateway, a portal for computational neuroscience that provides access to large HPCs, we benchmark simulations of neuronal networks of different sizes (500–100,000 cells), and using different numbers of nodes (1–256). We compare three types of networks, composed of either Izhikevich integrate-and-fire neurons (I&F), single-compartment Hodgkin-Huxley (HH) cells, or a hybrid network with half of each. Results show simulation run time increased approximately linearly with network size and decreased almost linearly with the number of nodes. Networks with I&F neurons were faster than HH networks, although differences were small since all tested cells were point neurons with a single compartment.

[1]  Tadashi Yamazaki,et al.  Simulation Platform: A cloud-based online simulation environment , 2011, Neural Networks.

[2]  Paul R. Calder,et al.  Composing user interfaces with InterViews , 1989, Computer.

[3]  Pierre Yger,et al.  PyNN: A Common Interface for Neuronal Network Simulators , 2008, Front. Neuroinform..

[4]  Nicholas T. Carnevale,et al.  The NEURON Book: Epilogue , 2006 .

[5]  Nicholas T. Carnevale,et al.  Early experiences in developing and managing the neuroscience gateway , 2015, Concurr. Comput. Pract. Exp..

[6]  Michael L. Hines,et al.  Neuron splitting in compute-bound parallel network simulations enables runtime scaling with twice as many processors , 2008, Journal of Computational Neuroscience.

[7]  William W Lytton,et al.  Data mining through simulation. , 2007, Methods in molecular biology.

[8]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[9]  William W. Lytton,et al.  Reproducibility in Computational Neuroscience Models and Simulations , 2016, IEEE Transactions on Biomedical Engineering.

[10]  Oliver Schmitt,et al.  neuroVIISAS: Approaching Multiscale Simulation of the Rat Connectome , 2012, Neuroinformatics.

[11]  Michael L. Hines,et al.  Neuroinformatics Original Research Article Neuron and Python , 2022 .

[12]  Wulfram Gerstner,et al.  Limits to high-speed simulations of spiking neural networks using general-purpose computers , 2014, Front. Neuroinform..

[13]  Nicholas T. Carnevale,et al.  Discrete event simulation in the NEURON environment , 2004, Neurocomputing.

[14]  Örjan Ekeberg,et al.  Run-Time Interoperability Between Neuronal Network Simulators Based on the MUSIC Framework , 2010, Neuroinformatics.

[15]  Ivan Soltesz,et al.  Quantitative assessment of CA1 local circuits: Knowledge base for interneuron‐pyramidal cell connectivity , 2013, Hippocampus.

[16]  Marc-Oliver Gewaltig,et al.  NEST (NEural Simulation Tool) , 2007, Scholarpedia.

[17]  James R Faeder,et al.  Efficient modeling, simulation and coarse-graining of biological complexity with NFsim , 2011, Nature Methods.

[18]  Eugene M. Izhikevich,et al.  Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting , 2006 .

[19]  Michael L. Hines,et al.  Comparison of neuronal spike exchange methods on a Blue Gene/P supercomputer , 2011, Front. Comput. Neurosci..

[20]  Michael L. Hines,et al.  Reaction-diffusion in the NEURON simulator , 2013, Front. Neuroinform..

[21]  D. Contreras,et al.  Dynamic interactions determine partial thalamic quiescence in a computer network model of spike-and-wave seizures. , 1997, Journal of neurophysiology.

[22]  N. T. Carnevale,et al.  Translating network models to parallel hardware in NEURON , 2008, Journal of Neuroscience Methods.

[23]  Anders M. Dale,et al.  Towards effective and rewarding data sharing , 2003, Neuroinformatics.

[24]  W.W. Lytton,et al.  Hybrid neural networks - combining abstract and realistic neural units , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[25]  Michael L. Hines,et al.  Independent Variable Time-Step Integration of Individual Neurons for Network Simulations , 2005, Neural Computation.

[26]  Michael L. Hines,et al.  The virtual slice setup , 2008, Journal of Neuroscience Methods.

[27]  Nicholas T. Carnevale,et al.  Introducing The Neuroscience Gateway , 2013, IWSG.

[28]  M L Hines,et al.  Neuron: A Tool for Neuroscientists , 2001, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[29]  Upinder S. Bhalla,et al.  PyMOOSE: Interoperable Scripting in Python for MOOSE , 2008, Frontiers in neuroinformatics.

[30]  Mark A. Moraes,et al.  Parallel random numbers: As easy as 1, 2, 3 , 2011, 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC).

[31]  Nicholas T. Carnevale,et al.  Simulation of networks of spiking neurons: A review of tools and strategies , 2006, Journal of Computational Neuroscience.

[32]  Tomoki Fukai,et al.  Supercomputers Ready for Use as Discovery Machines for Neuroscience , 2012, Front. Neuroinform..

[33]  James M. Bower,et al.  Python as a Federation Tool for GENESIS 3.0 , 2012, PloS one.

[34]  William W Lytton,et al.  Neural query system , 2007, Neuroinformatics.

[35]  Andrew P. Davison,et al.  Efficient generation of connectivity in neuronal networks from simulator-independent descriptions , 2014, Front. Neuroinform..

[36]  Romain Brette,et al.  The Brian Simulator , 2009, Front. Neurosci..

[37]  Moritz Helias,et al.  Neuroinformatics Original Research Article Pynest: a Convenient Interface to the Nest Simulator , 2022 .

[38]  Michael L. Hines,et al.  Parallel network simulations with NEURON , 2006, Journal of Computational Neuroscience.

[39]  Thomas M. Morse,et al.  Model structure analysis in NEURON : toward interoperability among neural simulators. , 2007, Methods in molecular biology.

[40]  Michael L. Hines,et al.  Trends in Programming Languages for Neuroscience Simulations , 2009, Front. Neurosci..