Three Tools for the Real-Time Simulation of Embodied Spiking Neural Networks Using GPUs

This paper presents a toolbox of solutions that enable the user to construct biologically-inspired spiking neural networks with tens of thousands of neurons and millions of connections that can be simulated in real time, visualized in 3D and connected to robots and other devices. NeMo is a high performance simulator that works with a variety of neural and oscillator models and performs parallel simulations on either GPUs or multi-core processors. SpikeStream is a visualization and analysis environment that works with NeMo and can construct networks, store them in a database and visualize their activity in 3D. The iSpike library provides biologically-inspired conversion between real data and spike representations to support work with robots, such as the iCub. Each of the tools described in this paper can be used independently with other software, and they also work well together.

[1]  Rob Knight,et al.  ECCE1: The first of a series of anthropomimetic musculoskeletal upper torsos , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[2]  Pierre Yger,et al.  PyNN: A Common Interface for Neuronal Network Simulators , 2008, Front. Neuroinform..

[3]  C. Enroth-Cugell,et al.  The contrast sensitivity of retinal ganglion cells of the cat , 1966, The Journal of physiology.

[4]  Örjan Ekeberg,et al.  Brain-scale simulation of the neocortex on the IBM Blue Gene/L supercomputer , 2008, IBM J. Res. Dev..

[5]  D. Robinson.  The mechanics of human saccadic eye movement , 1964, The Journal of physiology.

[6]  Murray Shanahan,et al.  NeMo: A Platform for Neural Modelling of Spiking Neurons Using GPUs , 2009, 2009 20th IEEE International Conference on Application-specific Systems, Architectures and Processors.

[7]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[8]  Simon R. Schultz,et al.  A parallel spiking neural network simulator , 2009, 2009 International Conference on Field-Programmable Technology.

[9]  Mirko Farina.  Supersizing the Mind: Embodiment, Action and Cognitive Extension. , 2010 .

[10]  Hiroyuki Shinoda,et al.  A Sensitive Skin Based on Touch-Area-Evaluating Tactile Elements , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[11]  Örjan Ekeberg,et al.  Large Neural Network Simulations on Multiple Hardware Platforms , 1997, Journal of Computational Neuroscience.

[12]  Tobi Delbrück,et al.  Using FPGA for visuo-motor control with a silicon retina and a humanoid robot , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[13]  Thomas Parisini,et al.  INTERNATIONAL SYMPOSIUM ON INTELLIGENT CONTROL , 2009 .

[14]  S. Gandevia,et al.  Cutaneous receptors contribute to kinesthesia at the index finger, elbow, and knee. , 2005, Journal of neurophysiology.

[15]  Tim P Vogels,et al.  Signal Propagation and Logic Gating in Networks of Integrate-and-Fire Neurons , 2005, The Journal of Neuroscience.

[16]  Ammar Belatreche,et al.  Challenges for large-scale implementations of spiking neural networks on FPGAs , 2007, Neurocomputing.

[17]  Leon Reznik,et al.  GPU-based simulation of spiking neural networks with real-time performance & high accuracy , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[18]  D. McCloskey,et al.  The role of joint receptors in human kinaesthesia when intramuscular receptors cannot contribute. , 1987, The Journal of physiology.

[19]  Murray Shanahan,et al.  How well do oscillator models capture the behaviour of biological neurons? , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[20]  Yoshiki Kuramoto,et al.  Chemical Oscillations, Waves, and Turbulence , 1984, Springer Series in Synergetics.

[21]  Romain Brette,et al.  The Brian Simulator , 2009, Front. Neurosci..

[22]  A. Ijspeert,et al.  From Swimming to Walking with a Salamander Robot Driven by a Spinal Cord Model , 2007, Science.

[23]  S. Grillner,et al.  Mechanisms for selection of basic motor programs – roles for the striatum and pallidum , 2005, Trends in Neurosciences.

[24]  Rob Knight,et al.  Two Simulation Tools for Biologically Inspired Virtual Robotics , 2006 .

[25]  Wayne Luk,et al.  FPGA Accelerated Simulation of Biologically Plausible Spiking Neural Networks , 2009, 2009 17th IEEE Symposium on Field Programmable Custom Computing Machines.

[26]  Paul F. M. J. Verschure,et al.  iqr: A Tool for the Construction of Multi-level Simulations of Brain and Behaviour , 2010, Neuroinformatics.

[27]  David Gamez,et al.  Information integration based predictions about the conscious states of a spiking neural network , 2010, Consciousness and Cognition.

[28]  Eric L. Schwartz,et al.  Computational anatomy and functional architecture of striate cortex: A spatial mapping approach to perceptual coding , 1980, Vision Research.

[29]  James M. Bower,et al.  The GENESIS Simulation System , 2003 .

[30]  I. Aleksander.  The World in My Mind, My Mind in the World: Key Mechanisms of Consciousness in People, Animals and Machines , 2005 .

[31]  B. Edin,et al.  Skin strain patterns provide kinaesthetic information to the human central nervous system. , 1995, The Journal of physiology.

[32]  Richard F. Lyon,et al.  A computational model of filtering, detection, and compression in the cochlea , 1982, ICASSP.

[33]  D. F. Collins,et al.  Movement illusions evoked by ensemble cutaneous input from the dorsum of the human hand. , 1996, The Journal of physiology.

[34]  D. Burke,et al.  Perceptual responses to microstimulation of single afferents innervating joints, muscles and skin of the human hand. , 1990, The Journal of physiology.

[35]  David Gamez,et al.  A neuronal global workspace for human-like control of a computer game character , 2011, 2011 IEEE Conference on Computational Intelligence and Games (CIG'11).

[36]  Nikil D. Dutt,et al.  An Efficient Simulation Environment for Modeling Large-Scale Cortical Processing , 2011, Front. Neuroinform..

[37]  Frédéric Albert,et al.  Proprioceptive population coding of limb position in humans , 2003, Experimental Brain Research.

[38]  Mikael Bergenheim,et al.  Proprioceptive population coding of two-dimensional limb movements in humans: II. Muscle-spindle feedback during "drawing-like" movements , 2000, Experimental Brain Research.

[39]  Renaud Keriven,et al.  Spiking Neurons on GPUs , 2006, International Conference on Computational Science.

[40]  Giulio Sandini,et al.  The iCub humanoid robot: an open platform for research in embodied cognition , 2008, PerMIS.

[41]  Giorgio Metta,et al.  Towards long-lived robot genes , 2008, Robotics Auton. Syst..

[42]  Huosheng Hu,et al.  Biologically inspired behaviour design for autonomous robotic fish , 2006, Int. J. Autom. Comput..

[43]  Nikil D. Dutt,et al.  A configurable simulation environment for the efficient simulation of large-scale spiking neural networks on graphics processors , 2009, Neural Networks.

[44]  E. Thompson,et al.  Are There Neural Correlates of Consciousness , 2004 .

[45]  Olaf Sporns,et al.  Brain connectivity , 2007, Scholarpedia.

[46]  Nicholas T. Carnevale,et al.  Simulation of networks of spiking neurons: A review of tools and strategies , 2006, Journal of Computational Neuroscience.

[47]  Marc-Oliver Gewaltig,et al.  NEST (NEural Simulation Tool) , 2007, Scholarpedia.

[48]  Steve B. Furber,et al.  Concurrent heterogeneous neural model simulation on real-time neuromimetic hardware , 2011, Neural Networks.

[49]  Nicholas T. Carnevale,et al.  The NEURON Book: Epilogue , 2006 .

[50]  Anthony S. Maida,et al.  Using parallel GPU architecture for simulation of planar I/F networks , 2009, 2009 International Joint Conference on Neural Networks.

[51]  Martin D. Levine,et al.  A Review of Biologically Motivated Space-Variant Data Reduction Models for Robotic Vision , 1998, Comput. Vis. Image Underst..

[52]  O. Sporns,et al.  Mapping the Structural Core of Human Cerebral Cortex , 2008, PLoS biology.

[53]  Giulio Sandini,et al.  An embedded artificial skin for humanoid robots , 2008, 2008 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[54]  Tarek M. Taha,et al.  Neuromorphic models on a GPGPU cluster , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[55]  Jean-Pierre Roll,et al.  Proprioceptive population coding of two-dimensional limb movements in humans: I. Muscle spindle feedback during spatially oriented movements , 2000, Experimental Brain Research.

[56]  Kwabena Boahen,et al.  A 48,000 pixel, 590,000 transistor silicon retina in current-mode subthreshold CMOS , 1994, Proceedings of 1994 37th Midwest Symposium on Circuits and Systems.

[57]  D Gamez,et al.  iSpike: a spiking neural interface for the iCub robot , 2012, Bioinspiration & biomimetics.

[58]  R. Douglas,et al.  A Quantitative Map of the Circuit of Cat Primary Visual Cortex , 2004, The Journal of Neuroscience.

[59]  Gert Cauwenberghs,et al.  Neuromorphic Silicon Neuron Circuits , 2011, Front. Neurosci.

[60]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[61]  Wulfram Gerstner,et al.  Phenomenological models of synaptic plasticity based on spike timing , 2008, Biological Cybernetics.

[62]  Murray Shanahan,et al.  Training a spiking neural network to control a 4-DoF robotic arm based on Spike Timing-Dependent Plasticity , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[63]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[64]  Romain Brette,et al.  Brian Hears: Online Auditory Processing Using Vectorization Over Channels , 2011, Front. Neuroinform..

[65]  Bernhard Hellwig,et al.  A quantitative analysis of the local connectivity between pyramidal neurons in layers 2/3 of the rat visual cortex , 2000, Biological Cybernetics.

[66]  Dan F. M. Goodman.  Code Generation: A Strategy for Neural Network Simulators , 2010, Neuroinformatics.

[67]  Igor Aleksander,et al.  Accuracy and performance of the state-based Φ and liveliness measures of information integration , 2011, Consciousness and Cognition.

[68]  Murray Shanahan,et al.  Accelerated simulation of spiking neural networks using GPUs , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[69]  A. Clark.  Supersizing the Mind , 2008 .

[70]  Thomas Nowotny,et al.  Flexible neuronal network simulation framework using code generation for NVidia® CUDA™ , 2011, BMC Neuroscience.

[71]  H. Kornhuber,et al.  Natural and drug-induced variations of velocity and duration of human saccadic eye movements: Evidence for a control of the neural pulse generator by local feedback , 2004, Biological Cybernetics.

[72]  H. Markram.  The Blue Brain Project , 2006, Nature Reviews Neuroscience.

[73]  David Gamez.  SpikeStream: A Fast and Flexible Simulator of Spiking Neural Networks , 2007, ICANN.

[74]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[75]  Gerald M Edelman,et al.  Characterizing functional hippocampal pathways in a brain-based device as it solves a spatial memory task. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[76]  Dharmendra S. Modha,et al.  The cat is out of the bag: cortical simulations with 109 neurons, 1013 synapses , 2009, Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis.

[77]  Frédéric Albert,et al.  “Proprioceptive signature” of cursive writing in humans: a multi-population coding , 2004, Experimental Brain Research.

[78]  A B Vallbo,et al.  Directional tuning of human forearm muscle afferents during voluntary wrist movements , 2001, The Journal of physiology.

[79]  Johannes Schemmel,et al.  A wafer-scale neuromorphic hardware system for large-scale neural modeling , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[80]  G. Tononi.  Consciousness as Integrated Information: a Provisional Manifesto , 2008, The Biological Bulletin.

[81]  K. Grill-Spector,et al.  The human visual cortex. , 2004, Annual review of neuroscience.

[82]  Timothée Masquelier,et al.  Unsupervised Learning of Visual Features through Spike Timing Dependent Plasticity , 2007, PLoS Comput. Biol..

[83]  G. Edelman,et al.  Large-scale model of mammalian thalamocortical systems , 2008, Proceedings of the National Academy of Sciences.