A Spiking Neural Network Model of the Lateral Geniculate Nucleus on the SpiNNaker Machine

We present a spiking neural network model of the thalamic Lateral Geniculate Nucleus (LGN) developed on SpiNNaker, which is a state-of-the-art digital neuromorphic hardware built with very-low-power ARM processors. The parallel, event-based data processing in SpiNNaker makes it viable for building massively parallel neuro-computational frameworks. The LGN model has 140 neurons representing a “basic building block” for larger modular architectures. The motivation of this work is to simulate biologically plausible LGN dynamics on SpiNNaker. Synaptic layout of the model is consistent with biology. The model response is validated with existing literature reporting entrainment in steady state visually evoked potentials (SSVEP)—brain oscillations corresponding to periodic visual stimuli recorded via electroencephalography (EEG). Periodic stimulus to the model is provided by: a synthetic spike-train with inter-spike-intervals in the range 10–50 Hz at a resolution of 1 Hz; and spike-train output from a state-of-the-art electronic retina subjected to a light emitting diode flashing at 10, 20, and 40 Hz, simulating real-world visual stimulus to the model. The resolution of simulation is 0.1 ms to ensure solution accuracy for the underlying differential equations defining Izhikevichs neuron model. Under this constraint, 1 s of model simulation time is executed in 10 s real time on SpiNNaker; this is because simulations on SpiNNaker work in real time for time-steps dt ⩾ 1 ms. The model output shows entrainment with both sets of input and contains harmonic components of the fundamental frequency. However, suppressing the feed-forward inhibition in the circuit produces subharmonics within the gamma band (>30 Hz) implying a reduced information transmission fidelity. These model predictions agree with recent lumped-parameter computational model-based predictions, using conventional computers. Scalability of the framework is demonstrated by a multi-node architecture consisting of three “nodes,” where each node is the “basic building block” LGN model. This 420 neuron model is tested with synthetic periodic stimulus at 10 Hz to all the nodes. The model output is the average of the outputs from all nodes, and conforms to the above-mentioned predictions of each node. Power consumption for model simulation on SpiNNaker is ≪1 W.

[1]  Neslihan Serap Sengör,et al.  A computational model to investigate the effect of dopamine on neural synchronization in striatum , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[2]  S. Sherman.  Tonic and burst firing: dual modes of thalamocortical relay , 2001, Trends in Neurosciences.

[3]  Steve B. Furber,et al.  Accuracy and Efficiency in Fixed-Point Neural ODE Solvers , 2015, Neural Computation.

[4]  Pierre Yger,et al.  PyNN: A Common Interface for Neuronal Network Simulators , 2008, Front. Neuroinform..

[5]  Russell Anderson,et al.  A Multiscale “Working Brain” Model , 2015 .

[6]  H. Markram.  The Blue Brain Project , 2006, Nature Reviews Neuroscience.

[7]  S. Joshi,et al.  65k-neuron integrate-and-fire array transceiver with address-event reconfigurable synaptic routing , 2012, 2012 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[8]  Jim D. Garside,et al.  Overview of the SpiNNaker System Architecture , 2013, IEEE Transactions on Computers.

[9]  T. Delbruck,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < 1 , 2022 .

[10]  Pablo F. Diez,et al.  Asynchronous BCI control using high-frequency SSVEP , 2011, Journal of NeuroEngineering and Rehabilitation.

[11]  Steve B. Furber,et al.  Large-Scale Simulations of Plastic Neural Networks on Neuromorphic Hardware , 2016, Front. Neuroanat..

[12]  Damien Coyle,et al.  A thalamo-cortico-thalamic neural mass model to study alpha rhythms in Alzheimer's disease , 2011, Neural Networks.

[13]  D. McCormick,et al.  Synaptic and membrane mechanisms underlying synchronized oscillations in the ferret lateral geniculate nucleus in vitro. , 1995, The Journal of physiology.

[14]  Stephen B. Furber,et al.  Maximising information recovery from rank-order codes , 2007, SPIE Defense + Commercial Sensing.

[15]  J. Huguenard,et al.  Reciprocal inhibitory connections and network synchrony in the mammalian thalamus. , 1999, Science.

[16]  A. Cichocki,et al.  Steady-state visually evoked potentials: Focus on essential paradigms and future perspectives , 2010, Progress in Neurobiology.

[17]  Bernabé Linares-Barranco,et al.  A 128$\,\times$ 128 1.5% Contrast Sensitivity 0.9% FPN 3 µs Latency 4 mW Asynchronous Frame-Free Dynamic Vision Sensor Using Transimpedance Preamplifiers , 2013, IEEE Journal of Solid-State Circuits.

[18]  Jürgen Kurths,et al.  Modification of Brain Oscillations via Rhythmic Light Stimulation Provides Evidence for Entrainment but Not for Superposition of Event-Related Responses , 2016, Front. Hum. Neurosci..

[19]  Paolo Bonato,et al.  Patient specific ankle-foot orthoses using rapid prototyping , 2011, Journal of NeuroEngineering and Rehabilitation.

[20]  Xin Wang,et al.  How inhibitory circuits in the thalamus serve vision. , 2015, Annual review of neuroscience.

[21]  Steve Furber,et al.  Power-efficient simulation of detailed cortical microcircuits on SpiNNaker , 2012, Journal of Neuroscience Methods.

[22]  S. M. Williams,et al.  Central Visual Pathways , 2001 .

[23]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[24]  S Murray Sherman,et al.  Functional Synaptic Contacts by Intranuclear Axon Collaterals of Thalamic Relay Neurons , 2003, The Journal of Neuroscience.

[25]  W. Guido,et al.  Burst and tonic response modes in thalamic neurons during sleep and wakefulness. , 2001, Journal of neurophysiology.

[26]  James W. Bisley,et al.  Visual Information Processing in the Primate Brain , 2003 .

[27]  Daniel Matolin,et al.  A QVGA 143 dB Dynamic Range Frame-Free PWM Image Sensor With Lossless Pixel-Level Video Compression and Time-Domain CDS , 2011, IEEE Journal of Solid-State Circuits.

[28]  Basabdatta Sen Bhattacharya,et al.  Causal Role of Thalamic Interneurons in Brain State Transitions: A Study Using a Neural Mass Model Implementing Synaptic Kinetics , 2016, Front. Comput. Neurosci..

[29]  C. Schwiening,et al.  A brief historical perspective: Hodgkin and Huxley , 2012, The Journal of physiology.

[30]  C. Eliasmith,et al.  The use and abuse of large-scale brain models , 2014, Current Opinion in Neurobiology.

[31]  C. Herrmann.  Human EEG responses to 1–100 Hz flicker: resonance phenomena in visual cortex and their potential correlation to cognitive phenomena , 2001, Experimental Brain Research.

[32]  Michael M. Halassa,et al.  Thalamic Inhibition: Diverse Sources, Diverse Scales , 2016, Trends in Neurosciences.

[33]  Tobi Delbrück,et al.  Retinomorphic Event-Based Vision Sensors: Bioinspired Cameras With Spiking Output , 2014, Proceedings of the IEEE.

[34]  G. Edelman,et al.  Large-scale model of mammalian thalamocortical systems , 2008, Proceedings of the National Academy of Sciences.

[35]  Bernabé Linares-Barranco,et al.  A Real-Time, Event-Driven Neuromorphic System for Goal-Directed Attentional Selection , 2012, ICONIP.

[36]  C. Cierpka,et al.  Particle imaging techniques for volumetric three-component (3D3C) velocity measurements in microfluidics , 2011, Journal of Visualization.

[37]  Manish Kumar.  Large-scale neuromorphic computing systems , 2016 .

[38]  Rodrigo Alvarez-Icaza,et al.  Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations , 2014, Proceedings of the IEEE.

[39]  Steve Furber,et al.  Engineering a thalamo-cortico-thalamic circuit on SpiNNaker: a preliminary study toward modeling sleep and wakefulness , 2014, Front. Neural Circuits.

[40]  M D Humphries,et al.  The role of intra-thalamic and thalamocortical circuits in action selection , 2002, Network.

[41]  Vincenzo Crunelli,et al.  Cellular Dynamics of Cholinergically Induced α (8–13 Hz) Rhythms in Sensory Thalamic Nuclei In Vitro , 2008, The Journal of Neuroscience.

[42]  David A. McCormick,et al.  Are thalamocortical rhythms the rosetta stone of a subset of neurological disorders? , 1999, Nature Medicine.

[43]  Brendan Z. Allison,et al.  How Many People Could Use an SSVEP BCI? , 2012, Front. Neurosci..

[44]  Justin M. Ales,et al.  The steady-state visual evoked potential in vision research: A review. , 2015, Journal of vision.

[45]  Jim D. Garside,et al.  SpiNNaker: A 1-W 18-Core System-on-Chip for Massively-Parallel Neural Network Simulation , 2013, IEEE Journal of Solid-State Circuits.

[46]  Tobi Delbrück,et al.  A 128$\times$ 128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor , 2008, IEEE Journal of Solid-State Circuits.

[47]  Vincenzo Crunelli,et al.  Thalamic T-type Ca2+ channels and NREM sleep. , 2006, Cell calcium.

[48]  W W Lytton,et al.  An intrinsic oscillation in interneurons of the rat lateral geniculate nucleus. , 1999, Journal of neurophysiology.

[49]  M Steriade,et al.  Low-frequency rhythms in the thalamus of intact-cortex and decorticated cats. , 1996, Journal of neurophysiology.

[50]  Basabdatta Sen Bhattacharya,et al.  Nonlinear Origin of SSVEP Spectra—A Combined Experimental and Modeling Study , 2016, Front. Comput. Neurosci..

[51]  Sergio Rajsbaum,et al.  Introduction , 2007, SIGA.

[52]  S. Sherman,et al.  Relative distribution of synapses in the A‐laminae of the lateral geniculate nucleus of the cat , 2000, The Journal of comparative neurology.

[53]  Gerold Baier,et al.  Dynamic Mechanisms of Neocortical Focal Seizure Onset , 2014, PLoS Comput. Biol..

[54]  Bernabé Linares-Barranco,et al.  A 3.6 $\mu$ s Latency Asynchronous Frame-Free Event-Driven Dynamic-Vision-Sensor , 2011, IEEE Journal of Solid-State Circuits.

[55]  S. Murray Sherman,et al.  Interneurons and triadic circuitry of the thalamus , 2004, Trends in Neurosciences.

[56]  Steve B. Furber,et al.  The SpiNNaker Project , 2014, Proceedings of the IEEE.

[57]  James W. Bisley,et al.  Visual Processing in the Primate Brain , 2003 .

[58]  Steve B. Furber,et al.  Towards Real-World Neurorobotics: Integrated Neuromorphic Visual Attention , 2014, ICONIP.

[59]  M. Pirchio,et al.  Cl‐ ‐ and K+‐dependent inhibitory postsynaptic potentials evoked by interneurones of the rat lateral geniculate nucleus. , 1988, The Journal of physiology.

[60]  Johannes Schemmel,et al.  A wafer-scale neuromorphic hardware system for large-scale neural modeling , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[61]  Steve B. Furber,et al.  Benchmarking Spike-Based Visual Recognition: A Dataset and Evaluation , 2016, Front. Neurosci..

[62]  F. D. da Silva,et al.  Organization of thalamic and cortical alpha rhythms: spectra and coherences. , 1973, Electroencephalography and clinical neurophysiology.

[63]  Damien Coyle,et al.  Alpha and theta rhythm abnormality in Alzheimer's Disease: a study using a computational model. , 2011, Advances in experimental medicine and biology.

[64]  Steve B. Furber,et al.  Power analysis of large-scale, real-time neural networks on SpiNNaker , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[65]  Basabdatta B. Sen,et al.  Information recovery from rank-order encoded images , 2008 .

[66]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.