Integer Quadratic Integrate-and-Fire (IQIF): A Neuron Model for Digital Neuromorphic Systems

Simulation of a spiking neural network involves solving a large number of differential equations. This is a challenge even for modern computer systems, especially when simulating large-scale neural networks. To address this challenge, we design a neuron model: the Integer Quadratic Integrate-and-Fire (IQIF) neuron. Instead of computing on floating point numbers, as is typical with other spiking neuron models, the IQIF model is computed purely on integers. The IQIF model is a quantized and linearized version of the classic quadratic integrate-and-fire (QIF) model. The IQIF model retains all dynamic characteristics of the QIF model with much lower computation complexity, at the cost of a limited dynamic range of the membrane potential and the synaptic current. We compare IQIF to other spiking neuron models based on their simulation speeds and the number of neuronal behaviors they can perform. We further compare the performance of IQIF with the leaky integrate-and-fire model in a classical decision-making network that exhibits nonlinear attractor dynamics. Our results show that the IQIF neurons are capable of performing computation that other spiking neuron models can do while having the advantages of speed. Moreover, the IQIF model is digital hardware friendly due to its pure integer operation and is therefore easily to be implemented in custom-built neuromorphic systems.

[1]  Rodrigo Alvarez-Icaza,et al.  Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations , 2014, Proceedings of the IEEE.

[2]  Xiao-Jing Wang,et al.  Conflict Resolution as Near-Threshold Decision-Making: A Spiking Neural Circuit Model with Two-Stage Competition for Antisaccadic Task , 2016, PLoS Comput. Biol..

[3]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[4]  Xiao-Jing Wang Decision Making in Recurrent Neuronal Circuits , 2008, Neuron.

[5]  Xiao-Jing Wang,et al.  Cortico–basal ganglia circuit mechanism for a decision threshold in reaction time tasks , 2006, Nature Neuroscience.

[6]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[7]  Paul Cisek,et al.  Making Choices between Rules or between Actions , 2011, Neuron.

[8]  D. Hansel,et al.  How Spike Generation Mechanisms Determine the Neuronal Response to Fluctuating Inputs , 2003, The Journal of Neuroscience.

[9]  Paul Miller,et al.  Accuracy and response-time distributions for decision-making: linear perfect integrators versus nonlinear attractor-based neural circuits , 2013, Journal of Computational Neuroscience.

[10]  Chi-Sang Poon,et al.  Neuromorphic Silicon Neurons and Large-Scale Neural Networks: Challenges and Opportunities , 2011, Front. Neurosci..

[11]  Chung-Chuan Lo,et al.  Top-Down Modulation on Perceptual Decision with Balanced Inhibition through Feedforward and Feedback Inhibitory Neurons , 2013, PloS one.

[12]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[13]  Christopher J. Cueva,et al.  Dynamics of Neural Population Responses in Prefrontal Cortex Indicate Changes of Mind on Single Trials , 2014, Current Biology.

[14]  M. Shadlen,et al.  Decision-making with multiple alternatives , 2008, Nature Neuroscience.

[15]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[16]  Andrew Heathcote,et al.  Brain and Behavior in Decision-Making , 2014, PLoS Comput. Biol..

[17]  Arvind Kumar,et al.  Existence and Control of Go/No-Go Decision Transition Threshold in the Striatum , 2015, PLoS Comput. Biol..

[18]  Romain Brette,et al.  Philosophy of the Spike: Rate-Based vs. Spike-Based Theories of the Brain , 2015, Front. Syst. Neurosci..

[19]  Sander M. Bohte,et al.  Computing with Spiking Neuron Networks , 2012, Handbook of Natural Computing.

[20]  Paul E. Hasler,et al.  A field programmable neural array , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[21]  Hong Wang,et al.  Loihi: A Neuromorphic Manycore Processor with On-Chip Learning , 2018, IEEE Micro.

[22]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[23]  Chung-Chuan Lo,et al.  POPPINS: A Population-Based Digital Spiking Neuromorphic Processor with Integer Quadratic Integrate-and-Fire Neurons , 2021, 2021 IEEE International Symposium on Circuits and Systems (ISCAS).

[24]  Michael Pfeiffer,et al.  Deep Learning With Spiking Neurons: Opportunities and Challenges , 2018, Front. Neurosci..