POPPINS: A Population-Based Digital Spiking Neuromorphic Processor with Integer Quadratic Integrate-and-Fire Neurons

The inner operations of the human brain as a biological processing system remain largely a mystery. Inspired by the function of the human brain and based on the analysis of simple neural network systems in other species, such as Drosophila, neuromorphic computing systems have attracted considerable interest. In cellular-level connectomics research, we can identify the characteristics of biological neural network, called population, which constitute not only recurrent fully- connection in network, also an external-stimulus and self- connection in each neuron. Relying on low data bandwidth of spike transmission in network and input data, Spiking Neural Networks exhibit low-latency and low-power design. In this study, we proposed a configurable population-based digital spiking neuromorphic processor in 180nm process technology with two configurable hierarchy populations. Also, these neurons in the processor can be configured as novel models, integer quadratic integrate-and-fire neuron models, which contain an unsigned 8-bit membrane potential value. The processor can implement intelligent decision making for avoidance in real-time. Moreover, the proposed approach enables the developments of biomimetic neuromorphic system and various low-power, and low-latency inference processing applications with normalized energy efficiency of 13.2 pJ/SOP.

[1]  D. Ielmini,et al.  A Spiking Recurrent Neural Network With Phase-Change Memory Neurons and Synapses for the Accelerated Solution of Constraint Satisfaction Problems , 2020, IEEE Journal on Exploratory Solid-State Computational Devices and Circuits.

[2]  Chung-Chuan Lo,et al.  Coupled symmetric and asymmetric circuits underlying spatial orientation in fruit flies , 2017, Nature Communications.

[3]  Ir J.A.J. van Leunen,et al.  How the Brain Works , 2011 .

[4]  Chung-Chuan Lo,et al.  A Single-Cell Level and Connectome-Derived Computational Model of the Drosophila Brain , 2018, bioRxiv.

[5]  Mark A Frye,et al.  Inhibitory Interactions and Columnar Inputs to an Object Motion Detector in Drosophila. , 2020, Cell reports.

[6]  Giacomo Indiveri,et al.  A reconfigurable on-line learning spiking neuromorphic processor comprising 256 neurons and 128K synapses , 2015, Front. Neurosci..

[7]  Ralph Etienne-Cummings,et al.  Low-power, low-mismatch, highly-dense array of VLSI Mihalas-Niebur neurons , 2017, 2017 IEEE International Symposium on Circuits and Systems (ISCAS).

[8]  Ting-Yuan Wang,et al.  Diverse Community Structures in the Neuronal-Level Connectome of the Drosophila Brain , 2019, Neuroinformatics.

[9]  G. Ermentrout,et al.  Parabolic bursting in an excitable system coupled with a slow oscillation , 1986 .

[10]  Giacomo Indiveri,et al.  A Scalable Multicore Architecture With Heterogeneous Memory Structures for Dynamic Neuromorphic Asynchronous Processors (DYNAPs) , 2017, IEEE Transactions on Biomedical Circuits and Systems.

[11]  Hong Wang,et al.  Loihi: A Neuromorphic Manycore Processor with On-Chip Learning , 2018, IEEE Micro.

[12]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[13]  D. Hansel,et al.  How Spike Generation Mechanisms Determine the Neuronal Response to Fluctuating Inputs , 2003, The Journal of Neuroscience.

[14]  L.F. Abbott,et al.  Gating Multiple Signals through Detailed Balance of Excitation and Inhibition in Spiking Networks , 2009, Nature Neuroscience.

[15]  Chung-Chuan Lo,et al.  Top-Down Modulation on Perceptual Decision with Balanced Inhibition through Feedforward and Feedback Inhibitory Neurons , 2013, PloS one.

[16]  Damon A. Clark,et al.  Heterogeneous Temporal Contrast Adaptation in Drosophila Direction-Selective Circuits , 2020, Current Biology.

[17]  Jongkil Park,et al.  A 65k-neuron 73-Mevents/s 22-pJ/event asynchronous micro-pipelined integrate-and-fire array transceiver , 2014, 2014 IEEE Biomedical Circuits and Systems Conference (BioCAS) Proceedings.

[18]  Michael S. Drews,et al.  The Temporal Tuning of the Drosophila Motion Detectors Is Determined by the Dynamics of Their Input Elements , 2017, Current Biology.

[19]  Jonathan Tse,et al.  Neural spiking dynamics in asynchronous digital circuits , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[20]  Bernard Brezzo,et al.  TrueNorth: Design and Tool Flow of a 65 mW 1 Million Neuron Programmable Neurosynaptic Chip , 2015, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[21]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[22]  Gert Cauwenberghs,et al.  A subthreshold aVLSI implementation of the Izhikevich simple neuron model , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[23]  Claude Desplan,et al.  Visual circuits in flies: beginning to see the whole picture , 2015, Current Opinion in Neurobiology.

[24]  David Bol,et al.  MorphIC: A 65-nm 738k-Synapse/mm$^2$ Quad-Core Binary-Weight Digital Neuromorphic Processor With Stochastic Spike-Driven Online Learning , 2019, IEEE Transactions on Biomedical Circuits and Systems.

[25]  Aaron Stillmaker,et al.  Scaling equations for the accurate prediction of CMOS device performance from 180 nm to 7 nm , 2017, Integr..

[26]  Olivier Temam,et al.  Hardware spiking neurons design: Analog or digital? , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[27]  Dharmendra S. Modha,et al.  A digital neurosynaptic core using embedded crossbar memory with 45pJ per spike in 45nm , 2011, 2011 IEEE Custom Integrated Circuits Conference (CICC).

[28]  Andrew S. Cassidy,et al.  Cognitive computing building block: A versatile and efficient digital neuron model for neurosynaptic cores , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).