A High-Accuracy and Energy-Efficient CORDIC Based Izhikevich Neuron With Error Suppression and Compensation

Bio-inspired neuron models are the key building blocks of brain-like neural networks for brain-science exploration and neuromorphic engineering applications. The efficient hardware design of bio-inspired neuron models is one of the challenges to implement brain-like neural networks, as the balancing of model accuracy, energy consumption and hardware cost is very challenging. This paper proposes a high-accuracy and energy-efficient Fast-Convergence COordinate Rotation DIgital Computer (FC-CORDIC) based Izhikevich neuron design. For ensuring the model accuracy, an error propagation model of the Izhikevich neuron is presented for systematic error analysis and effective error reduction. Parameter-Tuning Error Compensation (PTEC) method and Bitwidth-Extension Error Suppression (BEES) method are proposed to reduce the error of Izhikevich neuron design effectively. In addition, by utilizing the FC-CORDIC instead of conventional CORDIC for square calculation in the Izhikevich model, the redundant CORDIC iterations are removed and therefore, both the accumulated errors and required computation are effectively reduced, which significantly improve the accuracy and energy efficiency. An optimized fixed-point design of FC-CORDIC is also proposed to save hardware overhead while ensuring the accuracy. FPGA implementation results exhibit that the proposed Izhikevich neuron design can achieve high accuracy and energy efficiency with an acceptable hardware overhead, among the state-of-the-art designs.

[1]  Kwen-Siong Chong,et al.  A High-Accuracy and Energy-Efficient CORDIC based Izhikevich Neuron , 2021, 2021 19th IEEE International New Circuits and Systems Conference (NEWCAS).

[2]  Wei Liu,et al.  Low-Cost Adaptive Exponential Integrate-and-Fire Neuron Using Stochastic Computing , 2020, IEEE Transactions on Biomedical Circuits and Systems.

[3]  Ilangko Balasingham,et al.  Synaptic Communication Engineering for Future Cognitive Brain–Machine Interfaces , 2019, Proceedings of the IEEE.

[4]  Majid Ahmadi,et al.  CORDIC-SNN: On-FPGA STDP Learning With Izhikevich Neurons , 2019, IEEE Transactions on Circuits and Systems I: Regular Papers.

[5]  Arash Ahmadi,et al.  Multiplierless Implementation of Noisy Izhikevich Neuron With Low-Cost Digital Design , 2018, IEEE Transactions on Biomedical Circuits and Systems.

[6]  Jun Zhou,et al.  A 1-V to 0.29-V sub-100-pJ/operation ultra-low power fast-convergence CORDIC processor in 0.18-μm CMOS , 2018, Microelectron. J..

[7]  Hassan Mostafa,et al.  A Low Power CORDIC-Based Hardware Implementation of Izhikevich Neuron Model , 2018, 2018 16th IEEE International New Circuits and Systems Conference (NEWCAS).

[8]  Bin Deng,et al.  FPGA implementation of hippocampal spiking network and its real-time simulation on dynamical neuromodulation of oscillations , 2017, Neurocomputing.

[9]  Hamid Soleimani,et al.  An Efficient and Reconfigurable Synchronous Neuron Model , 2018, IEEE Transactions on Circuits and Systems II: Express Briefs.

[10]  Christoph Börgers,et al.  An Introduction to Modeling Neuronal Dynamics , 2017 .

[11]  Kwabena Boahen,et al.  A Neuromorph's Prospectus , 2017, Computing in Science & Engineering.

[12]  Ana B. Porto-Pazos,et al.  Deep Artificial Neural Networks and Neuromorphic Chips for Big Data Analysis: Pharmaceutical and Bioinformatics Applications , 2016, International journal of molecular sciences.

[13]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[14]  Rodrigo Alvarez-Icaza,et al.  Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations , 2014, Proceedings of the IEEE.

[15]  François W. Primeau,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014 .

[16]  Arash Ahmadi,et al.  Biologically Inspired Spiking Neurons: Piecewise Linear Models and Digital Implementation , 2012, IEEE Transactions on Circuits and Systems I: Regular Papers.

[17]  Tetsuya Hishiki,et al.  A Generalized Rotate-and-Fire Digital Spiking Neuron Model and Its On-FPGA Learning , 2011, IEEE Transactions on Circuits and Systems II: Express Briefs.

[18]  Wulfram Gerstner,et al.  Spike-timing dependent plasticity , 2010, Scholarpedia.

[19]  E.E. Swartzlander,et al.  Adaptive CORDIC: Using Parallel Angle Recoding to Accelerate CORDIC Rotations , 2006, 2006 Fortieth Asilomar Conference on Signals, Systems and Computers.

[20]  Anthony N. Burkitt,et al.  A Review of the Integrate-and-fire Neuron Model: I. Homogeneous Synaptic Input , 2006, Biological Cybernetics.

[21]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[22]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[23]  Yu Hen Hu,et al.  An Angle Recoding Method for CORDIC Algorithm Implementation , 1993, IEEE Trans. Computers.

[24]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1990, Bulletin of mathematical biology.

[25]  J. S. Walther,et al.  A unified algorithm for elementary functions , 1899, AFIPS '71 (Spring).

[26]  Jack E. Volder The CORDIC Trigonometric Computing Technique , 1959, IRE Trans. Electron. Comput..