Open the box of digital neuromorphic processor: Towards effective algorithm-hardware co-design

Sparse and event-driven spiking neural network (SNN) algorithms are the ideal candidate solution for energy-efficient edge computing. Yet, with the growing complexity of SNN algorithms, it isn't easy to properly benchmark and optimize their computational cost without hardware in the loop. Although digital neuromorphic processors have been widely adopted to benchmark SNN algorithms, their black-box nature is problematic for algorithm-hardware co-optimization. In this work, we open the black box of the digital neuromorphic processor for algorithm designers by presenting the neuron processing instruction set and detailed energy consumption of the SENeCA neuromorphic architecture. For convenient benchmarking and optimization, we provide the energy cost of the essential neuromorphic components in SENeCA, including neuron models and learning rules. Moreover, we exploit the SENeCA's hierarchical memory and exhibit an advantage over existing neuromorphic processors. We show the energy efficiency of SNN algorithms for video processing and online learning, and demonstrate the potential of our work for optimizing algorithm designs. Overall, we present a practical approach to enable algorithm designers to accurately benchmark SNN algorithms and pave the way towards effective algorithm-hardware co-design.

[1]  Georges G. E. Gielen,et al.  Neuromorphic Near-Sensor Computing: From Event-Based Sensing to Edge Learning , 2022, IEEE Micro.

[2]  Georges G. E. Gielen,et al.  Event Camera Data Classification Using Spiking Networks with Spike-Timing-Dependent Plasticity , 2022, 2022 International Joint Conference on Neural Networks (IJCNN).

[3]  A. Yousefzadeh,et al.  Delta Activation Layer exploits temporal sparsity for efficient embedded video processing , 2022, 2022 International Joint Conference on Neural Networks (IJCNN).

[4]  Federico Corradi,et al.  SENeCA: Scalable Energy-efficient Neuromorphic Computer Architecture , 2022, 2022 IEEE 4th International Conference on Artificial Intelligence Circuits and Systems (AICAS).

[5]  Akhilesh R. Jaiswal,et al.  ACE-SNN: Algorithm-Hardware Co-design of Energy-Efficient & Low-Latency Deep Spiking Neural Networks for 3D Image Recognition , 2022, Frontiers in Neuroscience.

[6]  Neelesh Kumar,et al.  BioGrad: Biologically Plausible Gradient-Based Learning for Spiking Neural Networks , 2021, ArXiv.

[7]  Federico Corradi,et al.  μBrain: An Event-Driven and Fully Synthesizable Architecture for Spiking Neural Networks , 2021, Frontiers in Neuroscience.

[8]  Ru Huang,et al.  A Spike-Event-Based Neuromorphic Processor with Enhanced On-Chip STDP Learning in 28nm CMOS , 2021, 2021 IEEE International Symposium on Circuits and Systems (ISCAS).

[9]  Benoit Miramond,et al.  Learning from Event Cameras with Sparse Spiking Convolutional Neural Networks , 2021, 2021 International Joint Conference on Neural Networks (IJCNN).

[10]  Qinru Qiu,et al.  Neuromorphic Algorithm-hardware Codesign for Temporal Pattern Learning , 2021, 2021 58th ACM/IEEE Design Automation Conference (DAC).

[11]  Giacomo Indiveri,et al.  Analog Weight Updates with Compliance Current Modulation of Binary ReRAMs for On-Chip Learning , 2020, 2020 IEEE International Symposium on Circuits and Systems (ISCAS).

[12]  W. Maass,et al.  Online spatio-temporal learning in deep neural networks , 2020, ArXiv.

[13]  David Bol,et al.  A 28-nm Convolutional Neuromorphic Processor Enabling Online Learning with Spike-Based Retinas , 2020, 2020 IEEE International Symposium on Circuits and Systems (ISCAS).

[14]  K. Michmizos,et al.  Reinforcement co-Learning of Deep and Spiking Neural Networks for Energy-Efficient Mapless Navigation with Neuromorphic Hardware , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  Orlando Moreira,et al.  NeuronFlow: a neuromorphic processor architecture for Live AI applications , 2020, 2020 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[16]  Bernabe Linares-Barranco,et al.  Asynchronous Spiking Neurons, the Natural Key to Exploit Temporal Sparsity , 2019, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[17]  Wolfgang Maass,et al.  A solution to the learning dilemma for recurrent networks of spiking neurons , 2019, Nature Communications.

[18]  Pradeep Dubey,et al.  A Study of BFLOAT16 for Deep Learning Training , 2019, ArXiv.

[19]  Sungroh Yoon,et al.  Spiking-YOLO: Spiking Neural Network for Energy-Efficient Object Detection , 2019, AAAI.

[20]  Kaushik Roy,et al.  Going Deeper in Spiking Neural Networks: VGG and Residual Architectures , 2018, Front. Neurosci..

[21]  Hong Wang,et al.  Loihi: A Neuromorphic Manycore Processor with On-Chip Learning , 2018, IEEE Micro.

[22]  Lei Deng,et al.  Spatio-Temporal Backpropagation for Training High-Performance Spiking Neural Networks , 2017, Front. Neurosci..

[23]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[24]  Somnath Paul,et al.  Event-Driven Random Back-Propagation: Enabling Neuromorphic Deep Learning Machines , 2016, Front. Neurosci..

[25]  Max Welling,et al.  Sigma Delta Quantized Networks , 2016, ICLR.

[26]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[28]  Bernabé Linares-Barranco,et al.  An AER handshake-less modular infrastructure PCB with x8 2.5Gbps LVDS serial links , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[29]  Mubarak Shah,et al.  UCF101: A Dataset of 101 Human Actions Classes From Videos in The Wild , 2012, ArXiv.

[30]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[31]  Giacomo Indiveri,et al.  Spike-based learning with a generalized integrate and fire silicon neuron , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[32]  Ethem Alpaydin,et al.  Combining multiple representations and classifiers for pen-based handwritten digit recognition , 1997, Proceedings of the Fourth International Conference on Document Analysis and Recognition.

[33]  Michael J. Flynn,et al.  Some Computer Organizations and Their Effectiveness , 1972, IEEE Transactions on Computers.

[34]  K. Michmizos,et al.  Decoding EEG With Spiking Neural Networks on Neuromorphic Hardware , 2022, Trans. Mach. Learn. Res..

[35]  Wolfgang Maass,et al.  Networks of Spiking Neurons: The Third Generation of Neural Network Models , 1996, Electron. Colloquium Comput. Complex..