Towards Efficient Neuromorphic Hardware: Unsupervised Adaptive Neuron Pruning

We acknowledge the financial support from King Abdullah University of Science and Technology (KAUST), Saudi Arabia.

[1]  Gert Cauwenberghs,et al.  Neural and Synaptic Array Transceiver: A Brain-Inspired Computing Framework for Embedded Learning , 2017, Front. Neurosci..

[2]  Jianxin Wu,et al.  ThiNet: A Filter Level Pruning Method for Deep Neural Network Compression , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[3]  Xianghong Lin,et al.  An Adaptive Structure Learning Algorithm for Multi-Layer Spiking Neural Networks , 2019, 2019 15th International Conference on Computational Intelligence and Security (CIS).

[4]  Matthew Cook,et al.  Unsupervised learning of digit recognition using spike-timing-dependent plasticity , 2015, Front. Comput. Neurosci..

[5]  Pavlo Molchanov,et al.  Importance Estimation for Neural Network Pruning , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Luciano Lavagno,et al.  Efficient FPGA Implementation of OpenCL High-Performance Computing Applications via High-Level Synthesis , 2017, IEEE Access.

[7]  W. Gerstner,et al.  Triplets of Spikes in a Model of Spike Timing-Dependent Plasticity , 2006, The Journal of Neuroscience.

[8]  Narasimhan Sundararajan,et al.  A two stage learning algorithm for a Growing-Pruning Spiking Neural Network for pattern classification problems , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[9]  Timothée Masquelier,et al.  Deep Learning in Spiking Neural Networks , 2018, Neural Networks.

[10]  Ruizhi Chen,et al.  Fast and Efficient Deep Sparse Multi-Strength Spiking Neural Networks with Dynamic Pruning , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[11]  Scott A. Mahlke,et al.  Scalpel: Customizing DNN pruning to the underlying hardware parallelism , 2017, 2017 ACM/IEEE 44th Annual International Symposium on Computer Architecture (ISCA).

[12]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[13]  Gernot A. Fink,et al.  Neuron Pruning for Compressing Deep Networks Using Maxout Architectures , 2017, GCPR.

[14]  Steve B. Furber,et al.  The SpiNNaker Project , 2014, Proceedings of the IEEE.

[15]  Anthony N. Burkitt,et al.  A Review of the Integrate-and-fire Neuron Model: I. Homogeneous Synaptic Input , 2006, Biological Cybernetics.

[16]  David Bol,et al.  A 0.086-mm$^2$ 12.7-pJ/SOP 64k-Synapse 256-Neuron Online-Learning Digital Spiking Neuromorphic Processor in 28-nm CMOS , 2018, IEEE Transactions on Biomedical Circuits and Systems.

[17]  Catherine D. Schuman,et al.  Multi-Objective Optimization for Size and Resilience of Spiking Neural Networks , 2019, 2019 IEEE 10th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON).

[18]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[19]  Hong Wang,et al.  Loihi: A Neuromorphic Manycore Processor with On-Chip Learning , 2018, IEEE Micro.