A neuromorphic GAN system for intelligent computing on edge

Recently, artificial intelligence has gained great success in moving toward to edge devices. However, the involved deep neural network (DNN) computations which extremely resource-intensive and power-hungry became a big challenge to the edge computing. The programmable ReRAM based neuromorphic engine opened an opportunity for efficient DNN computing; however, memory utilization and communication latency in the training process implementation is still significant in the current research, and as yet, unmet challenges. The problem becomes more severe in DNN with complex training process such as the generative adversarial network (GAN) which is widely adopted in the intelligence computing on edge. In this work, we target to solve these challenges by designing an efficient GAN computing system on ReRAM neuromorphic engine with a online training framework and an optimized backward computation and a cross-parallel computation flow to execute the training process efficiently. The system performance is evaluated and compared with traditional GPU accelerator, and our results show 2.8x speedup and 6.1x energy-saving.

[1]  Chenchen Liu,et al.  Rescuing memristor-based neuromorphic design with high defects , 2017, 2017 54th ACM/EDAC/IEEE Design Automation Conference (DAC).

[2]  Hao Jiang,et al.  A spiking neuromorphic design with resistive crossbar , 2015, 2015 52nd ACM/EDAC/IEEE Design Automation Conference (DAC).

[3]  Wei Zhang,et al.  A novel peripheral circuit for RRAM-based LUT , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[4]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[5]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[6]  Yiran Chen,et al.  PipeLayer: A Pipelined ReRAM-Based Accelerator for Deep Learning , 2017, 2017 IEEE International Symposium on High Performance Computer Architecture (HPCA).

[7]  Tao Zhang,et al.  PRIME: A Novel Processing-in-Memory Architecture for Neural Network Computation in ReRAM-Based Main Memory , 2016, 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA).

[8]  Guangwen Yang,et al.  F-CNN: An FPGA-based framework for training Convolutional Neural Networks , 2016, 2016 IEEE 27th International Conference on Application-specific Systems, Architectures and Processors (ASAP).