Simulation studies of an All-Spin Artificial Neural Network: Emulating neural and synaptic functionalities through domain wall motion in ferromagnets

Non-Boolean computing based on emerging postCMOS technologies can potentially pave the way for low-power neural computing platforms. However, existing work on such emerging neuromorphic architectures have either focused on solely mimicking the neuron, or the synapse functionality. While memristive devices have been proposed to emulate biological synapses, spintronic devices have proved to be efficient at perform the thresholding operation of the neuron at ultra-low currents. In this work, we propose an All-Spin Artificial Neural Network where a single spintronic device acts as the basic building block of the system. The device offers a direct mapping to synapse and neuron functionalities in the brain while inter-layer network communication is accomplished via CMOS transistors. To the best of our knowledge, this is the first demonstration of a neural architecture where a single nanoelectronic device is able to mimic both neurons and synapses. The ultra-low voltage operation of low resistance magneto-metallic neurons enables the low-voltage operation of the array of spintronic synapses, thereby leading to ultra-low power neural architectures. Device-level simulations, calibrated to experimental results, was used to drive the circuit and system level simulations of the neural network for a standard pattern recognition problem. Simulation studies indicate energy savings by ∼ 100× in comparison to a corresponding digital/ analog CMOS neuron implementation.

[1]  Byoungil Lee,et al.  Nanoelectronic programmable synapses based on phase change materials for brain-inspired computing. , 2012, Nano letters.

[2]  Geoffrey W. Burr,et al.  Nanoscale electronic synapses using phase change devices , 2013, JETC.

[3]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[4]  Kaushik Roy,et al.  Spin Orbit Torque Based Electronic Neuron , 2014, ArXiv.

[5]  Xuanyao Fong,et al.  KNACK: A hybrid spin-charge mixed-mode simulator for evaluating different genres of spin-transfer torque MRAM bit-cells , 2011, 2011 International Conference on Simulation of Semiconductor Processes and Devices.

[6]  S. Parkin,et al.  Chiral spin torque at magnetic domain walls. , 2013, Nature nanotechnology.

[7]  Yong Liu,et al.  Specifications of Nanoscale Devices and Circuits for Neuromorphic Computational Systems , 2013, IEEE Transactions on Electron Devices.

[8]  Hyun-Woo Lee,et al.  Spin Hall torque magnetometry of Dzyaloshinskii domain walls , 2013, 1308.1432.

[9]  S. Parkin,et al.  Chiral spin torque arising from proximity-induced magnetization , 2014, Nature Communications.

[10]  J. Gilman,et al.  Nanotechnology , 2001 .

[11]  K. Roy,et al.  Spin-Based Neuron Model With Domain-Wall Magnets as Synapse , 2012, IEEE Transactions on Nanotechnology.

[12]  Renu Mehra,et al.  Proceedings of the 2016 International Symposium on Low Power Electronics and Design , 2016, ISLPED.

[13]  Matthew J. Rosseinsky,et al.  Physical Review B , 2011 .

[14]  Paul E. Hasler,et al.  Floating gate synapses with spike time dependent plasticity , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[15]  G. Schmid The Nature of Nanotechnology , 2010 .

[16]  G. Beach,et al.  Current-driven dynamics of chiral ferromagnetic domain walls. , 2013, Nature materials.

[17]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[18]  Satoru Emori,et al.  Current-driven dynamics of Dzyaloshinskii domain walls in the presence of in-plane fields: Full micromagnetic and one-dimensional analysis , 2014 .

[19]  F. García-Sánchez,et al.  The design and verification of MuMax3 , 2014, 1406.7635.

[20]  A. J. Freeman,et al.  Journal of Magnetism and Magnetic Materials. Volumes 198-199, 1 June 1999, , 1999 .

[21]  S. Yuasa,et al.  Giant room-temperature magnetoresistance in single-crystal Fe/MgO/Fe magnetic tunnel junctions , 2004, Nature materials.

[22]  Manik Varma,et al.  Character Recognition in Natural Images , 2009, VISAPP.

[23]  I. Ial,et al.  Nature Communications , 2010, Nature Cell Biology.

[24]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[25]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[26]  Luan Tran,et al.  45nm low power CMOS logic compatible embedded STT MRAM utilizing a reverse-connection 1T/1MTJ cell , 2009, 2009 IEEE International Electron Devices Meeting (IEDM).

[27]  Kaushik Roy,et al.  SPINDLE: SPINtronic Deep Learning Engine for large-scale neuromorphic computing , 2014, 2014 IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED).

[28]  Slonczewski Jc,et al.  Conductance and exchange coupling of two ferromagnets separated by a tunneling barrier. , 1989 .

[29]  Steven M. Nowick,et al.  ACM Journal on Emerging Technologies in Computing Systems , 2010, TODE.

[30]  Kaushik Roy,et al.  Spin Neurons: A Possible Path to Energy-Efficient Neuromorphic Computers , 2013, ArXiv.