A Novel Compound Synapse Using Probabilistic Spin–Orbit-Torque Switching for MTJ-Based Deep Neural Networks

Analog electronic nonvolatile memories mimicking synaptic operations are being explored for the implementation of neuromorphic computing systems. Compound synapses consisting of ensembles of stochastic binary elements are alternatives to analog memory synapses to achieve multilevel memory operation. Among the existing binary memory technologies, magnetic tunneling junction (MTJ)-based magnetic random access memory (MRAM) technology has matured to the point of commercialization. More importantly for this work, stochasticity is natural to the MTJ switching physics, e.g., devices referred to as p-bits that mimic binary stochastic neurons. In this article, we experimentally demonstrate a novel compound synapse that uses stochastic spin–orbit-torque (SOT) switching of an ensemble of nanomagnets that are located on one shared spin Hall effect (SHE) material channel, i.e., tantalum. By using a properly chosen pulse scheme, we are able to demonstrate linear potentiation and depression in the synapse, as required for many neuromorphic architectures. In addition to this experimental effort, we also performed circuit simulations on an SOT-MRAM-based $784\times 200\times 10$ deep belief network (DBN) consisting of p-bit-based neurons and compound synapses. MNIST pattern recognition was used to evaluate the system performance, and our findings indicate that a significant reduction in recognition error rates can be achieved by improving the linearity of the potentiation and depression curves using an incremental pulse scheme.

[1]  Shimeng Yu,et al.  Neuro-Inspired Computing With Emerging Nonvolatile Memorys , 2018, Proceedings of the IEEE.

[2]  Youguang Zhang,et al.  Stochastic spintronic device based synapses and spiking neurons for neuromorphic computation , 2016, 2016 IEEE/ACM International Symposium on Nanoscale Architectures (NANOARCH).

[3]  Damien Querlioz,et al.  Neuromorphic computing with nanoscale spintronic oscillators , 2017, Nature.

[4]  Ali Khiat,et al.  Challenges hindering memristive neuromorphic hardware from going mainstream , 2018, Nature Communications.

[5]  Ian D. Reid,et al.  Training Compact Neural Networks with Binary Weights and Low Precision Activations , 2018, ArXiv.

[6]  I. Radu,et al.  Chain of magnetic tunnel junctions as a spintronic memristor , 2018, Journal of Applied Physics.

[7]  Jong-Ryul Jeong,et al.  Field-free switching of perpendicular magnetization through spin-orbit torque in antiferromagnet/ferromagnet/oxide structures. , 2016, Nature nanotechnology.

[8]  Yu Wang,et al.  All Spin Artificial Neural Networks Based on Compound Spintronic Synapse and Neuron , 2016, IEEE Transactions on Biomedical Circuits and Systems.

[9]  Diana Tsvetanova,et al.  SOT-MRAM 300MM Integration for Low Power and Ultrafast Embedded Memories , 2018, 2018 IEEE Symposium on VLSI Circuits.

[10]  Hitoshi Kubota,et al.  Neural-like computing with populations of superparamagnetic basis functions , 2016, Nature Communications.

[11]  Supriyo Datta,et al.  Implementing p-bits With Embedded MTJ , 2017, IEEE Electron Device Letters.

[12]  Robert Legenstein,et al.  A compound memristive synapse model for statistical learning through STDP in spiking neural networks , 2014, Front. Neurosci..

[13]  D. Ralph,et al.  Spin-Torque Switching with the Giant Spin Hall Effect of Tantalum , 2012, Science.

[14]  Pulkit Jain,et al.  13.3 A 7Mb STT-MRAM in 22FFL FinFET Technology with 4ns Read Sensing Time at 0.9V Using Write-Verify-Write Scheme and Offset-Cancellation Sensing Technique , 2019, 2019 IEEE International Solid- State Circuits Conference - (ISSCC).

[15]  Masatoshi Okutomi,et al.  A Novel Inference of a Restricted Boltzmann Machine , 2014, 2014 22nd International Conference on Pattern Recognition.

[16]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[17]  H. Ohno,et al.  Magnetization switching by spin-orbit torque in an antiferromagnet-ferromagnet bilayer system. , 2015, Nature materials.

[18]  E. Vianello,et al.  HfO2-Based OxRAM Devices as Synapses for Convolutional Neural Networks , 2015, IEEE Transactions on Electron Devices.

[19]  Supriyo Datta,et al.  Composable Probabilistic Inference Networks Using MRAM-based Stochastic Neurons , 2018, ACM J. Emerg. Technol. Comput. Syst..

[20]  Damien Querlioz,et al.  Vowel recognition with four coupled spin-torque nano-oscillators , 2017, Nature.

[21]  Shimeng Yu,et al.  Ferroelectric FET analog synapse for acceleration of deep neural network training , 2017, 2017 IEEE International Electron Devices Meeting (IEDM).

[22]  H. Ohno,et al.  Spintronics based random access memory: a review , 2017 .

[23]  Jacques-Olivier Klein,et al.  Spin-Transfer Torque Magnetic Memory as a Stochastic Memristive Synapse for Neuromorphic Systems , 2015, IEEE Transactions on Biomedical Circuits and Systems.

[24]  H. Ohno,et al.  Tunnel magnetoresistance of 604% at 300K by suppression of Ta diffusion in CoFeB∕MgO∕CoFeB pseudo-spin-valves annealed at high temperature , 2008 .

[25]  S. H. Han,et al.  Demonstration of Highly Manufacturable STT-MRAM Embedded in 28nm Logic , 2018, 2018 IEEE International Electron Devices Meeting (IEDM).

[26]  Ankur Srivastava,et al.  In-situ Stochastic Training of MTJ Crossbar based Neural Networks , 2018, ISLPED.

[27]  Brian M. Sutton,et al.  Stochastic p-bits for Invertible Logic , 2016, 1610.00377.