A tunable magnetic skyrmion neuron cluster for energy efficient artificial neural network

Artificial neuron is one of the fundamental computing unit in brain-inspired artificial neural network. The standard CMOS based artificial neuron designs to implement non-Unear neuron activation function typically consist of large number of transistors, which inevitably causes large area and power consumption. There is a need for novel nanoelectronic device that can intrinsically and efficiently implement such complex non-Unear neuron activation function. Magnetic skyrmions are topologically stable chiral spin textures due to Dzyaloshinskii-Moriya interaction in bulk magnets or magnetic thin films. They are promising next-generation information carrier owing to ultra-small size (sub-10nm), high speed (>100n]/s) with ultra-low depinning current density (MA/cm2) and high defect tolerance compared to conventional magnetic domain wall motion devices. In this work, to the best of our knowledge, we are the first to propose a threshold-tunable artificial neuron based on magnetic skyrmion. Meanwhile, we propose a Skyrmion Neuron Cluster (SNC) to approximate non-linear soft-limiting neuron activation functions, such as the most popular sigmoid function. The device to system simulation indicates that our proposed SNC leads to 98.74% recognition accuracy in deep learning Convolutional Neural Network (CNN) with MNIST handwritten digits dataset Moreover, the energy consumption of our proposed SNC is only 3.1 fj/step, which is more than two orders lower than that of CMOS counterpart.

[1]  R. Lippmann,et al.  An introduction to computing with neural nets , 1987, IEEE ASSP Magazine.

[2]  K. Roy,et al.  Spin-Based Neuron Model With Domain-Wall Magnets as Synapse , 2012, IEEE Transactions on Nanotechnology.

[3]  A. Locatelli,et al.  Room-temperature chiral magnetic skyrmions in ultrathin magnetic nanostructures. , 2016, Nature nanotechnology.

[4]  S. Heinze,et al.  Spontaneous atomic-scale magnetic skyrmion lattice in two dimensions , 2011 .

[5]  Y. Tokura,et al.  Near room-temperature formation of a skyrmion crystal in thin-films of the helimagnet FeGe. , 2011, Nature materials.

[6]  P. Böni,et al.  Skyrmion Lattice in a Chiral Magnet , 2009, Science.

[7]  Kaushik Roy,et al.  STT-SNN: A Spin-Transfer-Torque Based Soft-Limiting Non-Linear Neuron for Low-Power Artificial Neural Networks , 2014, IEEE Transactions on Nanotechnology.

[8]  Rasmus Berg Palm,et al.  Prediction as a candidate for learning deep hierarchical models of data , 2012 .

[9]  Yan Zhou,et al.  Magnetic skyrmion transistor: skyrmion motion in a voltage-gated nanotrack , 2015, Scientific Reports.

[10]  C. Pfleiderer,et al.  Skyrmion lattice in the doped semiconductor Fe1-xCoxSi , 2009, 0903.2587.

[11]  Kaushik Roy,et al.  SPINDLE: SPINtronic Deep Learning Engine for large-scale neuromorphic computing , 2014, 2014 IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED).

[12]  Witold Pedrycz,et al.  Current-Mode Analog Adaptive Mechanism for Ultra-Low-Power Neural Networks , 2011, IEEE Transactions on Circuits and Systems II: Express Briefs.

[13]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[14]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[15]  A. Fert,et al.  Skyrmions on the track. , 2013, Nature nanotechnology.

[16]  Y. Tokura,et al.  Real-space observation of a two-dimensional skyrmion crystal , 2010, Nature.

[17]  Kaushik Roy,et al.  Spin Neurons: A Possible Path to Energy-Efficient Neuromorphic Computers , 2013, ArXiv.

[18]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[19]  A. Fert,et al.  Nucleation, stability and current-induced motion of isolated magnetic skyrmions in nanostructures. , 2013, Nature nanotechnology.

[20]  C. Chien,et al.  Extended Skyrmion phase in epitaxial FeGe(111) thin films. , 2012, Physical review letters.

[21]  Xuanyao Fong,et al.  KNACK: A hybrid spin-charge mixed-mode simulator for evaluating different genres of spin-transfer torque MRAM bit-cells , 2011, 2011 International Conference on Simulation of Semiconductor Processes and Devices.

[22]  Yan Zhou,et al.  Voltage Controlled Magnetic Skyrmion Motion for Racetrack Memory , 2015, Scientific Reports.

[23]  Kaushik Roy,et al.  Spin-Transfer Torque Magnetic neuron for low power neuromorphic computing , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[24]  M. Mochizuki,et al.  Current-induced skyrmion dynamics in constricted geometries. , 2013, Nature nanotechnology.

[25]  Yan Zhou,et al.  Magnetic skyrmion logic gates: conversion, duplication and merging of skyrmions , 2014, Scientific Reports.