Magnetic domain wall neuron with lateral inhibition

The development of an efficient neuromorphic computing system requires the use of nanodevices that intrinsically emulate the biological behavior of neurons and synapses. While numerous artificial synapses have been shown to store weights in a manner analogous to biological synapses, the challenge of developing an artificial neuron is impeded by the necessity to include leaking, integrating, firing, and lateral inhibition features. In particular, previous proposals for artificial neurons have required the use of external circuits to perform lateral inhibition, thereby decreasing the efficiency of the resulting neuromorphic computing system. This work therefore proposes a leaky integrate-and-fire neuron that intrinsically provides lateral inhibition, without requiring any additional circuitry. The proposed neuron is based on the previously proposed domain-wall magnetic tunnel junction devices, which have been proposed as artificial synapses and experimentally demonstrated for non-volatile logic. Single-neuron micromagnetic simulations are provided that demonstrate the ability of this neuron to implement the required leaking, integrating, and firing. These simulations are then extended to pairs of adjacent neurons to demonstrate, for the first time, lateral inhibition between neighboring artificial neurons. Finally, this intrinsic lateral inhibition is applied to a ten-neuron crossbar structure and trained to identify handwritten digits and shown via direct large-scale micromagnetic simulation for 100 digits to correctly identify the proper signal for 94% of the digits.The development of an efficient neuromorphic computing system requires the use of nanodevices that intrinsically emulate the biological behavior of neurons and synapses. While numerous artificial synapses have been shown to store weights in a manner analogous to biological synapses, the challenge of developing an artificial neuron is impeded by the necessity to include leaking, integrating, firing, and lateral inhibition features. In particular, previous proposals for artificial neurons have required the use of external circuits to perform lateral inhibition, thereby decreasing the efficiency of the resulting neuromorphic computing system. This work therefore proposes a leaky integrate-and-fire neuron that intrinsically provides lateral inhibition, without requiring any additional circuitry. The proposed neuron is based on the previously proposed domain-wall magnetic tunnel junction devices, which have been proposed as artificial synapses and experimentally demonstrated for non-volatile logic. Single-neur...

[1]  Martin Stemmler,et al.  Power Consumption During Neuronal Computation , 2014, Proceedings of the IEEE.

[2]  Gert Cauwenberghs,et al.  Memristors Empower Spiking Neurons With Stochasticity , 2015, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[3]  J. Yang,et al.  A Family of Electronically Reconfigurable Nanodevices , 2009 .

[4]  Anthony N. Burkitt,et al.  A review of the integrate-and-fire neuron model: II. Inhomogeneous synaptic input and network properties , 2006, Biological Cybernetics.

[5]  Abhronil Sengupta,et al.  A Vision for All-Spin Neural Networks: A Device to System Perspective , 2016, IEEE Transactions on Circuits and Systems I: Regular Papers.

[6]  Kaushik Roy,et al.  Proposal for an All-Spin Artificial Neural Network: Emulating Neural and Synaptic Functionalities Through Domain Wall Motion in Ferromagnets , 2015, IEEE Transactions on Biomedical Circuits and Systems.

[7]  C. Ross,et al.  Low Energy Magnetic Domain Wall Logic in Short, Narrow, Ferromagnetic Wires , 2012, IEEE Magnetics Letters.

[8]  Joseph S. Friedman,et al.  Overhead Requirements for Stateful Memristor Logic , 2019, IEEE Transactions on Circuits and Systems I: Regular Papers.

[9]  Mark Fischetti,et al.  Computers vs. brains. , 2011, Scientific American.

[10]  F. García-Sánchez,et al.  The design and verification of MuMax3 , 2014, 1406.7635.

[11]  A. Masaki,et al.  Neural networks in CMOS: a case study , 1990, IEEE Circuits and Devices Magazine.

[12]  Bernard Widrow,et al.  30 years of adaptive neural networks: perceptron, Madaline, and backpropagation , 1990, Proc. IEEE.

[13]  C. A. Ross,et al.  Logic circuit prototypes for three-terminal magnetic tunnel junctions with mobile domain walls , 2016, Nature Communications.

[14]  Damien Querlioz,et al.  Spintronic Nanodevices for Bioinspired Computing , 2016, Proceedings of the IEEE.

[15]  S. Yuasa,et al.  A magnetic synapse: multilevel spin-torque memristor with perpendicular anisotropy , 2016, Scientific Reports.

[16]  Giacomo Indiveri,et al.  Integration of nanoscale memristor synapses in neuromorphic computing architectures , 2013, Nanotechnology.

[17]  Lawrence D. Jackel,et al.  VLSI implementation of a neural network model , 1988, Computer.

[18]  S. Moss,et al.  GABAA receptor trafficking and its role in the dynamic modulation of neuronal inhibition , 2008, Nature Reviews Neuroscience.

[19]  H. Markram,et al.  Interneurons of the neocortical inhibitory system , 2004, Nature Reviews Neuroscience.

[20]  C. Ross,et al.  Magnetic reversal and thermal stability of CoFeB perpendicular magnetic tunnel junction arrays patterned by block copolymer lithography , 2018, Nanotechnology.

[21]  Vijay Balasubramanian,et al.  Heterogeneity and Efficiency in the Brain , 2015, Proceedings of the IEEE.

[22]  M. Cecchini,et al.  Ultrastructural Characterization of the Lower Motor System in a Mouse Model of Krabbe Disease , 2016, Scientific Reports.

[23]  Polymethyl methacrylate/hydrogen silsesquioxane bilayer resist electron beam lithography process for etching 25 nm wide magnetic wires , 2014 .

[24]  R. Demara,et al.  A Tunable Majority Gate-Based Full Adder Using Current-Induced Domain Wall Nanomagnets , 2016, IEEE Transactions on Magnetics.

[25]  B. Mandelbrot,et al.  RANDOM WALK MODELS FOR THE SPIKE ACTIVITY OF A SINGLE NEURON. , 1964, Biophysical journal.

[26]  S. Amari.  Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[27]  G. Beach,et al.  Current-driven dynamics of chiral ferromagnetic domain walls. , 2013, Nature materials.

[28]  Jacques Gautrais,et al.  SpikeNET: A simulator for modeling large networks of integrate and fire neurons , 1999, Neurocomputing.

[29]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[30]  Kaushik Roy,et al.  Encoding Neural and Synaptic Functionalities in Electron Spin: A Pathway to Efficient Neuromorphic Computing , 2017, ArXiv.

[31]  David Blaauw,et al.  Rectified-linear and recurrent neural networks built with spin devices , 2017, 2017 IEEE International Symposium on Circuits and Systems (ISCAS).

[32]  Kaushik Roy,et al.  Spin Orbit Torque Based Electronic Neuron , 2014, ArXiv.

[33]  D. Stewart,et al.  The missing memristor found , 2008, Nature.

[34]  D. S. Touretzky,et al.  Neural network simulation at Warp speed: how we got 17 million connections per second , 1988, IEEE 1988 International Conference on Neural Networks.

[35]  Jacques-Olivier Klein,et al.  Multiscaled Simulation Methodology for Neuro-Inspired Circuits Demonstrated with an Organic Memristor , 2018, IEEE Transactions on Multi-Scale Computing Systems.

[36]  G. Odell,et al.  Robustness, Flexibility, and the Role of Lateral Inhibition in the Neurogenic Network , 2002, Current Biology.

[37]  S. Graffi,et al.  CMOS implementation of an analogically programmable cellular neural network , 1993 .

[38]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[39]  L. Chua.  Memristor-The missing circuit element , 1971 .

[40]  D. Apalkov,et al.  Matching domain-wall configuration and spin-orbit torques for efficient domain-wall motion , 2012, 1210.3049.

[41]  Zhi-Hong Mao,et al.  Dynamics of Winner-Take-All Competition in Recurrent Neural Networks With Lateral Inhibition , 2007, IEEE Transactions on Neural Networks.

[42]  Bernard Brezzo,et al.  TrueNorth: Design and Tool Flow of a 65 mW 1 Million Neuron Programmable Neurosynaptic Chip , 2015, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[43]  Byoung Hun Lee,et al.  Neuromorphic Hardware System for Visual Pattern Recognition With Memristor Array and CMOS Neuron , 2015, IEEE Transactions on Industrial Electronics.

[44]  D. Feldmeyer,et al.  Inhibitory Interneurons and their Circuit Motifs in the Many Layers of the Barrel Cortex , 2018, Neuroscience.

[45]  Kaushik Roy,et al.  Proposal for a Leaky-Integrate-Fire Spiking Neuron Based on Magnetoelectric Switching of Ferromagnets , 2016, IEEE Transactions on Electron Devices.