Training coupled spin-torque nano-oscillators to classify patterns in real-time

Substantial evidence indicates that the brain uses principles of non-linear dynamics in neural processes, providing inspiration for computing with nanoelectronic devices. However, training neural networks composed of dynamical nanodevices requires finely controlling and tuning their coupled oscillations. In this work, we show that the outstanding tunability of spintronic nano-oscillators can solve this challenge. We successfully train a hardware network of four spin-torque nano-oscillators to recognize spoken vowels by tuning their frequencies according to an automatic real-time learning rule. We show that the high experimental recognition rates stem from the high frequency tunability of the oscillators and their mutual coupling. Our results demonstrate that non-trivial pattern classification tasks can be achieved with small hardware neural networks by endowing them with non-linear dynamical features: here, oscillations and synchronization. This demonstration is a milestone for spintronics-based neuromorphic computing.

[1]  Giacomo Indiveri,et al.  Scaling mixed-signal neuromorphic processors to 28 nm FD-SOI technologies , 2016, 2016 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[2]  T. Meitzler,et al.  Low power microwave signal detection with a Spin-Torque Nano-Oscillator in the active self-oscillating regime , 2017, 2017 IEEE International Magnetics Conference (INTERMAG).

[3]  David A. Patterson,et al.  In-datacenter performance analysis of a tensor processing unit , 2017, 2017 ACM/IEEE 44th Annual International Symposium on Computer Architecture (ISCA).

[4]  Damien Querlioz,et al.  Synchronization detection in networks of coupled oscillators for pattern recognition , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[5]  James A. Bain,et al.  Phase Coupling and Control of Oxide-Based Oscillators for Neuromorphic Computing , 2015, IEEE Journal on Exploratory Solid-State Computational Devices and Circuits.

[6]  Wolfgang Porod,et al.  Computational Study of Spin-Torque Oscillator Interactions for Non-Boolean Computing Applications , 2013, IEEE Transactions on Magnetics.

[7]  Damien Querlioz,et al.  A Nanotechnology-Ready Computing Scheme based on a Weakly Coupled Oscillator Network , 2017, Scientific Reports.

[8]  Yan Fang,et al.  Pattern recognition with “materials that compute” , 2016, Science Advances.

[9]  Gilles Laurent,et al.  Transient Dynamics for Neural Processing , 2008, Science.

[10]  M. Pickett,et al.  A scalable neuristor built with Mott memristors. , 2013, Nature materials.

[11]  A Fukushima,et al.  Mutual synchronization of spin torque nano-oscillators through a long-range and tunable electrical coupling scheme , 2016, Nature Communications.

[12]  Hitoshi Kubota,et al.  High emission power and Q factor in spin torque vortex oscillator consisting of FeB free layer , 2014 .

[13]  P. Bortolotti,et al.  Enhancing the injection locking range of spin torque oscillators through mutual coupling , 2016, 1610.06172.

[14]  V. Tiberkevich,et al.  Nonlinear Auto-Oscillator Theory of Microwave Generation by Spin-Polarized Current , 2009, IEEE Transactions on Magnetics.

[15]  J. Katine,et al.  Mutual phase-locking of microwave spin torque nano-oscillators , 2005, Nature.

[16]  Arkady Pikovsky,et al.  Dynamics of globally coupled oscillators: Progress and perspectives. , 2015, Chaos.

[17]  M. Gajek,et al.  Spin torque switching of 20 nm magnetic tunnel junctions with perpendicular anisotropy , 2012 .

[18]  Suman Datta,et al.  Computational paradigms using oscillatory networks based on state-transition devices , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[19]  J. Hillenbrand,et al.  Acoustic characteristics of American English vowels. , 1994, The Journal of the Acoustical Society of America.

[20]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[21]  Giacomo Indiveri,et al.  A current-mode conductance-based silicon neuron for address-event neuromorphic systems , 2009, 2009 IEEE International Symposium on Circuits and Systems.

[22]  Duc Xuan Tran,et al.  An ultra-low power consumption and very compact 1.49 GHz CMOS Voltage Controlled Ring Oscillator , 2014, 2014 International Conference on Advanced Technologies for Communications (ATC 2014).

[23]  David Sussillo,et al.  Neural circuits as computational dynamical systems , 2014, Current Opinion in Neurobiology.

[24]  Kaushik Roy,et al.  Magnetic Pattern Recognition Using Injection-Locked Spin-Torque Nano-Oscillators , 2016, IEEE Transactions on Electron Devices.

[25]  J. Åkerman,et al.  Spin-wave-beam driven synchronization of nanocontact spin-torque oscillators. , 2016, Nature nanotechnology.

[26]  R Borisyuk,et al.  An oscillatory neural network model of sparse distributed memory and novelty detection. , 2000, Bio Systems.

[27]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[28]  John Paul Strachan,et al.  Chaotic dynamics in nanoscale NbO2 Mott memristors for analogue computing , 2017, Nature.

[29]  V. Cros,et al.  Spin-torque building blocks. , 2014, Nature Materials.

[30]  Damien Querlioz,et al.  Neuromorphic computing with nanoscale spintronic oscillators , 2017, Nature.