Vowel recognition with four coupled spin-torque nano-oscillators

In recent years, artificial neural networks have become the flagship algorithm of artificial intelligence1. In these systems, neuron activation functions are static, and computing is achieved through standard arithmetic operations. By contrast, a prominent branch of neuroinspired computing embraces the dynamical nature of the brain and proposes to endow each component of a neural network with dynamical functionality, such as oscillations, and to rely on emergent physical phenomena, such as synchronization2–6, for solving complex problems with small networks7–11. This approach is especially interesting for hardware implementations, because emerging nanoelectronic devices can provide compact and energy-efficient nonlinear auto-oscillators that mimic the periodic spiking activity of biological neurons12–16. The dynamical couplings between oscillators can then be used to mediate the synaptic communication between the artificial neurons. One challenge for using nanodevices in this way is to achieve learning, which requires fine control and tuning of their coupled oscillations17; the dynamical features of nanodevices can be difficult to control and prone to noise and variability18. Here we show that the outstanding tunability of spintronic nano-oscillators—that is, the possibility of accurately controlling their frequency across a wide range, through electrical current and magnetic field—can be used to address this challenge. We successfully train a hardware network of four spin-torque nano-oscillators to recognize spoken vowels by tuning their frequencies according to an automatic real-time learning rule. We show that the high experimental recognition rates stem from the ability of these oscillators to synchronize. Our results demonstrate that non-trivial pattern classification tasks can be achieved with small hardware neural networks by endowing them with nonlinear dynamical features such as oscillations and synchronization.A network of four spin-torque nano-oscillators can be trained in real time to recognize spoken vowels, in a simple and scalable approach that could be exploited for large-scale neural networks.

[1]  Gilles Laurent,et al.  Transient Dynamics for Neural Processing , 2008, Science.

[2]  J. Katine,et al.  Mutual phase-locking of microwave spin torque nano-oscillators , 2005, Nature.

[3]  Patrick Suppes,et al.  Learning Pattern Recognition Through Quasi-Synchronization of Phase Oscillators , 2011, IEEE Transactions on Neural Networks.

[4]  S. Yuasa,et al.  Spin-torque diode effect in magnetic tunnel junctions , 2005, Nature.

[5]  Piotr Dudek,et al.  Compact silicon neuron circuit with spiking and bursting behaviour , 2008, Neural Networks.

[6]  Wolfgang Porod,et al.  Physical Implementation of Coherently Coupled Oscillator Networks , 2015, IEEE Journal on Exploratory Solid-State Computational Devices and Circuits.

[7]  James A. Bain,et al.  Phase Coupling and Control of Oxide-Based Oscillators for Neuromorphic Computing , 2015, IEEE Journal on Exploratory Solid-State Computational Devices and Circuits.

[8]  M. Pickett,et al.  A scalable neuristor built with Mott memristors. , 2013, Nature materials.

[9]  Suman Datta,et al.  Computational paradigms using oscillatory networks based on state-transition devices , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[10]  Hirotaka Tamura,et al.  An 8-to-16GHz 28nm CMOS clock distribution circuit based on mutual-injection-locked ring oscillators , 2013, 2013 Symposium on VLSI Circuits.

[11]  Arkady Pikovsky,et al.  Dynamics of globally coupled oscillators: Progress and perspectives. , 2015, Chaos.

[12]  Yan Fang,et al.  Pattern recognition with “materials that compute” , 2016, Science Advances.

[13]  Frank C Hoppensteadt,et al.  Spin-wave interference patterns created by spin-torque nano-oscillators for memory and computation , 2010, Nanotechnology.

[14]  David A. Patterson,et al.  In-datacenter performance analysis of a tensor processing unit , 2017, 2017 ACM/IEEE 44th Annual International Symposium on Computer Architecture (ISCA).

[15]  Damien Querlioz,et al.  Neuromorphic computing with nanoscale spintronic oscillators , 2017, Nature.

[16]  M. Gajek,et al.  Spin torque switching of 20 nm magnetic tunnel junctions with perpendicular anisotropy , 2012 .

[17]  Damien Querlioz,et al.  Synchronization detection in networks of coupled oscillators for pattern recognition , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[18]  A Fukushima,et al.  Mutual synchronization of spin torque nano-oscillators through a long-range and tunable electrical coupling scheme , 2016, Nature Communications.

[19]  V. Tiberkevich,et al.  Nonlinear Auto-Oscillator Theory of Microwave Generation by Spin-Polarized Current , 2009, IEEE Transactions on Magnetics.

[20]  B. N. Engel,et al.  Phase-locking in double-point-contact spin-transfer devices , 2005, Nature.

[21]  Giacomo Indiveri,et al.  Scaling mixed-signal neuromorphic processors to 28 nm FD-SOI technologies , 2016, 2016 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[22]  Baoshun Zhang,et al.  Giant spin-torque diode sensitivity in the absence of bias magnetic field , 2016, Nature communications.

[23]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[24]  Giacomo Indiveri,et al.  A current-mode conductance-based silicon neuron for address-event neuromorphic systems , 2009, 2009 IEEE International Symposium on Circuits and Systems.

[25]  Duc Xuan Tran,et al.  An ultra-low power consumption and very compact 1.49 GHz CMOS Voltage Controlled Ring Oscillator , 2014, 2014 International Conference on Advanced Technologies for Communications (ATC 2014).

[26]  David Sussillo,et al.  Neural circuits as computational dynamical systems , 2014, Current Opinion in Neurobiology.

[27]  Hitoshi Kubota,et al.  High emission power and Q factor in spin torque vortex oscillator consisting of FeB free layer , 2014 .

[28]  P. Bortolotti,et al.  Enhancing the injection locking range of spin torque oscillators through mutual coupling , 2016, 1610.06172.

[29]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[30]  John Paul Strachan,et al.  Chaotic dynamics in nanoscale NbO2 Mott memristors for analogue computing , 2017, Nature.

[31]  V. Cros,et al.  Spin-torque building blocks. , 2014, Nature Materials.

[32]  Damien Querlioz,et al.  Spintronic Nanodevices for Bioinspired Computing , 2016, Proceedings of the IEEE.

[33]  Kaushik Roy,et al.  Magnetic Pattern Recognition Using Injection-Locked Spin-Torque Nano-Oscillators , 2016, IEEE Transactions on Electron Devices.

[34]  J. Åkerman,et al.  Spin-wave-beam driven synchronization of nanocontact spin-torque oscillators. , 2016, Nature nanotechnology.

[35]  R Borisyuk,et al.  An oscillatory neural network model of sparse distributed memory and novelty detection. , 2000, Bio Systems.

[36]  J. Hillenbrand,et al.  Acoustic characteristics of American English vowels. , 1994, The Journal of the Acoustical Society of America.

[37]  Wolfgang Porod,et al.  Computational Study of Spin-Torque Oscillator Interactions for Non-Boolean Computing Applications , 2013, IEEE Transactions on Magnetics.

[38]  Damien Querlioz,et al.  A Nanotechnology-Ready Computing Scheme based on a Weakly Coupled Oscillator Network , 2017, Scientific Reports.