A Nanotechnology-Ready Computing Scheme based on a Weakly Coupled Oscillator Network

With conventional transistor technologies reaching their limits, alternative computing schemes based on novel technologies are currently gaining considerable interest. Notably, promising computing approaches have proposed to leverage the complex dynamics emerging in networks of coupled oscillators based on nanotechnologies. The physical implementation of such architectures remains a true challenge, however, as most proposed ideas are not robust to nanotechnology devices’ non-idealities. In this work, we propose and investigate the implementation of an oscillator-based architecture, which can be used to carry out pattern recognition tasks, and which is tailored to the specificities of nanotechnologies. This scheme relies on a weak coupling between oscillators, and does not require a fine tuning of the coupling values. After evaluating its reliability under the severe constraints associated to nanotechnologies, we explore the scalability of such an architecture, suggesting its potential to realize pattern recognition tasks using limited resources. We show that it is robust to issues like noise, variability and oscillator non-linearity. Defining network optimization design rules, we show that nano-oscillator networks could be used for efficient cognitive processing.

[1]  Roberto Barrio,et al.  Control strategies of 3-cell Central Pattern Generator via global stimuli , 2016, Scientific Reports.

[2]  P. Bortolotti,et al.  Mutual synchronization of spin torque nano-oscillators through a non-local and tunable electrical coupling , 2016 .

[3]  V. Tiberkevich,et al.  Nonlinear Auto-Oscillator Theory of Microwave Generation by Spin-Polarized Current , 2009, IEEE Transactions on Magnetics.

[4]  Florian Dörfler,et al.  Synchronization in complex networks of phase oscillators: A survey , 2014, Autom..

[5]  Pradeep Dubey,et al.  Convergence of Recognition, Mining, and Synthesis Workloads and Its Implications , 2008, Proceedings of the IEEE.

[6]  Steven P. Levitan,et al.  Associative processing with coupled oscillators , 2013, ISLPED '13.

[7]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Vegard Flovik,et al.  Describing synchronization and topological excitations in arrays of magnetic spin torque oscillators through the Kuramoto model , 2016, Scientific Reports.

[9]  DeLiang Wang,et al.  Emergent synchrony in locally coupled neural oscillators , 1995, IEEE Trans. Neural Networks.

[10]  Grant R. Gerhart,et al.  Phase-locking and frustration in an array of nonlinear spin-torque nano-oscillators , 2009 .

[11]  J. Kurths,et al.  Synchronization in Oscillatory Networks , 2007 .

[12]  Konstantin K. Likharev,et al.  Mutual phase-locking in Josephson junction arrays , 1984 .

[13]  Vincent Cros,et al.  Efficient Synchronization of Dipolarly Coupled Vortex-Based Spin Transfer Nano-Oscillators , 2015, Scientific Reports.

[14]  E. Izhikevich,et al.  Oscillatory Neurocomputers with Dynamic Connectivity , 1999 .

[15]  Narayanan Vijaykrishnan,et al.  Computational Architectures Based on Coupled Oscillators , 2014, 2014 IEEE Computer Society Annual Symposium on VLSI.

[16]  Kaushik Roy,et al.  Computing with coupled Spin Torque Nano Oscillators , 2016, 2016 21st Asia and South Pacific Design Automation Conference (ASP-DAC).

[17]  Rachel Courtland,et al.  Transistors could stop shrinking in 2021 , 2016 .

[18]  Frank C. Hoppensteadt,et al.  Pattern recognition via synchronization in phase-locked loop neural networks , 2000, IEEE Trans. Neural Networks Learn. Syst..

[19]  Michael J. Jutras,et al.  Synchronous neural activity and memory formation , 2010, Current Opinion in Neurobiology.

[20]  Hoppensteadt,et al.  Synchronization of laser oscillators, associative memory, and optical neurocomputing , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[21]  A. F. Adams,et al.  The Survey , 2021, Dyslexia in Higher Education.

[22]  Ulf Hashagen,et al.  The first computers: history and architectures , 2000 .

[23]  Murray Shanahan,et al.  How well do oscillator models capture the behaviour of biological neurons? , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[24]  Henk Nijmeijer,et al.  Modelling the dynamics of a MEMS resonator : simulations and experiments , 2008 .

[25]  J. Fell,et al.  The role of phase synchronization in memory processes , 2011, Nature Reviews Neuroscience.

[26]  Damien Querlioz,et al.  Spintronic Nanodevices for Bioinspired Computing , 2016, Proceedings of the IEEE.

[27]  Yan Zhou,et al.  Capacitance Enhanced Synchronization of Pairs of Spin-Transfer Oscillators , 2009, IEEE Transactions on Magnetics.

[28]  M. Imboden,et al.  Synchronized Oscillation in Coupled Nanomechanical Oscillators , 2007, Science.

[29]  Damien Querlioz,et al.  Synchronization detection in networks of coupled oscillators for pattern recognition , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[30]  Wolfgang Porod,et al.  Computational Study of Spin-Torque Oscillator Interactions for Non-Boolean Computing Applications , 2013, IEEE Transactions on Magnetics.

[31]  Jian Gao,et al.  Effects of frustration on explosive synchronization , 2016 .

[32]  Tadashi Shibata,et al.  Coupled-Oscillator Associative Memory Array Operation for Pattern Recognition , 2015, IEEE Journal on Exploratory Solid-State Computational Devices and Circuits.

[33]  Damien Querlioz,et al.  Bioinspired Programming of Memory Devices for Implementing an Inference Engine , 2015, Proceedings of the IEEE.

[34]  E. Izhikevich,et al.  Weakly connected neural networks , 1997 .

[35]  R. Cutler,et al.  An Analytical Study , 2016 .

[36]  Ashwin A. Seshia,et al.  Electrically coupled MEMS oscillators , 2011, 2011 Joint Conference of the IEEE International Frequency Control and the European Frequency and Time Forum (FCS) Proceedings.

[37]  Robert W. Hölzel,et al.  Pattern recognition with simple oscillating circuits , 2011 .

[38]  James A. Bain,et al.  Phase Coupling and Control of Oxide-Based Oscillators for Neuromorphic Computing , 2015, IEEE Journal on Exploratory Solid-State Computational Devices and Circuits.

[39]  Frank C. Hoppensteadt,et al.  Synchronization of MEMS resonators and mechanical neurocomputing , 2001 .

[40]  Florian Marquardt,et al.  Noise-induced transitions in optomechanical synchronization , 2015, 1507.06190.

[41]  Brian H. Houston,et al.  Frequency entrainment for micromechanical oscillator , 2003 .

[42]  Gustavo Deco,et al.  Role of local network oscillations in resting-state functional connectivity , 2011, NeuroImage.

[43]  Johan Åkerman,et al.  Long-range mutual synchronization of spin Hall nano-oscillators , 2016, Nature Physics.

[44]  Yan Zhou,et al.  Phase-locked spin torque oscillators : Impact of device variability and time delay , 2007 .

[45]  Jürgen Kurths,et al.  Synchronization - A Universal Concept in Nonlinear Sciences , 2001, Cambridge Nonlinear Science Series.

[46]  V. Cros,et al.  Impact of the electrical connection of N Spin Transfer Oscillators on their synchronization : an analytical study , 2008, 0804.4855.

[47]  Mirko Hansen,et al.  Synchronization of two memristive coupled van der Pol oscillators , 2015, ArXiv.

[48]  Suman Datta,et al.  Neuro inspired computing with coupled relaxation oscillators , 2014, 2014 51st ACM/EDAC/IEEE Design Automation Conference (DAC).

[49]  R. Spigler,et al.  The Kuramoto model: A simple paradigm for synchronization phenomena , 2005 .

[50]  Yurii Ovchinnikov,et al.  Networks of Josephson junctions and their synchronization , 2013 .

[51]  E. Izhikevich Weakly Coupled Oscillators , 2006 .

[52]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[53]  Hitoshi Kubota,et al.  High emission power and Q factor in spin torque vortex oscillator consisting of FeB free layer , 2014 .

[54]  S. Strogatz From Kuramoto to Crawford: exploring the onset of synchronization in populations of coupled oscillators , 2000 .

[55]  Suman Datta,et al.  Computing with dynamical systems in the post-CMOS era , 2016, 2016 IEEE Photonics Society Summer Topical Meeting Series (SUM).

[56]  Pablo Kaluza,et al.  Computation with phase oscillators: An oscillatory perceptron model , 2013, Neurocomputing.

[57]  J. Åkerman,et al.  Spin-wave-beam driven synchronization of nanocontact spin-torque oscillators. , 2016, Nature nanotechnology.

[58]  Eiichi Goto,et al.  The Parametron, a Digital Computing Element Which Utilizes Parametric Oscillation , 1959, Proceedings of the IRE.

[59]  S. Singh,et al.  Nonlinear Effects in Optical Fibers: Origin, Management and Applications , 2007 .

[60]  R Borisyuk,et al.  An oscillatory neural network model of sparse distributed memory and novelty detection. , 2000, Bio Systems.

[61]  Patrick Suppes,et al.  Learning Pattern Recognition Through Quasi-Synchronization of Phase Oscillators , 2011, IEEE Transactions on Neural Networks.