Time-Delay Encoded Image Recognition in a Network of Resistively Coupled VO₂ on Si Oscillators

Oscillatory neural networks based on insulator to metal transition of VO2 switches are implemented for image recognition. The VO2 oscillators are fabricated on silicon in a CMOS compatible process. A fully-connected network of coupled oscillators is investigated using programmable resistors as coupling elements. In this approach, input of the image information and data processing is performed in the time domain. In particular, tuning the coupling resistors allows to control the phase-relation between the oscillators. This is used to memorize and recognize patterns in an analog circuit. The concept is demonstrated experimentally on a three-VO2 oscillator network, whereas simulations are performed on a larger 9-oscillators circuit.

[1]  John J. Hopfield,et al.  Dense Associative Memory for Pattern Recognition , 2016, NIPS.

[2]  Giacomo Indiveri,et al.  A reconfigurable on-line learning spiking neuromorphic processor comprising 256 neurons and 128K synapses , 2015, Front. Neurosci..

[3]  S. Ambrogio,et al.  Emerging neuromorphic devices , 2019, Nanotechnology.

[4]  S. Datta,et al.  Pairwise coupled hybrid vanadium dioxide-MOSFET (HVFET) oscillators for non-boolean associative computing , 2014, 2014 IEEE International Electron Devices Meeting.

[5]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[6]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[7]  Wolfgang Porod,et al.  Computing With Networks of Oscillatory Dynamical Systems , 2019, Proceedings of the IEEE.

[8]  Supratik Mukhopadhyay,et al.  Unsupervised Learning using Pretrained CNN and Associative Memory Bank , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[9]  Pritish Narayanan,et al.  Neuromorphic computing using non-volatile memory , 2017 .

[10]  Suman Datta,et al.  Modeling and Simulation of Vanadium Dioxide Relaxation Oscillators , 2015, IEEE Transactions on Circuits and Systems I: Regular Papers.

[11]  S. Datta,et al.  Ultra low power coupled oscillator arrays for computer vision applications , 2016, 2016 IEEE Symposium on VLSI Technology.

[12]  Giacomo Indiveri,et al.  Memory and Information Processing in Neuromorphic Systems , 2015, Proceedings of the IEEE.

[13]  Hiroshi Imamura,et al.  Stochastic Phase Synchronization of Perpendicularly Magnetized Spin-Torque Oscillators With the Second-Order Uniaxial Anisotropy , 2017, IEEE Transactions on Magnetics.

[14]  Amin Karbasi,et al.  Iterative Learning and Denoising in Convolutional Neural Associative Memories , 2013, ICML.

[15]  David Murphy,et al.  2.5 A complementary VCO for IoE that achieves a 195dBc/Hz FOM and flicker noise corner of 200kHz , 2016, 2016 IEEE International Solid-State Circuits Conference (ISSCC).

[16]  Adrian M. Ionescu,et al.  Scaled resistively-coupled VO2 oscillators for neuromorphic computing , 2020 .

[17]  Eugene M. Izhikevich,et al.  Computing with Oscillators , 2000 .

[18]  H. Wong,et al.  Localized Triggering of the Insulator-Metal Transition in VO2 Using a Single Carbon Nanotube. , 2019, ACS nano.

[19]  Jim D. Garside,et al.  SpiNNaker: A 1-W 18-Core System-on-Chip for Massively-Parallel Neural Network Simulation , 2013, IEEE Journal of Solid-State Circuits.

[20]  Gert Cauwenberghs,et al.  Neuromorphic Silicon Neuron Circuits , 2011, Front. Neurosci.

[21]  Roberto Nonis,et al.  A precision 140MHz relaxation oscillator in 40nm CMOS with 28ppm/°C frequency stability for automotive SoC applications , 2017, 2017 IEEE Radio Frequency Integrated Circuits Symposium (RFIC).

[22]  Hassan Foroosh,et al.  Sparse Convolutional Neural Networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Damien Querlioz,et al.  Neuromorphic computing with nanoscale spintronic oscillators , 2017, Nature.

[24]  E. Izhikevich,et al.  Oscillatory Neurocomputers with Dynamic Connectivity , 1999 .

[25]  Damien Querlioz,et al.  A Nanotechnology-Ready Computing Scheme based on a Weakly Coupled Oscillator Network , 2017, Scientific Reports.

[26]  Harish Krishnaswamy,et al.  19.4 A 0.0049mm2 2.3GHz sub-sampling ring-oscillator PLL with time-based loop filter achieving −236.2dB jitter-FOM , 2017, 2017 IEEE International Solid-State Circuits Conference (ISSCC).

[27]  Suman Datta,et al.  Exploiting Synchronization Properties of Correlated Electron Devices in a Non-Boolean Computing Fabric for Template Matching , 2014, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[28]  James A. Bain,et al.  Phase Coupling and Control of Oxide-Based Oscillators for Neuromorphic Computing , 2015, IEEE Journal on Exploratory Solid-State Computational Devices and Circuits.

[29]  James A. Bain,et al.  Oscillatory Neural Networks Based on TMO Nano-Oscillators and Multi-Level RRAM Cells , 2015, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[30]  Suman Datta,et al.  Synchronization of pairwise-coupled, identical, relaxation oscillators based on metal- insulator phase transition devices: A model study , 2014 .

[31]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[32]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[33]  G J Milburn,et al.  Synchronization of many nanomechanical resonators coupled via a common cavity field. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[34]  Arnaud Magrez,et al.  Elevated transition temperature in Ge doped VO2 thin films , 2017 .

[35]  Poras T. Balsara,et al.  1.3 V 20 ps time-to-digital converter for frequency synthesis in 90-nm CMOS , 2006, IEEE Transactions on Circuits and Systems II: Express Briefs.

[36]  P. Holmes,et al.  Bifurcation of periodic motions in two weakly coupled van der Pol oscillators , 1980 .

[37]  Adrian M. Ionescu,et al.  Resistive Coupled VO2 Oscillators for Image Recognition , 2018, 2018 IEEE International Conference on Rebooting Computing (ICRC).