Oscillatory Neural Networks for Edge AI Computing

In this paper, we showcase the innovative concept of implementing Oscillatory Neural Networks (ONNs) for neuromorphic computing with beyond-CMOS devices based on vanadium dioxide to mimic neurons and resistors to emulate synapses. We explore ONN technology potentials from device to analog circuit-level simulations. We report that ONN behaves like an associative memory and can implement energy-based models such as Hopfield Neural Networks on edge devices. Finally, as a proof of concept, a reconfigurable digital ONN is implemented on FPGA for pattern recognition tasks.

[1]  P. Alam.  ‘A’ , 2021, Composites Engineering: An A–Z Guide.

[2]  Giyong Lee,et al.  Investigation of length-dependent characteristics of the voltage-induced metal insulator transition in VO2 film devices , 2014 .

[3]  Joel Emer,et al.  A method to estimate the energy consumption of deep neural networks , 2017, 2017 51st Asilomar Conference on Signals, Systems, and Computers.

[4]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[5]  W. Hager,et al.  and s , 2019, Shallow Water Hydraulics.

[6]  Ivan K Schuller,et al.  Role of thermal heating on the voltage induced insulator-metal transition in VO2. , 2013, Physical review letters.

[7]  Adrian M. Ionescu,et al.  Resistive Coupled VO2 Oscillators for Image Recognition , 2018, 2018 IEEE International Conference on Rebooting Computing (ICRC).

[8]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[9]  H. Bandulet,et al.  Phase diagram of the ultrafast photoinduced insulator-metal transition in vanadium dioxide , 2012 .

[10]  Wolfgang Porod,et al.  Computing With Networks of Oscillatory Dynamical Systems , 2019, Proceedings of the IEEE.

[11]  Adrian M. Ionescu,et al.  Coupled VO2 Oscillators Circuit as Analog First Layer Filter in Convolutional Neural Networks , 2020, Frontiers in Neuroscience.

[12]  G. Ermentrout,et al.  Neurons as oscillators. , 2016, Journal of neurophysiology.

[13]  Samuel Nascimento Pagliarini,et al.  An Oscillatory Neural Network with Programmable Resistive Synapses in 28 Nm CMOS , 2018, 2018 IEEE International Conference on Rebooting Computing (ICRC).

[14]  Myungsoo Kim,et al.  Atomristor: Nonvolatile Resistance Switching in Atomic Sheets of Transition Metal Dichalcogenides. , 2018, Nano letters.

[15]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[16]  Suman Datta,et al.  Modeling and Simulation of Vanadium Dioxide Relaxation Oscillators , 2015, IEEE Transactions on Circuits and Systems I: Regular Papers.

[17]  Jack D. Kendall,et al.  The building blocks of a brain-inspired computer , 2020 .

[18]  S. Datta,et al.  Ultra low power coupled oscillator arrays for computer vision applications , 2016, 2016 IEEE Symposium on VLSI Technology.

[19]  Massimo Merenda,et al.  Edge Machine Learning for AI-Enabled IoT Devices: A Review , 2020, Sensors.

[20]  Frank C. Hoppensteadt,et al.  Pattern recognition via synchronization in phase-locked loop neural networks , 2000, IEEE Trans. Neural Networks Learn. Syst..

[21]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[22]  Adrian M. Ionescu,et al.  Scaled resistively-coupled VO2 oscillators for neuromorphic computing , 2020 .

[23]  A. Todri-Sanial,et al.  Mapping Hebbian Learning Rules to Coupling Resistances for Oscillatory Neural Networks , 2021, Frontiers in Neuroscience.

[24]  B. Linares-Barranco,et al.  How Frequency Injection Locking Can Train Oscillatory Neural Networks to Compute in Phase , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[25]  Lei Zhang,et al.  Memristive devices based on emerging two-dimensional materials beyond graphene. , 2019, Nanoscale.

[26]  Shi Chen,et al.  Unraveling Mechanism on Reducing Thermal Hysteresis Width of VO2 by Ti Doping: A Joint Experimental and Theoretical Study , 2014 .

[27]  Kwang-Hyun Cho,et al.  537 Short Report , 2022 .

[28]  Xing Lan,et al.  Zero-static power radio-frequency switches based on MoS2 atomristors , 2018, Nature Communications.

[29]  Wolfgang Porod,et al.  Coupled oscillators for computing: A review and perspective , 2020 .

[30]  Stefan Debener,et al.  Synchronisation of Neural Oscillations and Cross-modal Influences , 2020, Trends in Cognitive Sciences.