Artificial van der Waals hybrid synapse and its application to acoustic pattern recognition

Brain-inspired parallel computing, which is typically performed using a hardware neural-network platform consisting of numerous artificial synapses, is a promising technology for effectively handling large amounts of informational data. However, the reported nonlinear and asymmetric conductance-update characteristics of artificial synapses prevent a hardware neural-network from delivering the same high-level training and inference accuracies as those delivered by a software neural-network. Here, we developed an artificial van-der-Waals hybrid synapse that features linear and symmetric conductance-update characteristics. Tungsten diselenide and molybdenum disulfide channels were used selectively to potentiate and depress conductance. Subsequently, via training and inference simulation, we demonstrated the feasibility of our hybrid synapse toward a hardware neural-network and also delivered high recognition rates that were comparable to those delivered using a software neural-network. This simulation involving the use of acoustic patterns was performed with a neural network that was theoretically formed with the characteristics of the hybrid synapses. Designing high-performance and energy efficient neural network hardware remains a challenge. Here, the authors develop a van der Waals hybrid synaptic device that features linear and symmetric conductance-update characteristics and demonstrate the feasibility for hardware neural network performing acoustic pattern recognition.

[1]  Shimeng Yu,et al.  Neuro-Inspired Computing With Emerging Nonvolatile Memorys , 2018, Proceedings of the IEEE.

[2]  Arindam Ghosh,et al.  A high-performance MoS2 synaptic device with floating gate engineering for neuromorphic computing , 2019, 2D Materials.

[3]  W. Hu,et al.  A Ferroelectric/Electrochemical Modulated Organic Synapse for Ultraflexible, Artificial Visual‐Perception System , 2018, Advanced materials.

[4]  B. Widrow,et al.  Stationary and nonstationary learning characteristics of the LMS adaptive filter , 1976, Proceedings of the IEEE.

[5]  J. Kim,et al.  Neuromorphic speech systems using advanced ReRAM-based synapse , 2013, 2013 IEEE International Electron Devices Meeting.

[6]  Defect-related photoluminescence of hexagonal boron nitride , 2008, 0810.3989.

[7]  H-S Philip Wong,et al.  Artificial optic-neural synapse for colored and color-mixed pattern recognition , 2018, Nature Communications.

[8]  T. Hou,et al.  A Fluorographene‐Based Synaptic Transistor , 2019, Advanced Materials Technologies.

[9]  P. Frigeri,et al.  Electrical transport and low frequency noise characteristics of Au/n-GaAs Schottky diodes containing InAs quantum dots , 2004 .

[10]  Sungho Kim,et al.  Impact of Synaptic Device Variations on Pattern Recognition Accuracy in a Hardware Neural Network , 2018, Scientific Reports.

[11]  Pritish Narayanan,et al.  Neuromorphic computing using non-volatile memory , 2017 .

[12]  Hyung-Min Lee,et al.  Analog CMOS-based resistive processing unit for deep neural network training , 2017, 2017 IEEE 60th International Midwest Symposium on Circuits and Systems (MWSCAS).

[13]  K. Tsukagoshi,et al.  Barrier inhomogeneities at vertically stacked graphene-based heterostructures. , 2014, Nanoscale.

[14]  Pritish Narayanan,et al.  Equivalent-accuracy accelerated neural-network training using analogue memory , 2018, Nature.

[15]  Jian Shi,et al.  A correlated nickelate synaptic transistor , 2013, Nature Communications.

[16]  Tianjiao Wang,et al.  Reversible photo-induced doping in WSe2 field effect transistors. , 2019, Nanoscale.

[17]  Eric Pop,et al.  Electronic synapses made of layered two-dimensional materials , 2018, Nature Electronics.

[18]  Xiaochen Peng,et al.  NeuroSim: A Circuit-Level Macro Model for Benchmarking Neuro-Inspired Architectures in Online Learning , 2018, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[19]  K. Novoselov,et al.  2D materials and van der Waals heterostructures , 2016, Science.

[20]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[21]  G. W. Burr,et al.  Experimental demonstration and tolerancing of a large-scale neural network (165,000 synapses), using phase-change memory as the synaptic weight element , 2015, 2014 IEEE International Electron Devices Meeting.

[22]  Shimeng Yu,et al.  Ferroelectric FET analog synapse for acceleration of deep neural network training , 2017, 2017 IEEE International Electron Devices Meeting (IEDM).

[23]  Shimeng Yu,et al.  Exploiting Hybrid Precision for Training and Inference: A 2T-1FeFET Based Analog Synaptic Weight Cell , 2018, 2018 IEEE International Electron Devices Meeting (IEDM).

[24]  Carver A. Mead,et al.  Neuromorphic electronic systems , 1990, Proc. IEEE.

[25]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[26]  John W. Backus,et al.  Can programming be liberated from the von Neumann style?: a functional style and its algebra of programs , 1978, CACM.

[27]  Saptarshi Das,et al.  Mimicking Neurotransmitter Release in Chemical Synapses via Hysteresis Engineering in MoS2 Transistors. , 2017, ACS nano.

[28]  M. Marinella,et al.  A non-volatile organic electrochemical device as a low-voltage artificial synapse for neuromorphic computing. , 2017, Nature materials.

[29]  Armantas Melianas,et al.  Parallel programming of an ionic floating-gate memory array for scalable neuromorphic computing , 2019, Science.

[30]  Seyong Oh,et al.  Recent Progress in Artificial Synapses Based on Two-Dimensional van der Waals Materials for Brain-Inspired Computing , 2020 .

[31]  Shimeng Yu,et al.  An Electronic Synapse Device Based on Metal Oxide Resistive Switching Memory for Neuromorphic Computation , 2011, IEEE Transactions on Electron Devices.

[32]  SUPARNA DUTTASINHA,et al.  Van der Waals heterostructures , 2013, Nature.

[33]  Farnood Merrikh-Bayat,et al.  Training and operation of an integrated neuromorphic network based on metal-oxide memristors , 2014, Nature.

[34]  Wei Zhang,et al.  Designing crystallization in phase-change materials for universal memory and neuro-inspired computing , 2019, Nature Reviews Materials.

[35]  Young Sun,et al.  All‐Solid‐State Synaptic Transistor with Ultralow Conductance for Neuromorphic Computing , 2018, Advanced Functional Materials.

[36]  R. Steinman,et al.  Taking dendritic cells into medicine , 2007, Nature.

[37]  Yongsuk Choi,et al.  Optoelectronic Synapse Based on IGZO‐Alkylated Graphene Oxide Hybrid Structure , 2018, Advanced Functional Materials.

[38]  Sung Ha Park,et al.  A Neuromorphic Device Implemented on a Salmon‐DNA Electrolyte and its Application to Artificial Neural Networks , 2019, Advanced science.

[39]  H.-S. Philip Wong,et al.  Phase Change Memory , 2010, Proceedings of the IEEE.

[40]  Igor Aharonovich,et al.  Quantum emission from hexagonal boron nitride monolayers , 2015, 2016 Conference on Lasers and Electro-Optics (CLEO).

[41]  Jong-Ho Lee,et al.  Adaptive learning rule for hardware-based deep neural networks using electronic synapse devices , 2018, Neural Computing and Applications.

[42]  Richard F. Lyon,et al.  A computational model of filtering, detection, and compression in the cochlea , 1982, ICASSP.

[43]  Young-Jun Yu,et al.  Controlled charge trapping by molybdenum disulphide and graphene in ultrathin heterostructured memory devices , 2013, Nature Communications.

[44]  Jang‐Sik Lee,et al.  Ferroelectric Analog Synaptic Transistors. , 2019, Nano letters.

[45]  H. Hwang,et al.  Improved Synaptic Behavior Under Identical Pulses Using AlOx/HfO2 Bilayer RRAM Array for Neuromorphic Systems , 2016, IEEE Electron Device Letters.

[46]  T. Hasegawa,et al.  Short-term plasticity and long-term potentiation mimicked in single inorganic synapses. , 2011, Nature materials.

[47]  Qing Wan,et al.  Artificial Synapses Based on in-Plane Gate Organic Electrochemical Transistors. , 2016, ACS applied materials & interfaces.

[48]  Dong-Ho Kang,et al.  Electronic and Optoelectronic Devices based on Two‐Dimensional Materials: From Fabrication to Application , 2017 .