Graphene–ferroelectric transistors as complementary synapses for supervised learning in spiking neural network

The hardware design of supervised learning (SL) in spiking neural network (SNN) prefers 3-terminal memristive synapses, where the third terminal is used to impose supervise signals. In this work we address this demand by fabricating graphene transistor gated through organic ferroelectrics of polyvinylidene fluoride. Through gate tuning not only is the nonvolatile and continuous change of graphene channel conductance demonstrated, but also the transition between electron-dominated and hole-dominated transport. By exploiting the adjustable bipolar characteristic, the graphene–ferroelectric transistor can be electrically reconfigured as potentiative or depressive synapse and in this way complementary synapses are realized. The complementary synapse and neuron circuit is then constructed to execute remote supervise method (ReSuMe) of SNN, and quick convergence to successful learning is found through network-level simulation when applying to a SL task of classifying 3 × 3-pixel images. The presented design of graphene–ferroelectric transistor-based complementary synapses and quantitative simulation may indicate a potential approach to hardware implementation of SL in SNN.

[1]  Jae-Joon Kim,et al.  Input Voltage Mapping Optimized for Resistive Memory-Based Deep Neural Network Hardware , 2017, IEEE Electron Device Letters.

[2]  T. Morie,et al.  Three-terminal ferroelectric synapse device with concurrent learning function for artificial neural networks , 2012 .

[3]  Shimeng Yu,et al.  Synaptic electronics: materials, devices and applications , 2013, Nanotechnology.

[4]  J. U. Lee,et al.  Bipolar Junction Transistors in Two-Dimensional WSe2 with Large Current and Photocurrent Gains. , 2016, Nano letters.

[5]  Kristian Sommer Thygesen,et al.  Computational 2D Materials Database: Electronic Structure of Transition-Metal Dichalcogenides and Oxides , 2015, 1506.02841.

[6]  Yi Yang,et al.  A novel artificial synapse with dual modes using bilayer graphene as the bottom electrode. , 2017, Nanoscale.

[7]  Ru Huang,et al.  Multifunctional Nanoionic Devices Enabling Simultaneous Heterosynaptic Plasticity and Efficient In‐Memory Boolean Logic , 2017 .

[8]  J. Joshua Yang Memristor Crossbar Arrays for Analog and Neuromorphic Computing , 2018 .

[9]  Lin Sun,et al.  A Robust Artificial Synapse Based on Organic Ferroelectric Polymer , 2018, Advanced Electronic Materials.

[10]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[11]  Yukihiro Kaneko,et al.  Supervised Learning Using Spike-Timing-Dependent Plasticity of Memristive Synapses , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[12]  Shimeng Yu,et al.  Mitigating effects of non-ideal synaptic device characteristics for on-chip learning , 2015, 2015 IEEE/ACM International Conference on Computer-Aided Design (ICCAD).

[13]  Nicolas Locatelli,et al.  Learning through ferroelectric domain dynamics in solid-state synapses , 2017, Nature Communications.

[14]  Carver A. Mead,et al.  Neuromorphic electronic systems , 1990, Proc. IEEE.

[15]  K. Yao,et al.  Graphene field-effect transistors with ferroelectric gating. , 2010, Physical review letters.

[16]  N. Setter,et al.  Long-term retention in organic ferroelectric-graphene memories , 2012 .

[17]  K. Yao,et al.  Gate-controlled nonvolatile graphene-ferroelectric memory , 2009, 0904.1326.

[18]  E. Vianello,et al.  Bio-Inspired Stochastic Computing Using Binary CBRAM Synapses , 2013, IEEE Transactions on Electron Devices.

[19]  Sander M. Bohte,et al.  Error-backpropagation in temporally encoded networks of spiking neurons , 2000, Neurocomputing.

[20]  Catherine E. Graves,et al.  Memristor‐Based Analog Computation and Neural Network Classification with a Dot Product Engine , 2018, Advanced materials.

[21]  Shimeng Yu,et al.  A Low Energy Oxide‐Based Electronic Synaptic Device for Neuromorphic Visual Systems with Tolerance to Device Variation , 2013, Advanced materials.

[22]  Byoungil Lee,et al.  Nanoelectronic programmable synapses based on phase change materials for brain-inspired computing. , 2012, Nano letters.

[23]  J Joshua Yang,et al.  Memristive devices for computing. , 2013, Nature nanotechnology.

[24]  Zhi Jin,et al.  Reconfigurable Artificial Synapses between Excitatory and Inhibitory Modes Based on Single‐Gate Graphene Transistors , 2019, Advanced Electronic Materials.

[25]  Wulfram Gerstner,et al.  Neuronal Dynamics: From Single Neurons To Networks And Models Of Cognition , 2014 .

[26]  Peng Lin,et al.  Fully memristive neural networks for pattern classification with unsupervised learning , 2018 .

[27]  H.-S. Philip Wong,et al.  Face classification using electronic synapses , 2017, Nature Communications.

[28]  Pritish Narayanan,et al.  Experimental Demonstration and Tolerancing of a Large-Scale Neural Network (165 000 Synapses) Using Phase-Change Memory as the Synaptic Weight Element , 2014, IEEE Transactions on Electron Devices.

[29]  D. Ielmini,et al.  Novel RRAM-enabled 1T1R synapse capable of low-power STDP via burst-mode communication and real-time unsupervised machine learning , 2016, 2016 IEEE Symposium on VLSI Technology.

[30]  Stefan Schliebs,et al.  Span: Spike Pattern Association Neuron for Learning Spatio-Temporal Spike Patterns , 2012, Int. J. Neural Syst..

[31]  Shimeng Yu,et al.  Ferroelectric FET analog synapse for acceleration of deep neural network training , 2017, 2017 IEEE International Electron Devices Meeting (IEDM).

[32]  Andrzej J. Kasinski,et al.  Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification, and Spike Shifting , 2010, Neural Computation.

[33]  Yi Yang,et al.  Graphene Dynamic Synapse with Modulatable Plasticity. , 2015, Nano letters.

[34]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[35]  H. Kim,et al.  RRAM-based synapse for neuromorphic system with pattern recognition function , 2012, 2012 International Electron Devices Meeting.

[36]  Xiaochen Peng,et al.  NeuroSim+: An integrated device-to-algorithm framework for benchmarking synaptic devices and array architectures , 2017, 2017 IEEE International Electron Devices Meeting (IEDM).

[37]  Stefan Schliebs,et al.  Training spiking neural networks to associate spatio-temporal input-output spike patterns , 2013, Neurocomputing.