Neuromemristive Circuits for Edge Computing: A Review

The volume, veracity, variability, and velocity of data produced from the ever increasing network of sensors connected to Internet pose challenges for power management, scalability, and sustainability of cloud computing infrastructure. Increasing the data processing capability of edge computing devices at lower power requirements can reduce several overheads for cloud computing solutions. This paper provides the review of neuromorphic CMOS-memristive architectures that can be integrated into edge computing devices. We discuss why the neuromorphic architectures are useful for edge devices and show the advantages, drawbacks, and open problems in the field of neuromemristive circuits for edge computing.

[1]  Farnood Merrikh-Bayat,et al.  Training and operation of an integrated neuromorphic network based on metal-oxide memristors , 2014, Nature.

[2]  Vishal Saxena,et al.  Homogeneous Spiking Neuromorphic System for Real-World Pattern Recognition , 2015, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[3]  Alex Pappachen James,et al.  Neuron inspired data encoding memristive multi-level memory cell , 2018, ArXiv.

[4]  Kyoung-Rok Cho,et al.  Memristor MOS Content Addressable Memory (MCAM): Hybrid Architecture for Future High Performance Search Engines , 2010, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[5]  Uri C. Weiser,et al.  TEAM: ThrEshold Adaptive Memristor Model , 2013, IEEE Transactions on Circuits and Systems I: Regular Papers.

[6]  Dalibor Biolek,et al.  Memristor models for SPICE simulation of extremely large memristive networks , 2016, 2016 IEEE International Symposium on Circuits and Systems (ISCAS).

[7]  Sumio Hosaka,et al.  Handwritten-Digit Recognition by Hybrid Convolutional Neural Network based on HfO2 Memristive Spiking-Neuron , 2018, Scientific Reports.

[8]  Gert Cauwenberghs,et al.  Inherently stochastic spiking neurons for probabilistic neural computation , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[9]  V. Derycke,et al.  Electro-grafted organic memristors: Properties and prospects for artificial neural networks based on STDP , 2014, 14th IEEE International Conference on Nanotechnology.

[10]  Tarek R. Sheltami,et al.  Fog Computing: Data Streaming Services for Mobile End-Users , 2018, FNC/MobiSPC.

[11]  Leon O. Chua,et al.  A Circuit-Based Learning Architecture for Multilayer Neural Networks With Memristor Bridge Synapses , 2015, IEEE Transactions on Circuits and Systems I: Regular Papers.

[12]  Antonio Pflüger,et al.  Executive Summary. , 2012, Journal of the ICRU.

[13]  Qing Wu,et al.  Long short-term memory networks in memristor crossbar arrays , 2018, Nature Machine Intelligence.

[14]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[15]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[16]  L. Chua Memristor-The missing circuit element , 1971 .

[17]  Jose A. Moreno-Cadenas,et al.  Memristive recurrent neural network , 2018, Neurocomputing.

[18]  Dong Wang,et al.  Complex Learning in Bio-plausible Memristive Networks , 2015, Scientific Reports.

[19]  Ali Khiat,et al.  Unsupervised learning in probabilistic neural networks with multi-state metal-oxide memristive synapses , 2016, Nature Communications.

[20]  Miodrag Potkonjak,et al.  Hardware security strategies exploiting nanoelectronic circuits , 2013, 2013 18th Asia and South Pacific Design Automation Conference (ASP-DAC).

[21]  Tarek M. Taha,et al.  Enabling back propagation training of memristor crossbar neuromorphic processors , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[22]  Alex Pappachen James,et al.  Introduction to Memristive HTM Circuits , 2018 .

[23]  Alex Pappachen James,et al.  HTM Spatial Pooler With Memristor Crossbar Circuits for Sparse Biometric Recognition , 2017, IEEE Transactions on Biomedical Circuits and Systems.

[24]  Tarik Taleb,et al.  Edge Computing for the Internet of Things: A Case Study , 2018, IEEE Internet of Things Journal.

[25]  Giacomo Indiveri,et al.  Beyond spike-timing dependent plasticity in memristor crossbar arrays , 2016, 2016 IEEE International Symposium on Circuits and Systems (ISCAS).

[26]  Hao Yu,et al.  An energy-efficient and high-throughput bitwise CNN on sneak-path-free digital ReRAM crossbar , 2017, 2017 IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED).

[27]  Catherine D. Schuman,et al.  A Survey of Neuromorphic Computing and Neural Networks in Hardware , 2017, ArXiv.

[28]  Fei Zhou,et al.  Demonstration of Synaptic Behaviors and Resistive Switching Characterizations by Proton Exchange Reactions in Silicon Oxide , 2016, Scientific Reports.

[29]  Shukai Duan,et al.  A Memristive Multilayer Cellular Neural Network With Applications to Image Processing , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[30]  Peng Lin,et al.  Fully memristive neural networks for pattern classification with unsupervised learning , 2018 .

[31]  Jintao Yu,et al.  Interconnect networks for resistive computing architectures , 2017, 2017 12th International Conference on Design & Technology of Integrated Systems In Nanoscale Era (DTIS).

[32]  Pierre Boulet,et al.  Combining a volatile and nonvolatile memristor in artificial synapse to improve learning in Spiking Neural Networks , 2016, 2016 IEEE/ACM International Symposium on Nanoscale Architectures (NANOARCH).

[33]  Damien Querlioz,et al.  Simulation of a memristor-based spiking neural network immune to device variations , 2011, The 2011 International Joint Conference on Neural Networks.

[34]  Daniel Soudry,et al.  A fully analog memristor-based neural network with online gradient training , 2016, 2016 IEEE International Symposium on Circuits and Systems (ISCAS).

[35]  J. Yang,et al.  Switching dynamics in titanium dioxide memristive devices , 2009 .

[36]  Hai Helen Li,et al.  Spintronic Memristor Through Spin-Torque-Induced Magnetization Motion , 2009, IEEE Electron Device Letters.

[37]  Hao Jiang,et al.  Cyclical sensing integrate-and-fire circuit for memristor array based neuromorphic computing , 2016, 2016 IEEE International Symposium on Circuits and Systems (ISCAS).

[38]  H.-S. Philip Wong,et al.  Face classification using electronic synapses , 2017, Nature Communications.

[39]  Vahid Keshmiri,et al.  A Study of the Memristor Models and Applications , 2014 .

[40]  Alex Pappachen James,et al.  Hierarchical Temporal Memory Features with Memristor Logic Circuits for Pattern Recognition , 2018, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[41]  Xiaobo Sharon Hu A Cross-Layer Perspective for Energy Efficient Processing: - From beyond-CMOS Devices to Deep Learning , 2018, ACM Great Lakes Symposium on VLSI.

[42]  Byoungil Lee,et al.  Nanoelectronic programmable synapses based on phase change materials for brain-inspired computing. , 2012, Nano letters.

[43]  Spyros Stathopoulos,et al.  A Data-Driven Verilog-A ReRAM Model , 2018, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[44]  Zhaohao Wang,et al.  Ferroelectric tunnel memristor-based neuromorphic network with 1T1R crossbar architecture , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[45]  Pinaki Mazumder,et al.  CMOS and Memristor-Based Neural Network Design for Position Detection , 2012, Proceedings of the IEEE.

[46]  Qing Wu,et al.  Efficient and self-adaptive in-situ learning in multilayer memristor neural networks , 2018, Nature Communications.

[47]  J. Yang,et al.  State Dynamics and Modeling of Tantalum Oxide Memristors , 2013, IEEE Transactions on Electron Devices.

[48]  Balwinder Raj,et al.  Comparative analysis of memristor models and memories design , 2018, Journal of Semiconductors.

[49]  Dalibor Biolek,et al.  SPICE Model of Memristor with Nonlinear Dopant Drift , 2009 .

[50]  Alex Pappachen James,et al.  Analog Backpropagation Learning Circuits for Memristive Crossbar Neural Networks , 2018, 2018 IEEE International Symposium on Circuits and Systems (ISCAS).

[51]  Chris Yakopcic,et al.  On-chip training of memristor crossbar based multi-layer neural networks , 2017, Microelectron. J..

[52]  Gert Cauwenberghs,et al.  Memristors Empower Spiking Neurons With Stochasticity , 2015, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[53]  Kaushik Roy,et al.  Hierarchical Temporal Memory Based on Spin-Neurons and Resistive Memory for Energy-Efficient Brain-Inspired Computing , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[54]  Majid Ahmadi,et al.  Hyperbolic tangent passive resistive-type neuron , 2015, 2015 IEEE International Symposium on Circuits and Systems (ISCAS).

[55]  Kaushik Roy,et al.  M2CA: Modular Memristive Crossbar Arrays , 2018, 2018 IEEE International Symposium on Circuits and Systems (ISCAS).

[56]  Alex Pappachen James,et al.  Resistive Threshold Logic , 2013, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[57]  D. Stewart,et al.  The missing memristor found , 2008, Nature.

[58]  Leon O. Chua,et al.  Neural Synaptic Weighting With a Pulse-Based Memristor Circuit , 2012, IEEE Transactions on Circuits and Systems I: Regular Papers.

[59]  Mauro Forti,et al.  Memristor standard cellular neural networks computing in the flux-charge domain , 2017, Neural Networks.

[60]  Runze Han,et al.  Design and Hardware Implementation of Neuromorphic Systems With RRAM Synapses and Threshold-Controlled Neurons for Pattern Recognition , 2018, IEEE Transactions on Circuits and Systems I: Regular Papers.

[61]  Liam McDaid,et al.  Scalable Hierarchical Network-on-Chip Architecture for Spiking Neural Network Hardware Implementations , 2013, IEEE Transactions on Parallel and Distributed Systems.

[62]  Alex Pappachen James,et al.  Design and implication of a rule based weight sparsity module in HTM spatial pooler , 2017, 2017 24th IEEE International Conference on Electronics, Circuits and Systems (ICECS).

[63]  Alexantrou Serb,et al.  HfO2-based memristors for neuromorphic applications , 2016, 2016 IEEE International Symposium on Circuits and Systems (ISCAS).

[64]  J. Yang,et al.  High switching endurance in TaOx memristive devices , 2010 .

[65]  Weisong Shi,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[66]  Alex Pappachen James,et al.  A memristor-based long short term memory circuit , 2018 .

[67]  Miodrag Potkonjak,et al.  Nano-PPUF: A Memristor-Based Security Primitive , 2012, 2012 IEEE Computer Society Annual Symposium on VLSI.

[68]  Hyunsang Hwang,et al.  Neuromorphic Character Recognition System With Two PCMO Memristors as a Synapse , 2014, IEEE Transactions on Industrial Electronics.

[69]  Emmanuelle M. Grafals,et al.  Voltage divider effect for the improvement of variability and endurance of TaOx memristor , 2016, Scientific Reports.

[70]  J. Simmons Generalized Formula for the Electric Tunnel Effect between Similar Electrodes Separated by a Thin Insulating Film , 1963 .

[71]  Ligang Gao,et al.  High precision tuning of state for memristive devices by adaptable variation-tolerant algorithm , 2011, Nanotechnology.

[72]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[73]  Eby G. Friedman,et al.  Memristor-Based Circuit Design for Multilayer Neural Networks , 2018, IEEE Transactions on Circuits and Systems I: Regular Papers.

[74]  Miao Hu,et al.  ISAAC: A Convolutional Neural Network Accelerator with In-Situ Analog Arithmetic in Crossbars , 2016, 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA).

[75]  J. Yang,et al.  Sub-10 nm Ta Channel Responsible for Superior Performance of a HfO2 Memristor , 2016, Scientific Reports.

[76]  Jafar Shamsi,et al.  A Hardware Architecture for Columnar-Organized Memory Based on CMOS Neuron and Memristor Crossbar Arrays , 2018, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[77]  Hao Zhu,et al.  CMOS Compatible Bio-Realistic Implementation with Ag/HfO2-Based Synaptic Nanoelectronics for Artificial Neuromorphic System , 2018 .

[78]  Chris Yakopcic,et al.  Memristor crossbar deep network implementation based on a Convolutional neural network , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[79]  Alex Pappachen James,et al.  Approximate Probabilistic Neural Networks with Gated Threshold Logic , 2018, 2018 IEEE 18th International Conference on Nanotechnology (IEEE-NANO).

[80]  Alex Pappachen James,et al.  Neuromorphic Adaptive Edge-Preserving Denoising Filter , 2017, 2017 IEEE International Conference on Rebooting Computing (ICRC).

[81]  Dotan Di Castro,et al.  Hebbian Learning Rules with Memristors , 2013 .

[82]  Domenic Forte,et al.  Memristor PUF—A Security Primitive: Theory and Experiment , 2015, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[83]  J. Yang,et al.  Memristors with diffusive dynamics as synaptic emulators for neuromorphic computing. , 2017, Nature materials.

[84]  A. Martínez,et al.  The AR face databasae , 1998 .

[85]  Jin-Woo Han,et al.  Capacitive neural network with neuro-transistors , 2018, Nature Communications.

[86]  Alex Pappachen James,et al.  Learning in Memristive Neural Network Architectures Using Analog Backpropagation Circuits , 2018, IEEE Transactions on Circuits and Systems I: Regular Papers.

[87]  Rawan Naous,et al.  Stochasticity Modeling in Memristors , 2016, IEEE Transactions on Nanotechnology.

[88]  Alex Pappachen James,et al.  Bit-Plane Extracted Moving-Object Detection Using Memristive Crossbar-CAM Arrays for Edge Computing Image Devices , 2018, IEEE Access.

[89]  Fernando Corinto,et al.  Memristor-based cellular nanoscale networks: Theory, circuits, and applications , 2015, 2015 IEEE International Symposium on Circuits and Systems (ISCAS).

[90]  Stephen J. Wolf,et al.  The elusive memristor: properties of basic electrical circuits , 2008, 0807.3994.

[91]  Said Hamdioui,et al.  Interconnect networks for memristor crossbar , 2015, Proceedings of the 2015 IEEE/ACM International Symposium on Nanoscale Architectures (NANOARCH´15).

[92]  D. George,et al.  Hierarchical Temporal Memory Concepts , Theory , and Terminology , 2006 .

[93]  Alex Pappachen James Memristor Threshold Logic: An Overview to Challenges and Applications , 2016, ArXiv.

[94]  Eby G. Friedman,et al.  Synaptic Characteristics of Ag/AgInSbTe/Ta-Based Memristor for Pattern Recognition Applications , 2017, IEEE Transactions on Electron Devices.

[95]  Kaushik Roy,et al.  An All-Memristor Deep Spiking Neural Network: A Step Towards Realizing the Low Power, Stochastic Brain , 2017, ArXiv.

[96]  Yiran Chen,et al.  Memristor Crossbar-Based Neuromorphic Computing System: A Case Study , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[97]  Alex Pappachen James,et al.  Binary Weighted Memristive Analog Deep Neural Network for Near-Sensor Edge Processing , 2018, 2018 IEEE 18th International Conference on Nanotechnology (IEEE-NANO).

[98]  Marimuthu Palaniswami,et al.  Internet of Things (IoT): A vision, architectural elements, and future directions , 2012, Future Gener. Comput. Syst..

[99]  Yu Wang,et al.  A Compact Memristor-Based Dynamic Synapse for Spiking Neural Networks , 2017, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[100]  Chris Yakopcic,et al.  Extremely parallel memristor crossbar architecture for convolutional neural network implementation , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[101]  Alex Pappachen James,et al.  Memristive LSTM network hardware architecture for time-series predictive modeling problems , 2018, 2018 IEEE Asia Pacific Conference on Circuits and Systems (APCCAS).

[102]  Catherine D. Schuman,et al.  Energy and Area Efficiency in Neuromorphic Computing for Resource Constrained Devices , 2018, ACM Great Lakes Symposium on VLSI.

[103]  Shukai Duan,et al.  Memristor-Based Cellular Nonlinear/Neural Network: Design, Analysis, and Applications , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[104]  Matthew D. Pickett,et al.  SPICE modeling of memristors , 2011, 2011 IEEE International Symposium of Circuits and Systems (ISCAS).

[105]  D. Batas,et al.  A Memristor SPICE Implementation and a New Approach for Magnetic Flux-Controlled Memristor Modeling , 2011, IEEE Transactions on Nanotechnology.

[106]  Catherine D. Schuman,et al.  Memristive Mixed-Signal Neuromorphic Systems: Energy-Efficient Learning at the Circuit-Level , 2018, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[107]  Peng Lin,et al.  A provable key destruction scheme based on memristive crossbar arrays , 2018, Nature Electronics.

[108]  Majid Ahmadi,et al.  Analog Implementation of a Novel Resistive-Type Sigmoidal Neuron , 2012, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[109]  Uri C. Weiser,et al.  Memristor-Based Material Implication (IMPLY) Logic: Design Principles and Methodologies , 2014, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[110]  Zhigang Zeng,et al.  Region stability analysis and tracking control of memristive recurrent neural network , 2018, Neural Networks.

[111]  Narayan Srinivasa,et al.  A functional hybrid memristor crossbar-array/CMOS system for data storage and neuromorphic applications. , 2012, Nano letters.

[112]  Seong-Whan Lee,et al.  A new recurrent neural-network architecture for visual pattern recognition , 1997, IEEE Trans. Neural Networks.

[113]  Jeyavijayan Rajendran,et al.  Regaining Trust in VLSI Design: Design-for-Trust Techniques , 2014, Proceedings of the IEEE.

[114]  Leon O. Chua,et al.  Hodgkin-Huxley Axon is Made of memristors , 2012, Int. J. Bifurc. Chaos.

[115]  Alex Pappachen James,et al.  Hierarchical Temporal Memory Using Memristor Networks: A Survey , 2018, IEEE Transactions on Emerging Topics in Computational Intelligence.

[116]  J. Hawkins,et al.  On Intelligence , 2004 .

[117]  Kyeong-Sik Min,et al.  Synaptic weighting circuits for Cellular Neural Networks , 2012, 2012 13th International Workshop on Cellular Nanoscale Networks and their Applications.

[118]  G. Cauwenberghs,et al.  Memristor-based neural networks: Synaptic versus neuronal stochasticity , 2016 .

[119]  Yu Wang,et al.  TIME: A training-in-memory architecture for memristor-based deep neural networks , 2017, 2017 54th ACM/EDAC/IEEE Design Automation Conference (DAC).

[120]  Janusz A. Starzyk,et al.  Memristor Crossbar Architecture for Synchronous Neural Networks , 2014, IEEE Transactions on Circuits and Systems I: Regular Papers.

[121]  Leon O. Chua,et al.  Memristor Bridge Synapses , 2012, Proceedings of the IEEE.

[122]  Schahram Dustdar,et al.  Going Back to the Roots—The Evolution of Edge Computing, An IoT Perspective , 2018, IEEE Internet Computing.

[123]  Mahadev Satyanarayanan,et al.  The Emergence of Edge Computing , 2017, Computer.

[124]  L. Deng,et al.  The MNIST Database of Handwritten Digit Images for Machine Learning Research [Best of the Web] , 2012, IEEE Signal Processing Magazine.

[125]  D. Strukov,et al.  Phenomenological modeling of memristive devices , 2014, 1406.4219.

[126]  Yu Wang,et al.  Switched by input: Power efficient structure for RRAM-based convolutional neural network , 2016, 2016 53nd ACM/EDAC/IEEE Design Automation Conference (DAC).

[127]  Alex Pappachen James,et al.  A Survey of Memristive Threshold Logic Circuits , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[128]  B. Rajendran,et al.  Arbitrary Spike Time Dependent Plasticity (STDP) in Memristor by Analog Waveform Engineering , 2017, IEEE Electron Device Letters.

[129]  Dan Williams,et al.  Platform Storage Performance With 3D XPoint Technology , 2017, Proceedings of the IEEE.

[130]  R. K. Gnanamurthy,et al.  A detailed survey on 2D and 3D still face and face video databases part I , 2014, ICC 2014.

[131]  Mark D. Humphries,et al.  Dendrites enhance both single neuron and network computation , 2014 .

[132]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[133]  LeeSeong-Whan,et al.  A new recurrent neural-network architecture for visual pattern recognition , 1997 .

[134]  Shahar Kvatinsky,et al.  DIDACTIC: A Data-Intelligent Digital-to-Analog Converter with a Trainable Integrated Circuit using Memristors , 2018, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[135]  Khaled Ben Letaief,et al.  Dynamic Computation Offloading for Mobile-Edge Computing With Energy Harvesting Devices , 2016, IEEE Journal on Selected Areas in Communications.

[136]  Chris Yakopcic,et al.  Memristor based neuromorphic circuit for ex-situ training of multi-layer neural network algorithms , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[137]  Dalibor Biolek,et al.  Modeling and simulation of large memristive networks , 2018, Int. J. Circuit Theory Appl..

[138]  Khaled N. Salama,et al.  Memristor-based memory: The sneak paths problem and solutions , 2013, Microelectron. J..

[139]  Alex Pappachen James,et al.  Feature extraction without learning in an analog spatial pooler memristive-CMOS circuit design of hierarchical temporal memory , 2018, ArXiv.

[140]  R. Waser,et al.  Memristors: Devices, Models, and Applications , 2012 .

[141]  T. Serrano-Gotarredona,et al.  A Proposal for Hybrid Memristor-CMOS Spiking Neuromorphic Learning Systems , 2013, IEEE Circuits and Systems Magazine.

[142]  Bartlett W. Mel,et al.  Encoding and Decoding Bursts by NMDA Spikes in Basal Dendrites of Layer 5 Pyramidal Neurons , 2009, The Journal of Neuroscience.

[143]  S. Benderli,et al.  On SPICE macromodelling of TiO 2 memristors , 2009 .

[144]  Fabien Alibart,et al.  Pattern classification by memristive crossbar circuits using ex situ and in situ training , 2013, Nature Communications.

[145]  Kamalika Datta,et al.  A Scalable In-Memory Logic Synthesis Approach Using Memristor Crossbar , 2017, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[146]  György Cserey,et al.  Macromodeling of the Memristor in SPICE , 2010, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[147]  L. Goux,et al.  Intrinsic switching variability in HfO2 RRAM , 2013, 2013 5th IEEE International Memory Workshop.

[148]  Nishil Talati,et al.  Logic Design Within Memristive Memories Using Memristor-Aided loGIC (MAGIC) , 2016, IEEE Transactions on Nanotechnology.

[149]  Andrew B. Kahng,et al.  Scaling: More than Moore's law , 2010, IEEE Design & Test of Computers.

[150]  Xiaoping Wang,et al.  A Novel Design for Memristor-Based Logic Switch and Crossbar Circuits , 2015, IEEE Transactions on Circuits and Systems I: Regular Papers.

[151]  Baker Mohammad,et al.  Memristor Technology: Synthesis and Modeling for Sensing and Security Applications , 2017 .

[152]  Zhigang Zeng,et al.  GST-memristor-based online learning neural networks , 2018, Neurocomputing.

[153]  Yu Wang,et al.  Binary convolutional neural network on RRAM , 2017, 2017 22nd Asia and South Pacific Design Automation Conference (ASP-DAC).

[154]  Bo Shen,et al.  Discrete-time memristive recurrent neural networks with time-varying delays: Exponential stability analysis , 2016, 2016 35th Chinese Control Conference (CCC).

[155]  Afiya Ayman,et al.  Simulations of threshold logic unit problems using memristor based synapses and CMOS neuron , 2017, 2017 3rd International Conference on Electrical Information and Communication Technology (EICT).

[156]  Byung-Gook Park,et al.  Analog Synaptic Behavior of a Silicon Nitride Memristor. , 2017, ACS applied materials & interfaces.

[157]  Michael Unser,et al.  Convolutional Neural Networks for Inverse Problems in Imaging: A Review , 2017, IEEE Signal Processing Magazine.

[158]  Said Hamdioui,et al.  Alternative Architectures Toward Reliable Memristive Crossbar Memories , 2016, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[159]  Yutaka Maeda,et al.  Simultaneous perturbation learning rule for recurrent neural networks and its FPGA implementation , 2005, IEEE Transactions on Neural Networks.

[160]  C. Toumazou,et al.  A Versatile Memristor Model With Nonlinear Dopant Kinetics , 2011, IEEE Transactions on Electron Devices.

[161]  Alex Pappachen James,et al.  Design of CMOS-memristor Circuits for LSTM architecture , 2018, 2018 IEEE International Conference on Electron Devices and Solid State Circuits (EDSSC).

[162]  Parami Wijesinghe,et al.  An All-Memristor Deep Spiking Neural Computing System: A Step Toward Realizing the Low-Power Stochastic Brain , 2017, IEEE Transactions on Emerging Topics in Computational Intelligence.

[163]  Peter Tiño,et al.  Artificial Neural Network Models , 2015, Handbook of Computational Intelligence.

[164]  Subutai Ahmad,et al.  Why Neurons Have Thousands of Synapses, a Theory of Sequence Memory in Neocortex , 2015, Front. Neural Circuits.

[165]  Zenghui Wang,et al.  Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review , 2017, Neural Computation.

[166]  Aggelos K. Katsaggelos,et al.  Video Super-Resolution With Convolutional Neural Networks , 2016, IEEE Transactions on Computational Imaging.

[167]  Kehan Zhu,et al.  A CMOS spiking neuron for dense memristor-synapse connectivity for brain-inspired computing , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[168]  Rajiv V. Joshi,et al.  An Energy-Efficient Digital ReRAM-Crossbar-Based CNN With Bitwise Parallelism , 2017, IEEE Journal on Exploratory Solid-State Computational Devices and Circuits.

[169]  Jiaming Zhang,et al.  Analogue signal and image processing with large memristor crossbars , 2018 .

[170]  Raúl Rojas,et al.  Neural Networks - A Systematic Introduction , 1996 .

[171]  Xiaofeng Liao,et al.  Synchronization and chaos in coupled memristor-based FitzHugh-Nagumo circuits with memristor synapse , 2017 .

[172]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[173]  Leon O. Chua,et al.  Memristor Bridge Synapse-Based Neural Network and Its Learning , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[174]  Alex Pappachen James,et al.  On-chip face recognition system design with memristive Hierarchical Temporal Memory , 2018, J. Intell. Fuzzy Syst..

[175]  Xinyu Yang,et al.  A Survey on Internet of Things: Architecture, Enabling Technologies, Security and Privacy, and Applications , 2017, IEEE Internet of Things Journal.

[176]  Avinoam Kolodny,et al.  Memristor-Based Multilayer Neural Networks With Online Gradient Descent Training , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[177]  Lin-Bao Yang,et al.  Cellular neural networks: theory , 1988 .

[178]  Antonio Rubio,et al.  Memristive Crossbar Memory Lifetime Evaluation and Reconfiguration Strategies , 2018, IEEE Transactions on Emerging Topics in Computing.

[179]  Jonathan G. Fiscus,et al.  DARPA TIMIT:: acoustic-phonetic continuous speech corpus CD-ROM, NIST speech disc 1-1.1 , 1993 .

[180]  Ian A. Young,et al.  CMOS Scaling Trends and Beyond , 2017, IEEE Micro.