Memristor Platforms for Pattern Recognition Memristor Theory, Systems and Applications

In the last decade a large scientific community has focused on the study of the memristor. The memristor is thought to be by many the best alternative to CMOS technology, which is gradually showing its flaws. Transistor technology has developed fast both under a research and an industrial point of view, reducing the size of its elements to the nano-scale. It has been possible to generate more and more complex machinery and to communicate with that same machinery thanks to the development of programming languages based on combinations of boolean operands. Alas as shown by Moore's law, the steep curve of implementation and of development of CMOS is gradually reaching a plateau. It is clear the need of studying new elements that can combine the efficiency of transistors and at the same time increase the complexity of the operations. Memristors can be described as non-linear resistors capable of maintaining memory of the resistance state that they reached. From their first theoretical treatment by Professor Leon O. Chua in 1971, different research groups have devoted their expertise in studying the both the fabrication and the implementation of this new promising technology. In the following thesis a complete study on memristors and memristive elements is presented. The road map that characterizes this study departs from a deep understanding of the physics that govern memristors, focusing on the HP model by Dr. Stanley Williams. Other devices such as phase change memories (PCMs) and memristive biosensors made with Si nano-wires have been studied, developing emulators and equivalent circuitry, in order to describe their complex dynamics. This part sets the first milestone of a pathway that passes trough more complex implementations such as neuromorphic systems and neural networks based on memristors proving their computing efficiency. Finally it will be presented a memristror-based technology, covered by patent, demonstrating its efficacy for clinical applications. The presented system has been designed for detecting and assessing automatically chronic wounds, a syndrome that affects roughly 2% of the world population, through a Cellular Automaton which analyzes and processes digital images of ulcers. Thanks to its precision in measuring the lesions the proposed solution promises not only to increase healing rates, but also to prevent the worsening of the wounds that usually lead to amputation and death.

[1]  Daniel Krebs,et al.  Subthreshold electrical transport in amorphous phase-change materials , 2015 .

[2]  C. Toumazou,et al.  A Versatile Memristor Model With Nonlinear Dopant Kinetics , 2011, IEEE Transactions on Electron Devices.

[3]  Narayan Srinivasa,et al.  A functional hybrid memristor crossbar-array/CMOS system for data storage and neuromorphic applications. , 2012, Nano letters.

[4]  T. Sejnowski,et al.  Hippocampal Spine Head Sizes Are Highly Precise , 2015, bioRxiv.

[5]  D. Ielmini,et al.  Self-Accelerated Thermal Dissolution Model for Reset Programming in Unipolar Resistive-Switching Memory (RRAM) Devices , 2009, IEEE Transactions on Electron Devices.

[6]  Jan van den Hurk,et al.  Nanobatteries in redox-based resistive switches require extension of memristor theory , 2013, Nature Communications.

[7]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[8]  Daniel Krebs,et al.  Evidence for thermally assisted threshold switching behavior in nanoscale phase-change memory cells , 2016 .

[9]  Fabien Alibart,et al.  Pattern classification by memristive crossbar circuits using ex situ and in situ training , 2013, Nature Communications.

[10]  Kathie L. Olsen,et al.  Neurotech for Neuroscience: Unifying Concepts, Organizing Principles, and Emerging Tools , 2007, The Journal of Neuroscience.

[11]  Anne Siemon,et al.  Applicability of Well-Established Memristive Models for Simulations of Resistive Switching Devices , 2014, IEEE Transactions on Circuits and Systems I: Regular Papers.

[12]  Andrea L. Lacaita,et al.  Impact of Thermoelectric Effects on Phase Change Memory Characteristics , 2015, IEEE Transactions on Electron Devices.

[13]  T. Serrano-Gotarredona,et al.  A Proposal for Hybrid Memristor-CMOS Spiking Neuromorphic Learning Systems , 2013, IEEE Circuits and Systems Magazine.

[14]  Shih-Hung Chen,et al.  Phase-change random access memory: A scalable technology , 2008, IBM J. Res. Dev..

[15]  Farnood Merrikh-Bayat,et al.  Training and operation of an integrated neuromorphic network based on metal-oxide memristors , 2014, Nature.

[16]  Daniel Krebs,et al.  Crystal growth within a phase change memory cell , 2014, Nature Communications.

[17]  Yusuf Leblebici,et al.  Memristive-Biosensors: A New Detection Method by Using Nanofabricated Memristors , 2012 .

[18]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[19]  J. Yang,et al.  A compact modeling of TiO2-TiO2–x memristor , 2013 .

[20]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[21]  R. Duffin.  Nonlinear Networks , 2021, A Guide to Noise in Microwave Circuits.

[22]  Leon O. Chua,et al.  Cellular neural networks: applications , 1988 .

[23]  Leon O. Chua,et al.  The Fourth Element , 2012, Proceedings of the IEEE.

[24]  Ronald Tetzlaff,et al.  EU COST action IC1401 — Pushing the frontiers of memristive devices to systems , 2016, 2016 18th Mediterranean Electrotechnical Conference (MELECON).

[25]  Leon O. Chua,et al.  Memristor Cellular Automata and Memristor Discrete-Time Cellular Neural Networks , 2009, Int. J. Bifurc. Chaos.

[26]  Fernando Corinto,et al.  Chua's Constitutive Memristor Relations for Physical Phenomena at Metal–Oxide Interfaces , 2015, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[27]  L. Chua.  Memristor-The missing circuit element , 1971 .

[28]  Ronald Tetzlaff,et al.  A class of versatile circuits, made up of standard electrical components, are memristors , 2016, Int. J. Circuit Theory Appl..

[29]  Jim D. Garside,et al.  Overview of the SpiNNaker System Architecture , 2013, IEEE Transactions on Computers.

[30]  Fernando Corinto,et al.  A Boundary Condition-Based Approach to the Modeling of Memristor Nanostructures , 2012, IEEE Transactions on Circuits and Systems I: Regular Papers.

[31]  F. Gottrup.  Optimizing wound treatment through health care structuring and professional education , 2004, Wound repair and regeneration : official publication of the Wound Healing Society [and] the European Tissue Repair Society.

[32]  Manuel Le Gallo,et al.  Stochastic phase-change neurons. , 2016, Nature nanotechnology.

[33]  L.O. Chua,et al.  Memristive devices and systems , 1976, Proceedings of the IEEE.

[34]  R. Williams,et al.  The control of neuron number. , 1988, Annual review of neuroscience.

[35]  David Moore,et al.  Silver chalcogenide based memristor devices , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[36]  A. Pirovano,et al.  Electronic switching in phase-change memories , 2004, IEEE Transactions on Electron Devices.

[37]  Johannes Schemmel,et al.  Realizing biological spiking network models in a configurable wafer-scale hardware system , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[38]  Dmitri B. Strukov,et al.  Hybrid CMOS/memristor circuits , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[39]  Timothée Masquelier,et al.  Bio-inspired unsupervised learning of visual features leads to robust invariant object recognition , 2015, Neurocomputing.

[40]  Carlo Baldassi,et al.  Subdominant Dense Clusters Allow for Simple Learning and High Computational Performance in Neural Networks with Discrete Synapses. , 2015, Physical review letters.

[41]  Gene A. Frantz,et al.  Speech synthesis: Design case history: Speak & Spell learns to talk: Designers of an electronic learning aid mastered advanced speech technology and meticulously `prepared¿ the consumer , 1982 .

[42]  Leon O. Chua,et al.  A Theoretical Approach to Memristor Devices , 2015, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[43]  Julien Clinton Sprott,et al.  A new class of chaotic circuit , 2000 .

[44]  Stephen Wolfram,et al.  Universality and complexity in cellular automata , 1983 .

[45]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[46]  Matthew D. Pickett,et al.  SPICE modeling of memristors , 2011, 2011 IEEE International Symposium of Circuits and Systems (ISCAS).

[47]  R. Williams,et al.  Sub-nanosecond switching of a tantalum oxide memristor , 2011, Nanotechnology.

[48]  Dalibor Biolek,et al.  Variation of a classical fingerprint of ideal memristor , 2016, Int. J. Circuit Theory Appl..

[49]  Giovanni De Micheli,et al.  Computational Study on the Electrical Behavior of Silicon Nanowire Memristive Biosensors , 2015, IEEE Sensors Journal.

[50]  P. Franks,et al.  A community/hospital leg ulcer service. , 1997, Journal of wound care.

[51]  S. Balatti,et al.  Evidence for Voltage-Driven Set/Reset Processes in Bipolar Switching RRAM , 2012, IEEE Transactions on Electron Devices.

[52]  J A Kufera,et al.  Necrotizing soft tissue infections. Risk factors for mortality and strategies for management. , 1996, Annals of surgery.

[53]  Stephen J. Wolf,et al.  The elusive memristor: properties of basic electrical circuits , 2008, 0807.3994.

[54]  Leon O. Chua,et al.  If it’s pinched it’s a memristor , 2014 .

[55]  Byoungil Lee,et al.  Nanoelectronic programmable synapses based on phase change materials for brain-inspired computing. , 2012, Nano letters.

[56]  A. Lacaita,et al.  The race of phase change memories to nanoscale storage and applications , 2013 .

[57]  Fernando Corinto,et al.  Memristive diode bridge with LCR filter , 2012 .

[58]  J. Yang,et al.  State Dynamics and Modeling of Tantalum Oxide Memristors , 2013, IEEE Transactions on Electron Devices.

[59]  Fabien Alibart,et al.  Plasticity in memristive devices for spiking neural networks , 2015, Front. Neurosci..

[60]  Sundaram Seshu,et al.  Linear Graphs and Electrical Networks , 1961 .

[61]  Jennifer Hasler,et al.  Finding a roadmap to achieve large neuromorphic hardware systems , 2013, Front. Neurosci..

[62]  Yannick Bornat,et al.  Neuromimetic ICs with analog cores: an alternative for simulating spiking neural networks , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[63]  Kyung Hyun Choi,et al.  Fabrication of TiO2 thin film memristor device using electrohydrodynamic inkjet printing , 2012 .

[64]  Chang Jung Kim,et al.  Physical electro-thermal model of resistive switching in bi-layered resistance-change memory , 2013, Scientific Reports.

[65]  Derek Abbott,et al.  Memristive Device Fundamentals and Modeling: Applications to Circuits and Systems Simulation , 2012, Proceedings of the IEEE.

[66]  Seok-Jin Ham,et al.  Neuromorphic crossbar circuit with nanoscale filamentary-switching binary memristors for speech recognition , 2014, Nanoscale Research Letters.

[67]  Gregory S. Snider,et al.  ‘Memristive’ switches enable ‘stateful’ logic operations via material implication , 2010, Nature.

[68]  Fernando Corinto,et al.  Analysis of current–voltage characteristics for memristive elements in pattern recognition systems , 2012, Int. J. Circuit Theory Appl..

[69]  R. Waser,et al.  Electrode kinetics of Cu–SiO2-based resistive switching cells: Overcoming the voltage-time dilemma of electrochemical metallization memories , 2009 .

[70]  Abu Sebastian,et al.  Accumulation-Based Computing Using Phase-Change Memories With FET Access Devices , 2015, IEEE Electron Device Letters.

[71]  Jacob Katzenelson,et al.  Nonlinear RLC networks , 1965 .

[72]  Ali Khiat,et al.  Emulating short-term synaptic dynamics with memristive devices , 2015, Scientific Reports.

[73]  K. Boahen,et al.  Programmable Connections in Neuromorphic Grids , 2006, 2006 49th IEEE International Midwest Symposium on Circuits and Systems.

[74]  Evripides Kyriakides,et al.  NiTi smart alloys for memristors with multi-time-scale volatility , 2012 .

[75]  Christos Papavassiliou,et al.  Applications of solid-state memristors in tunable filters , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[76]  Uri C. Weiser,et al.  TEAM: ThrEshold Adaptive Memristor Model , 2013, IEEE Transactions on Circuits and Systems I: Regular Papers.

[77]  Dalibor Biolek,et al.  SPICE Model of Memristor with Nonlinear Dopant Drift , 2009 .

[78]  Julius Georgiou,et al.  A new memristor based on NiTi smart alloys , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[79]  Frederico A. C. Azevedo,et al.  Equal numbers of neuronal and nonneuronal cells make the human brain an isometrically scaled‐up primate brain , 2009, The Journal of comparative neurology.

[80]  S. Wang,et al.  Graded bidirectional synaptic plasticity is composed of switch-like unitary events. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[81]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[82]  Fernando Corinto,et al.  Nonlinear Dynamics of Memristor Oscillators , 2011, IEEE Transactions on Circuits and Systems I: Regular Papers.

[83]  Erik Brynjolfsson,et al.  Big data: the management revolution. , 2012, Harvard business review.

[84]  A. Pirovano,et al.  Threshold switching and phase transition numerical models for phase change memory simulations , 2008 .

[85]  Leon O. Chua,et al.  Introduction to nonlinear network theory , 1969 .

[86]  H-S Philip Wong,et al.  Memory leads the way to better computing. , 2015, Nature nanotechnology.

[87]  Giovanni De Micheli,et al.  Memristive sensors for pH measure in dry conditions , 2014 .

[88]  J. Simmons.  Electric Tunnel Effect between Dissimilar Electrodes Separated by a Thin Insulating Film , 1963 .

[89]  J. Grollier,et al.  A ferroelectric memristor. , 2012, Nature materials.

[90]  Marius K. Orlowski,et al.  Write and Erase Threshold Voltage Interdependence in Resistive Switching Memory Cells , 2015, IEEE Transactions on Electron Devices.

[91]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[92]  Hans-Oliver Rennekampff,et al.  Evidence-based Management Strategies for Treatment of Chronic Wounds , 2009, Eplasty.

[93]  Gorm Krogh Johnsen,et al.  An introduction to the memristor – a valuable circuit element in bioelectricity and bioimpedance , 2012 .

[94]  F. Corinto,et al.  Memristor Model Comparison , 2013, IEEE Circuits and Systems Magazine.

[95]  Ali Khiat,et al.  Emulating long-term synaptic dynamics with memristive devices , 2015, ArXiv.

[96]  Shimeng Yu,et al.  Conduction mechanism of TiN/HfOx/Pt resistive switching memory: A trap-assisted-tunneling model , 2011 .

[97]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[98]  Leon O. Chua,et al.  Synthesis of new nonlinear network elements , 1968 .

[99]  Ernst Niebur,et al.  A Competitive Network of Spiking VLSI Neurons , 2001 .

[100]  V. Cros,et al.  Spin-torque building blocks. , 2014, Nature Materials.

[101]  Jacques-Olivier Klein,et al.  Robust neural logic block (NLB) based on memristor crossbar array , 2011, 2011 IEEE/ACM International Symposium on Nanoscale Architectures.

[102]  Massimiliano Di Ventra,et al.  Memristive model of amoeba learning. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[103]  Nicolas Brunel,et al.  Efficient supervised learning in networks with binary synapses , 2007, BMC Neuroscience.

[104]  Kyungmin Kim,et al.  Memristor Applications for Programmable Analog ICs , 2011, IEEE Transactions on Nanotechnology.

[105]  Haralampos Pozidis,et al.  Recent Progress in Phase-Change Memory Technology , 2016, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[106]  Gianfranco Genta,et al.  Features and performance of some outlier detection methods , 2011 .

[107]  Leon O. Chua.  Resistance switching memories are memristors , 2011 .

[108]  Peng Li,et al.  Nonvolatile memristor memory: Device characteristics and design implications , 2009, 2009 IEEE/ACM International Conference on Computer-Aided Design - Digest of Technical Papers.

[109]  C. Toumazou,et al.  Memristive devices as parameter setting elements in programmable gain amplifiers , 2012 .

[110]  S. Ha,et al.  Adaptive oxide electronics: A review , 2011 .

[111]  Carver A. Mead,et al.  Neuromorphic electronic systems , 1990, Proc. IEEE.

[112]  C. Doré,et al.  Leg ulcers: Epidemiology and aetiology , 1986, The British journal of surgery.

[113]  Ronald Tetzlaff,et al.  Generalized boundary condition memristor model , 2016, Int. J. Circuit Theory Appl..

[114]  Yannick Bornat,et al.  A Library of Analog Operators Based on the Hodgkin-Huxley Formalism for the Design of Tunable, Real-Time, Silicon Neurons , 2011, IEEE Transactions on Biomedical Circuits and Systems.

[115]  Dalibor Biolek,et al.  Specification of one classical fingerprint of ideal memristor , 2015, Microelectron. J..

[116]  Leon O. Chua,et al.  Three Fingerprints of Memristor , 2013, IEEE Transactions on Circuits and Systems I: Regular Papers.

[117]  Leon O. Chua,et al.  Simplest Chaotic Circuit , 2010, Int. J. Bifurc. Chaos.

[118]  Yuhong Kang,et al.  Physics of the Voltage Constant in Multilevel Switching of Conductive Bridge Resistive Memory , 2013 .

[119]  Daniele Ielmini,et al.  Analytical model for subthreshold conduction and threshold switching in chalcogenide-based memory devices , 2007 .