Experimental Demonstration of Feature Extraction and Dimensionality Reduction Using Memristor Networks.

Memristors have been considered as a leading candidate for a number of critical applications ranging from nonvolatile memory to non-Von Neumann computing systems. Feature extraction, which aims to transform input data from a high-dimensional space to a space with fewer dimensions, is an important technique widely used in machine learning and pattern recognition applications. Here, we experimentally demonstrate that memristor arrays can be used to perform principal component analysis, one of the most commonly used feature extraction techniques, through online, unsupervised learning. Using Sanger's rule, that is, the generalized Hebbian algorithm, the principal components were obtained as the memristor conductances in the network after training. The network was then used to analyze sensory data from a standard breast cancer screening database with high classification success rate (97.1%).

[1]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[2]  M. Marinella,et al.  Isothermal Switching and Detailed Filament Evolution in Memristive Systems , 2014, Advanced materials.

[3]  Wei Lu,et al.  Retention failure analysis of metal-oxide based resistive memory , 2014 .

[4]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[5]  E. Oja.  Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.

[6]  Shimeng Yu,et al.  Conduction mechanism of TiN/HfOx/Pt resistive switching memory: A trap-assisted-tunneling model , 2011 .

[7]  H Moon,et al.  Computational and Performance Aspects of PCA-Based Face-Recognition Algorithms , 2001, Perception.

[8]  Lin-Bao Yang,et al.  Cellular neural networks: theory , 1988 .

[9]  Shinhyun Choi,et al.  Comprehensive physical model of dynamic resistive switching in an oxide memristor. , 2014, ACS nano.

[10]  Siddharth Gaba,et al.  Synaptic behaviors and modeling of a metal oxide memristive device , 2011 .

[11]  Fabien Alibart,et al.  Pattern classification by memristive crossbar circuits using ex situ and in situ training , 2013, Nature Communications.

[12]  Kinam Kim,et al.  A fast, high-endurance and scalable non-volatile memory device made from asymmetric Ta2O(5-x)/TaO(2-x) bilayer structures. , 2011, Nature materials.

[13]  O. Mangasarian,et al.  Multisurface method of pattern separation for medical diagnosis applied to breast cytology. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[14]  Markus Ringnér,et al.  What is principal component analysis? , 2008, Nature Biotechnology.

[15]  Farnood Merrikh-Bayat,et al.  Training and operation of an integrated neuromorphic network based on metal-oxide memristors , 2014, Nature.

[16]  R. Williams,et al.  Sub-nanosecond switching of a tantalum oxide memristor , 2011, Nanotechnology.

[17]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[18]  Terence D. Sanger,et al.  Optimal unsupervised learning in a single-layer linear feedforward neural network , 1989, Neural Networks.

[19]  D. Stewart,et al.  The missing memristor found , 2008, Nature.

[20]  J. Yang,et al.  High switching endurance in TaOx memristive devices , 2010 .

[21]  Konstantin K. Likharev,et al.  Neuromorphic architectures for nanoelectronic circuits , 2004, Int. J. Circuit Theory Appl..

[22]  Wei D. Lu,et al.  Data Clustering using Memristor Networks , 2015, Scientific Reports.

[23]  Yuchao Yang,et al.  Complementary resistive switching in tantalum oxide-based resistive memory devices , 2012, 1204.3515.

[24]  David Reich,et al.  Principal component analysis of genetic data , 2008, Nature Genetics.

[25]  O. Richard,et al.  10×10nm2 Hf/HfOx crossbar resistive RAM with excellent performance, reliability and low-energy operation , 2011, 2011 International Electron Devices Meeting.

[26]  Wei D. Lu,et al.  Pattern recognition with memristor networks , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[27]  Shinhyun Choi,et al.  Tuning resistive switching characteristics of tantalum oxide memristors through Si doping. , 2014, ACS nano.

[28]  M. Ringnér,et al.  Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networks , 2001, Nature Medicine.

[29]  J. de Haes,et al.  Measuring psychological and physical distress in cancer patients: structure and application of the Rotterdam Symptom Checklist. , 1990, British Journal of Cancer.