Independent Component Analysis Using RRAMs

Resistive random-access memories (RRAM)s are considered a promising candidate for neuromorphic circuits and systems. In this letter, we investigate using $TiO_2$ RRAMs to solve blind source separation problem through independent component analysis (ICA) for the first time. ICA has numerous uses including feature extraction. We deploy a local, unsupervised learning algorithm (error-gated Hebbian rule) to extract the independent components. The online evaluation of the weights during the training is studied taking into consideration the asymmetric nonlinear weight update behavior. The effects of the device variability are considered in the results. Finally, an example of de-mixing two Laplacian signals is given to demonstrate the efficacy of the approach.

[1]  Shimeng Yu,et al.  Neuro-Inspired Computing With Emerging Nonvolatile Memorys , 2018, Proceedings of the IEEE.

[2]  Wei D. Lu,et al.  Experimental Demonstration of Feature Extraction and Dimensionality Reduction Using Memristor Networks. , 2017, Nano letters.

[3]  Hyunsang Hwang,et al.  TiOx-Based RRAM Synapse With 64-Levels of Conductance and Symmetric Conductance Change by Adopting a Hybrid Pulse Scheme for Neuromorphic Computing , 2016, IEEE Electron Device Letters.

[4]  Wei D. Lu,et al.  Sparse coding with memristor networks. , 2017, Nature nanotechnology.

[5]  Seung Hwan Lee,et al.  Reservoir computing using dynamic memristors for temporal information processing , 2017, Nature Communications.

[6]  Siddharth Joshi,et al.  21.7 2pJ/MAC 14b 8×8 linear transform mixed-signal spatial filter in 65nm CMOS with 84dB interference suppression , 2017, 2017 IEEE International Solid-State Circuits Conference (ISSCC).

[7]  Jiaming Zhang,et al.  Analogue signal and image processing with large memristor crossbars , 2017, Nature Electronics.

[8]  Taro Toyoizumi,et al.  A Local Learning Rule for Independent Component Analysis , 2016, Scientific Reports.

[9]  Dang Hai Hoang,et al.  A PCA-based method for IoT network traffic anomaly detection , 2018, 2018 20th International Conference on Advanced Communication Technology (ICACT).

[10]  Chih-Cheng Chang,et al.  Mitigating Asymmetric Nonlinear Weight Update Effects in Hardware Neural Network Based on Analog Resistive Synapse , 2018, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[11]  Farnood Merrikh-Bayat,et al.  Training and operation of an integrated neuromorphic network based on metal-oxide memristors , 2014, Nature.

[12]  Yiran Chen,et al.  Hybrid spiking-based multi-layered self-learning neuromorphic system based on memristor crossbar arrays , 2017, Design, Automation & Test in Europe Conference & Exhibition (DATE), 2017.

[13]  G. Ghibaudo,et al.  Understanding RRAM endurance, retention and window margin trade-off using experimental results and simulations , 2016, 2016 IEEE International Electron Devices Meeting (IEDM).