A recurrent crossbar of memristive nanodevices implements online novelty detection

An auto-correlation matrix memory (ACMM) system continuously computes the degree to which a presented input is novel or anomalous relative to past examples. Here we demonstrate that such a filter can be efficiently implemented with memristive nanodevices and accompanying CMOS circuitry. Complete (a full crossbar) and incomplete (an array of memristive devices) variants of the proposed nanofabric are electrically detailed and subsequently simulated on a simple sparse input image test meant to gauge the system's responses to transitions. Both systems demonstrate active novelty filtering with a small level of false positives in the presence of noise, but only the complete system reports all transitions successfully (avoids false negative too). While the system is robust to a noisy channel, degradation towards false positives is more likely when nanodevice variability is taken into account as well. In addition to novelty filtering, the proposed system may be a useful building block for larger reservoir or recurrent on-chip learning systems.

[1]  Ralph Etienne-Cummings,et al.  A time-series processor for sonar mapping and novelty detection , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[2]  J.-P. Halain,et al.  The dual-gain 10 μm back-thinned 3k×3k CMOS-APS detector of the solar orbiter extreme UV imager , 2014, Astronomical Telescopes and Instrumentation.

[3]  Dominique Vuillaume,et al.  Filamentary switching: synaptic plasticity through device volatility. , 2015, ACS nano.

[4]  Anomaly detection in the right hemisphere: The influence of visuospatial factors , 2004, Brain and Cognition.

[5]  Ojas Parekh,et al.  Energy Scaling Advantages of Resistive Memory Crossbar Based Computation and Its Application to Sparse Coding , 2016, Front. Neurosci..

[6]  Pinaki Mazumder,et al.  CMOS and Memristor-Based Neural Network Design for Position Detection , 2012, Proceedings of the IEEE.

[7]  Gert Cauwenberghs,et al.  Neuromorphic Silicon Neuron Circuits , 2011, Front. Neurosci.

[8]  Boris N. Oreshkin,et al.  Machine learning approaches to network anomaly detection , 2007 .

[9]  H.-S. Philip Wong,et al.  Energy efficient programming of nanoelectronic synaptic devices for large-scale implementation of associative and temporal sequence learning , 2011, 2011 International Electron Devices Meeting.

[10]  S. Marsland Novelty Detection in Learning Systems , 2008 .

[11]  W. Marsden I and J , 2012 .

[12]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[13]  Mohammed Ismail,et al.  Analog VLSI Implementation of Neural Systems , 2011, The Kluwer International Series in Engineering and Computer Science.

[14]  V. Ramachandran Anosognosia in Parietal Lobe Syndrome , 1995, Consciousness and Cognition.

[15]  Zhigang Zeng,et al.  Synchronization control of a class of memristor-based recurrent neural networks , 2012, Inf. Sci..

[16]  E. Oja,et al.  Fast adaptive formation of orthogonalizing filters and associative memory in recurrent networks of neuron-like elements , 1976, Biological Cybernetics.

[17]  Jie Han,et al.  Approximate computing: An emerging paradigm for energy-efficient design , 2013, 2013 18th IEEE European Test Symposium (ETS).