Variation-tolerant Computing with Memristive Reservoirs

As feature-size scaling in integrated CMOS circuits further slows down, attention is shifting to computing by non-von Neumann and non-Boolean computing models. In addition, emerging devices are expected to behave in time-dependent non-linear ways, beyond a simple switching behavior, and will exhibit extreme physical variation, heterogeneity and unstructuredness. One solution path to address this challenge is to use a dynamical information processing approach that harnesses the intrinsic dynamics of networks of emerging devices. In this paper we employ an approach inspired by reservoir computing, a machine learning technique, to perform computations with memristive device networks that show variation and unstructuredness. Reservoir computing harnesses the nonlinear transient dynamics of such networks and is thus ideally suited for our memristive devices. We, for the first time, apply the reservoir computing approach to a regular structured reservoir and show, on a simple signal classification problem, that this architecture is highly tolerant towards device variation. Furthermore we prove that, compared to unstructured random reservoirs, regular structured reservoirs lead to better average performance as well as to higher variation tolerance. Based on our results of the signal classification task, we argue that harnessing the intrinsic non-linear and time-dependent properties of memristive device networks has the potential to lead generally to more efficient, cheaper, and more robust nanoscale electronics.

[1]  Damien Querlioz,et al.  Simulation of a memristor-based spiking neural network immune to device variations , 2011, The 2011 International Joint Conference on Neural Networks.

[2]  J. Yang,et al.  Memristive switching mechanism for metal/oxide/metal nanodevices. , 2008, Nature nanotechnology.

[3]  Christof Teuscher,et al.  Computational Capabilities of Random Automata Networks for Reservoir Computing , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[4]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[5]  Damien Challet,et al.  Optimal combinations of imperfect objects. , 2002, Physical review letters.

[6]  Sudeshna Sinha,et al.  Introduction to focus issue: intrinsic and designed computation: information processing in dynamical systems--beyond the digital hegemony. , 2010, Chaos.

[7]  Christof Teuscher,et al.  Memristor-based reservoir computing , 2012, 2012 IEEE/ACM International Symposium on Nanoscale Architectures (NANOARCH).

[8]  E. Lehtonen,et al.  CNN using memristors for neighborhood connections , 2010, 2010 12th International Workshop on Cellular Nanoscale Networks and their Applications (CNNA 2010).

[9]  Jeyavijayan Rajendran,et al.  An Approach to Tolerate Process Related Variations in Memristor-Based Applications , 2011, 2011 24th Internatioal Conference on VLSI Design.

[10]  L. Chua Memristor-The missing circuit element , 1971 .

[11]  Wei Wang,et al.  Design considerations for variation tolerant multilevel CMOS/Nano memristor memory , 2010, GLSVLSI '10.

[12]  Herbert Jaeger,et al.  The''echo state''approach to analysing and training recurrent neural networks , 2001 .

[13]  Ligang Gao,et al.  High precision tuning of state for memristive devices by adaptable variation-tolerant algorithm , 2011, Nanotechnology.