Using Neural Networks to Predict the Functionality of Reconfigurable Nanomaterial Networks

This paper demonstrates how neural networks can be applied to model and predict the functional behaviour of disordered nano-particle and nano-tube networks. In recently published experimental work, nano-particle and nano-tube networks show promising functionality for future reconfigurable devices, without a predefined design. The nano-material has been treated as a black-box, and the principle of evolution-in-materio, involving genetic algorithms, has been used to find appropriate configuration voltages to enable the target functionality. In order to support future experiments and the development of useful devices based on disordered nano-materials, we developed simulation tools for predicting candidate functionalities. One of these tools is based on a physical model, but the one described and analysed in this paper is based on an artificial neural network model. The advantage of this newly presented approach is that, after training the neural network to match either the real material or its physical model, it can be configured using gradient descent instead of a black-box optimisation, speeding up the search for functionality. The neural networks do not simulate the physical properties, but rather approximate the nano-material’s transfer functions. The functions found using this new technique were verified back on the nano-material’s physical model and on a real material network. It can be concluded from the reported experiments with these neural network models that they model the simulated nano-material quite accurately. The differentiable, neural network-based material model is used to find logic gates, as a proof of principle. This shows that the new approach has great potential for partly replacing costly and time-consuming experiments with the real nano-material. Therefore, this approach has a high relevance for future computing, either as an alternative to digital computing or as an alternative way of producing multifunctional reconfigurable devices. Keywords–nano-material network; neural network; simulation; unconventional computation; evolution-in-nanomaterio.

[1]  Julian F. Miller,et al.  Computational Matter: Evolving Computational Functions in Nanoscale Materials , 2017 .

[2]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[3]  Julian Francis Miller,et al.  Evolution-in-materio: evolving computation in materials , 2014, Evolutionary Intelligence.

[4]  Christoph Wasshuber Single-electronics - how it works. How it's used. How it's simulated , 2002, Proceedings International Symposium on Quality Electronic Design.

[5]  R. L. Anderson,et al.  RECENT ADVANCES IN FINDING BEST OPERATING CONDITIONS , 1953 .

[6]  Julian Francis Miller,et al.  Nascence Project: Nanoscale Engineering for Novel Computation Using Evolution , 2012, Int. J. Unconv. Comput..

[7]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[8]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  周天舒 Simulation program with integrated circuit emphasis (SPICE) model building method for size reduced process , 2010 .

[10]  Julian Francis Miller,et al.  Evolution in Materio , 2009, Encyclopedia of Complexity and Systems Science.

[11]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[12]  Julian Francis Miller,et al.  Evolution-in-materio: solving computational problems using carbon nanotube–polymer composites , 2015, Soft Computing.

[13]  A. Kotsialos,et al.  Evolution of Electronic Circuits using Carbon Nanotube Composites , 2016, Scientific Reports.

[14]  A. Korotkov Coulomb Blockade and Digital Single-Electron Devices , 1996, cond-mat/9602165.

[15]  Julian Francis Miller,et al.  Evolution In Materio: Evolving Logic Gates in Liquid Crystal , 2007, Int. J. Unconv. Comput..

[16]  PHYSICAL ANALOGUES TO THE GROWTH OF A CONCEPT , 2011 .

[17]  Klaus-Peter Zauner,et al.  From Prescriptive Programming of Solid-State Devices to Orchestrated Self-organisation of Informed Matter , 2004, UPP.

[18]  Jan Koutník,et al.  Unconventional computing using evolution-in-nanomaterio: neural networks meet nanoparticle networks , 2016 .

[19]  Roger J.-B. Wets,et al.  Minimization by Random Search Techniques , 1981, Math. Oper. Res..

[20]  Julian Francis Miller,et al.  Evolution in materio: looking beyond the silicon box , 2002, Proceedings 2002 NASA/DoD Conference on Evolvable Hardware.

[21]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[22]  Julian Francis Miller,et al.  Evolution in Materio: Exploiting the Physics of Materials for Computation , 2008, Int. J. Unconv. Comput..

[23]  Jürgen Schmidhuber,et al.  Discovering Boolean Gates in Slime Mould , 2016, ArXiv.

[24]  Siegfried Selberherr,et al.  SIMON-A simulator for single-electron tunnel devices and circuits , 1997, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[25]  C. Wasshuber Computational Single-Electronics , 2001 .

[26]  Jürgen Schmidhuber,et al.  A committee of neural networks for traffic sign classification , 2011, The 2011 International Joint Conference on Neural Networks.

[27]  Amemiya Yoshihito,et al.  Information Processing Using Intelligent Materials — Information-Processing Architectures for Material Processors , 1994 .

[28]  Celestine Preetham Lawrence,et al.  Evolution of a designless nanoparticle network into reconfigurable Boolean logic. , 2015, Nature nanotechnology.

[29]  Andrew W. Senior,et al.  Long Short-Term Memory Based Recurrent Neural Network Architectures for Large Vocabulary Speech Recognition , 2014, ArXiv.

[30]  Peter Cariani,et al.  To evolve an ear: epistemological implications of Gordon Pask's electrochemical devices , 2007 .

[31]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[32]  Hajo Broersma,et al.  A simulation tool for evolving functionalities in disordered nanoparticle networks , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[33]  Paul J. Werbos,et al.  Applications of advances in nonlinear sensitivity analysis , 1982 .