Memristive nanowires exhibit small-world connectivity

Small-world networks provide an excellent balance of efficiency and robustness that is not available with other network topologies. These characteristics are exhibited in the Memristive Nanowire Neural Network (MN3), a novel neuromorphic hardware architecture. This architecture is composed of an electrode array connected by stochastically deposited core-shell nanowires. We simulate the stochastic behavior of the nanowires by making various assumptions on their paths. First, we assume that the nanowires follow straight paths. Next, we assume that they follow arc paths with varying radii. Last, we assume that they follow paths generated by pink noise. For each of the three methods, we present a method to find whether a nanowire passes over an electrode, allowing us to represent the architecture as a bipartite graph. We find that the small-worldness coefficient increases logarithmically and is consistently greater than one, which is indicative of a small-world network.

[1]  Nathaniel Rodriguez,et al.  Optimal modularity and memory capacity of neural networks , 2017, ArXiv.

[2]  A. I. SALTYKOV,et al.  The number of components in a random bipartite graph , 1995 .

[3]  1/f noise from the coincidences of similar single-sided random telegraph signals , 2006, physics/0607044.

[4]  Rodrigo Alvarez-Icaza,et al.  Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations , 2014, Proceedings of the IEEE.

[5]  Edward T. Bullmore,et al.  Efficiency and Cost of Economical Brain Functional Networks , 2007, PLoS Comput. Biol..

[6]  Jon M. Kleinberg,et al.  The small-world phenomenon: an algorithmic perspective , 2000, STOC '00.

[7]  Hong Wang,et al.  Loihi: A Neuromorphic Manycore Processor with On-Chip Learning , 2018, IEEE Micro.

[8]  Marta C. González,et al.  Cycles and clustering in bipartite networks. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[9]  Wenguang Chen,et al.  Bridge the Gap between Neural Networks and Neuromorphic Hardware with a Neural Network Compiler , 2017, ASPLOS.

[10]  M. A. Muñoz,et al.  Neutral Theory and Scale-Free Neural Dynamics , 2017, 1703.05079.

[11]  Mark Newman,et al.  Networks: An Introduction , 2010 .

[12]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[13]  Gaël Varoquaux,et al.  The NumPy Array: A Structure for Efficient Numerical Computation , 2011, Computing in Science & Engineering.

[14]  Catherine D. Schuman,et al.  A Survey of Neuromorphic Computing and Neural Networks in Hardware , 2017, ArXiv.

[15]  Johannes C. Familton.  Quaternions: A History of Complex Noncommutative Rotation Groups in Theoretical Physics , 2015, 1504.04885.

[16]  J. Timmer,et al.  On generating power law noise. , 1995 .

[17]  Ashish Raj,et al.  The Wiring Economy Principle: Connectivity Determines Anatomy in the Human Brain , 2011, PloS one.

[18]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[19]  Walid G. Aref,et al.  A Survey of Shortest-Path Algorithms , 2017, ArXiv.

[20]  R. K. Shyamasundar,et al.  Introduction to algorithms , 1996 .

[21]  C. Macosko,et al.  Compaction of fiber reinforcements , 2002 .

[22]  A. Holden.  Stochastic processes in neurophysiology: transformation from point to continuous processes. , 1983, Bulletin of mathematical biology.

[23]  K. Gurney,et al.  Network ‘Small-World-Ness’: A Quantitative Method for Determining Canonical Network Equivalence , 2008, PloS one.