Asymptotic behavior of memristive circuits and combinatorial optimization

The interest in memristors has risen due to their possible application both as memory units and as computational devices in combination with CMOS. This is in part due to their nonlinear dynamics and a strong dependence on the circuit topology. We provide evidence that also purely memristive circuits can be employed for computational purposes. We show that a Lyapunov function, polynomial in the internal memory parameters, exists for the case of DC controlled memristors. Such Lyapunov function can be asymptotically mapped to quadratic combinatorial optimization problems. This shows a direct parallel between memristive circuits and the Hopfield-Little model. In the case of Erdos-Renyi random circuits, we provide numerical evidence that the distribution of the matrix elements of the couplings can be roughly approximated by a Gaussian distribution, and that they scale with the inverse square root of the number of elements. This provides an approximated but direct connection to the physics of disordered system and, in particular, of mean field spin glasses. Using this and the fact that the interaction is controlled by a projector operator on the loop space of the circuit, we estimate the number of stationary points of the Lyapunov function, and provide a scaling formula as an upper bound in terms of the circuit topology only. In order to put these ideas into practice, we provide an instance of optimization of the Nikkei 225 dataset in the Markowitz framework, and show that it is competitive compared to exponential annealing.

[1]  M. Ventra,et al.  Scale-free networks as an epiphenomenon of memory , 2013, 1312.2289.

[2]  Corso Elvezia,et al.  Ant colonies for the traveling salesman problem , 1997 .

[3]  Francesco Caravelli,et al.  Trajectories Entropy in Dynamical Graphs with Memory , 2015, Front. Robot. AI.

[4]  Massimiliano Di Ventra,et al.  Self-organization and solution of shortest-path optimization problems with memristive networks , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[5]  J. Hopfield,et al.  Computing with neural circuits: a model. , 1986, Science.

[6]  J Joshua Yang,et al.  Memristive devices for computing. , 2013, Nature nanotechnology.

[7]  R. Adler,et al.  Random Fields and Geometry , 2007 .

[8]  Y. Fyodorov High-Dimensional Random Fields and Random Matrix Theory , 2013, 1307.2379.

[9]  Y. Pershin,et al.  Solving mazes with memristors: a massively-parallel approach , 2011 .

[10]  Yazid M. Sharaiha,et al.  Heuristics for cardinality constrained portfolio optimisation , 2000, Comput. Oper. Res..

[11]  L.O. Chua,et al.  Memristive devices and systems , 1976, Proceedings of the IEEE.

[12]  W. Little The existence of persistent states in the brain , 1974 .

[13]  Fabio L. Traversa,et al.  Universal Memcomputing Machines , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[14]  M. Ventra,et al.  Complex dynamics of memristive circuits: Analytical results and universal slow relaxation. , 2016, Physical review. E.

[15]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[16]  J. Yang,et al.  Memristors with diffusive dynamics as synaptic emulators for neuromorphic computing. , 2017, Nature materials.

[17]  Sumio Hosaka,et al.  Associative memory realized by a reconfigurable memristive Hopfield neural network , 2015, Nature Communications.

[18]  Giacomo Indiveri,et al.  Memory and Information Processing in Neuromorphic Systems , 2015, Proceedings of the IEEE.

[19]  G. Parisi A sequence of approximated solutions to the S-K model for spin glasses , 1980 .

[20]  Federico Poloni,et al.  Algorithms for Quadratic Matrix and Vector Equations , 2012 .

[21]  Adam Z. Stieg,et al.  Neuromorphic Atomic Switch Networks , 2012, PloS one.

[22]  Sompolinsky,et al.  Spin-glass models of neural networks. , 1985, Physical review. A, General physics.

[23]  Mikhail S. Tarkov Hopfield Network with Interneuronal Connections Based on Memristor Bridges , 2016, ISNN.

[24]  T. Hasegawa,et al.  Sensory and short-term memory formations observed in a Ag2S gap-type atomic switch , 2011 .

[25]  F Caravelli,et al.  Locality of interactions for planar memristive circuits. , 2017, Physical review. E.

[26]  Fabrizio Bonani,et al.  Memcomputing NP-complete problems in polynomial time using polynomial resources and collective states , 2014, Science Advances.

[27]  John Paul Strachan,et al.  Chaotic dynamics in nanoscale NbO2 Mott memristors for analogue computing , 2017, Nature.