Stochastic optimization of spin-glasses on cellular neural/nonlinear network based processors

Nowadays, Cellular Neural/Nonlinear Networks (CNN) are practically implemented in parallel, analog computers, showing a fast developing trend. It is important also for physicists to be aware that such computers are appropriate for implementing in an elegant manner practically important algorithms, which are extremely slow on the classical digital architecture. Here, CNN is used for optimization of spin-glass systems. We prove, that a CNN in which the parameters of all cells can be separately controlled, is the analog correspondent of a two-dimensional Ising type spin-glass system. Using the properties of CNN we show that one single operation on the CNN chip would yield a local minimum of the spin-glass energy function. By using this property a fast optimization method, similar to simulated annealing, can be built. After estimating the simulation time needed for this algorithm on CNN based computers, and comparing it with the time needed on normal digital computers using the classical simulated annealing algorithm, the results look promising: a speed-up of the order 1012 is expected already at 50×50 lattice sizes. Hardwares realized nowadays are of 128×128 size. Also, there seem to be no technical difficulties adapting CNN chips for such problems and the needed local control of the parameters could be fully developed in the near future.

[1]  Leon O. Chua,et al.  Methods for image processing and pattern formation in Cellular Neural Networks: a tutorial , 1995 .

[2]  M. Ercsey-Ravasz,et al.  Stochastic simulations on the cellular wave computers , 2006 .

[3]  Dhanistha Panyasak,et al.  Circuits , 1995, Annals of the New York Academy of Sciences.

[5]  Rosario N. Mantegna,et al.  Book Review: An Introduction to Econophysics, Correlations, and Complexity in Finance, N. Rosario, H. Mantegna, and H. E. Stanley, Cambridge University Press, Cambridge, 2000. , 2000 .

[6]  Tamás Roska,et al.  The CNN universal machine: an analogic array computer , 1993 .

[7]  M. Ercsey-Ravasz,et al.  PERSPECTIVES FOR MONTE CARLO SIMULATIONS ON THE CNN UNIVERSAL MACHINE , 2006 .

[8]  L. Chua,et al.  Simulating nonlinear waves and partial differential equations via CNN. I. Basic techniques , 1995 .

[9]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[10]  Tamás Roska,et al.  Circuits, computers, and beyond Boolean logic , 2007, Int. J. Circuit Theory Appl..

[11]  Leon O. Chua,et al.  Pseudo-random sequence generation using the CNN universal machine with applications to cryptography , 1996, 1996 Fourth IEEE International Workshop on Cellular Neural Networks and their Applications Proceedings (CNNA-96).

[12]  Sorin Istrail,et al.  Statistical Mechanics, Three-Dimensionality and NP-Completeness: I. Universality of Intractability of the Partition Functions of the Ising Model Across Non-Planar Lattices , 2000, STOC 2000.

[13]  Lin-Bao Yang,et al.  Cellular neural networks: theory , 1988 .

[14]  Glenn W. Rowe Theoretical Models in Biology: The Origin of Life, the Immune System, and the Brain , 1994 .

[15]  M. Mézard,et al.  Spin Glass Theory and Beyond , 1987 .

[16]  S. Edwards,et al.  Theory of spin glasses , 1975 .

[17]  Leon O. Chua,et al.  Application of cellular neural networks to model population dynamics , 1995 .

[18]  Klaus Mainzer,et al.  Cellular Neural Networks and Visual Computing , 2003, Int. J. Bifurc. Chaos.

[19]  Ángel Rodríguez-Vázquez,et al.  Toward visual microprocessors , 2002, Proc. IEEE.

[20]  Tamás Roska Computational And Computer Complexity Of Analogic Cellular Wave Computers , 2003, J. Circuits Syst. Comput..

[21]  H. Nishimori Statistical Physics of Spin Glasses and Information Processing , 2001 .

[22]  L. Chua,et al.  Simulating nonlinear waves and partial differential equations via CNN. II. Typical examples , 1995 .

[23]  Nicolas Sourlas,et al.  Spin-glass models as error-correcting codes , 1989, Nature.

[24]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[25]  Leon O. Chua,et al.  Cellular Neural Networks and Visual Computing: Foundations and Applications , 2002 .

[26]  S. Kirkpatrick,et al.  Solvable Model of a Spin-Glass , 1975 .

[27]  F. Barahona On the computational complexity of Ising spin glass models , 1982 .

[28]  R. Weinand,et al.  Theoretical models in biology: The origin of life, the immune system, and the brain , 1995 .