Neuron-synapse IC chip-set for large-scale chaotic neural networks

We propose a neuron-synapse integrated circuit (IC) chip-set for large-scale chaotic neural networks. We use switched-capacitor (SC) circuit techniques to implement a three-internal-state transiently-chaotic neural network model. The SC chaotic neuron chip faithfully reproduces complex chaotic dynamics in real numbers through continuous state variables of the analog circuitry. We can digitally control most of the model parameters by means of programmable capacitive arrays embedded in the SC chaotic neuron chip. Since the output of the neuron is transfered into a digital pulse according to the all-or-nothing property of an axon, we design a synapse chip with digital circuits. We propose a memory-based synapse circuit architecture to achieve a rapid calculation of a vast number of weighted summations. Both of the SC neuron and the digital synapse circuits have been fabricated as IC forms. We have tested these IC chips extensively, and confirmed the functions and performance of the chip-set. The proposed neuron-synapse IC chip-set makes it possible to construct a scalable and reconfigurable large-scale chaotic neural network with 10000 neurons and 10000/sup 2/ synaptic connections.

[1]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1990 .

[2]  Yoshihiko Horio,et al.  Switched-capacitor chaotic neuron for chaotic neural networks , 1993, 1993 IEEE International Symposium on Circuits and Systems.

[3]  K. Aihara,et al.  Chaotic neural networks , 1990 .

[4]  Moore,et al.  Unpredictability and undecidability in dynamical systems. , 1990, Physical review letters.

[5]  J. Nagumo,et al.  On a response characteristic of a mathematical neuron model , 1972, Kybernetik.

[6]  K. Aihara,et al.  12. Chaotic oscillations and bifurcations in squid giant axons , 1986 .

[7]  Kazuyuki Aihara,et al.  Combination of Chaotic Neurodynamics with the 2-opt Algorithm to Solve Traveling Salesman Problems , 1997 .

[8]  Kazuyuki Aihara,et al.  A novel chaotic search for quadratic assignment problems , 2002, Eur. J. Oper. Res..

[9]  Ichiro Tsuda,et al.  Dynamic link of memory--Chaotic memory map in nonequilibrium neural networks , 1992, Neural Networks.

[10]  G. Temes,et al.  Analog MOS Integrated Circuits for Signal Processing , 1986 .

[11]  Kazuyuki Aihara,et al.  Associative Dynamics in a Chaotic Neural Network , 1997, Neural Networks.

[12]  K Aihara,et al.  Fractal encoding in a chaotic neural network. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  Hiroshi Nozawa,et al.  A neural network model as a globally coupled map and applications based on chaos. , 1992, Chaos.

[14]  Kazuyuki Aihara,et al.  Two schemes of switched-capacitor chaotic neuron circuits with bipolar/unipolar output function , 1999, ICONIP'99. ANZIIS'99 & ANNES'99 & ACNN'99. 6th International Conference on Neural Information Processing. Proceedings (Cat. No.99EX378).

[15]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[16]  A.S. Sedra,et al.  Analog MOS integrated circuits for signal processing , 1987, Proceedings of the IEEE.

[17]  Kazuyuki Aihara,et al.  Chaotic simulated annealing by a neural network model with transient chaos , 1995, Neural Networks.

[18]  Kazuyuki Aihara,et al.  Solving large scale traveling salesman problems by chaotic neurodynamics , 2002, Neural Networks.

[19]  Edgar Sanchez-Sinencio,et al.  Applications of Switched Capacitor Circuits , 1984 .

[20]  Cristopher Moore,et al.  Generalized shifts: unpredictability and undecidability in dynamical systems , 1991 .

[21]  Y. Horio,et al.  Switched-capacitor multi-internal-state chaotic neuron circuit with unipolar and bipolar output functions , 1999, ISCAS'99. Proceedings of the 1999 IEEE International Symposium on Circuits and Systems VLSI (Cat. No.99CH36349).

[22]  Kazuyuki Aihara,et al.  Chaotic Neuro-Computer , 2002 .

[23]  Hava T. Siegelmann,et al.  Neural networks and analog computation - beyond the Turing limit , 1999, Progress in theoretical computer science.

[24]  A. Babloyantz,et al.  Evidence of Chaotic Dynamics of Brain Activity During the Sleep Cycle , 1985 .

[25]  Kazuyuki Aihara,et al.  A Current-Mode Implementation of a Chaotic Neuron Model Using a SI Integrator , 1994 .

[26]  Yong Yao,et al.  Model of biological pattern recognition with spatially chaotic dynamics , 1990, Neural Networks.

[27]  Lenore Blum,et al.  Complexity and Real Computation , 1997, Springer New York.

[28]  Hatsuo Hayashi,et al.  Chaotic behavior in the Onchidium giant neuron under sinusoidal stimulation , 1982 .

[29]  Kazuyuki Aihara,et al.  Chaos engineering and its application to parallel distributed processing with chaotic neural networks , 2002, Proc. IEEE.

[30]  K. Aihara,et al.  Chaos and phase locking in normal squid axons , 1987 .

[31]  F Bezanilla,et al.  Nerve membrane excitation without threshold. , 1970, Proceedings of the National Academy of Sciences of the United States of America.

[32]  Kazuyuki Aihara,et al.  Exponential and chaotic neurodynamical tabu searches for quadratic assignment problems , 2000 .

[33]  W. Freeman.  Simulation of chaotic EEG patterns with a dynamic model of the olfactory system , 1987, Biological Cybernetics.

[34]  K. Aihara,et al.  Chaotic Neural Networks(Bifurcation Phenomena in Nonlinear Systems and Theory of Dynamical Systems) , 1989 .