A Temporal Sequence Processor Based on the Biological Reaction-diffusion Process

Temporal sequences are a fundamental form of information and communication both in natural and engineered systems. The biological control process which directs the generation of iterative structures from undifferentiated tissue is a type of temporal sequential process. A quantitative explanation of this temporal process is reaction-diffusion, initially proposed by Turing [1952] and later widely studied and elaborated. We have adapted the reaction-diffusion mechanism to create a novel network and algorithm based on a chemical ``neuron'''' model, which performs storage, associative retrieval and prediction for temporal sequences. Experiments demonstrate the ability of the device to achieve any desired depth limited only by storage capacity, to remember and predict on the basis of count to any length, and to learn and recognize embedded Reber grammar strings to 98% accuracy. The network is also capable of preserving time extent of stored symbols, such as in a musical melody, and permitting retrieval of both the symbols and their temporal extent. Redundancy can be controlled during retrieval or recognition permitting flexible grouping of stored sequences into broader classes during readout.

[1]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[2]  H. Bohn Interkalare Regeneration und segmentale Gradienten bei den Extremitäten von Leucophaea-Larven (Blattaria) , 1970 .

[3]  V. French Leg regeneration in the cockroach, Blatella germanica. II. Regeneration from a non-congruent tibial graft/host junction. , 1976, Journal of embryology and experimental morphology.

[4]  H. Meinhardt Models of biological pattern formation , 1982 .

[5]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[6]  Scott E. Fahlman,et al.  The Recurrent Cascade-Correlation Architecture , 1990, NIPS.

[7]  A. M. Turing,et al.  The chemical basis of morphogenesis , 1952, Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences.

[8]  Michael I. Jordan Attractor dynamics and parallelism in a connectionist sequential machine , 1990 .

[9]  Alex Waibel,et al.  Learning the architecture of neural networks for speech recognition , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[10]  Leon O. Chua,et al.  ASSOCIATIVE AND RANDOM ACCESS MEMORY USING ONE-DIMENSIONAL MAPS , 1992 .

[11]  José Carlos Príncipe,et al.  The gamma model--A new neural model for temporal processing , 1992, Neural Networks.

[12]  Fred Cumminsy Representation of Temporal Patternsin Recurrent Networks , 1993 .

[13]  Michael A. Arbib,et al.  Timing and chunking in processing temporal order , 1993, IEEE Trans. Syst. Man Cybern..