A neural network model of short-term sequence memory

As a principle of temporal pattern processing in brain to encode arbitrary sequences, we indicate the effectiveness of "a pointer whose speed is adaptively changed by transitions in sequences", and the fact that this pointer can be realized by "propagation of local firing on one-dimensional nerve field whose symmetry is externally controlled". By computer simulation, we show that this principle enables the sequence encoding with nonlinear time length compression, retaining the memory trace as static firing patterns, and recalling the sequence with its original speed.

[1]  D Kleinfeld,et al.  Sequential state generation by model neural networks. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Shun-ichi Amari,et al.  Learning Patterns and Pattern Sequences by Self-Organizing Nets of Threshold Elements , 1972, IEEE Transactions on Computers.

[3]  Daniel Bullock,et al.  A neural network model of serial order recall from short-term memory , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[4]  Stephen Grossberg,et al.  Working Memory Networks for Learning Temporal Order with Application to Three-Dimensional Visual Object Recognition , 1992, Neural Computation.

[5]  Stephen Grossberg,et al.  Working memories for storage and recall of arbitrary temporal sequences , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[6]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[7]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[8]  J J Hopfield,et al.  Neural computation by concentrating information in time. , 1987, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Gordon D. A. Brown.  A Neural Net Model of Human Short-Term Memory Development , 1990, EURASIP Workshop.

[10]  José Carlos Príncipe,et al.  The gamma model--A new neural model for temporal processing , 1992, Neural Networks.