Efficient multi-sequence memory with controllable steady-state period and high sequence storage capacity

Sequential information processing, for instance the sequence memory, plays an important role on many functions of brain. In this paper, multi-sequence memory with controllable steady-state period and high sequence storage capacity is proposed. By introducing a novel exponential kernel sampling function and the sampling interval parameter, the steady-state period can be controlled, and the steady-state time steps are equal to the sampling interval parameter. Furthermore, we explained this phenomenon theoretically. Ascribing to the nonlinear function constitution for local field, the conventional Hebbian learning rule with linear outer product method can be improved. Simulation results show that neural network with nonlinear function constitution can effectively increase sequence storage capacity.

[1]  Ramón Huerta,et al.  Reproducible sequence generation in random neural ensembles. , 2004, Physical review letters.

[2]  Lev S Tsimring,et al.  Dynamics-based sequential memory: winnerless competition of patterns. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  Charles J. Wilson,et al.  GABAergic microcircuits in the neostriatum , 2004, Trends in Neurosciences.

[4]  T. SHALLICE,et al.  Learning and Memory , 1970, Nature.

[5]  Shun-ichi Amari,et al.  Characteristics of sparsely encoded associative memory , 1989, Neural Networks.

[6]  G. Laurent,et al.  Odor encoding as an active, dynamical process: experiments, computation, and theory. , 2001, Annual review of neuroscience.

[7]  Masato Okada,et al.  Notions of Associative Memory and Sparse Coding , 1996, Neural Networks.

[8]  Teuvo Kohonen,et al.  Correlation Matrix Memories , 1972, IEEE Transactions on Computers.

[9]  Thomas P. Trappenberg,et al.  Rapid learning and robust recall of long sequences in modular associator networks , 2006, Neurocomputing.

[10]  A Selverston,et al.  General principles of rhythmic motor pattern generation derived from invertebrate CPGs. , 1999, Progress in brain research.

[11]  K. D. Punta,et al.  An ultra-sparse code underlies the generation of neural sequences in a songbird , 2002 .

[12]  Anders Lansner,et al.  Synaptic depression as an intrinsic driver of reinstatement dynamics in an attractor network , 2002, Neurocomputing.

[13]  Martin Rehn,et al.  Sequence memory with dynamical synapses , 2004, Neurocomputing.

[14]  J J Hopfield,et al.  Neural computation by concentrating information in time. , 1987, Proceedings of the National Academy of Sciences of the United States of America.

[15]  D Kleinfeld,et al.  Sequential state generation by model neural networks. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Kanter,et al.  Temporal association in asymmetric neural networks. , 1986, Physical review letters.

[17]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[18]  P. Andersen,et al.  [Learning and memory]. , 1995, Tidsskrift for den Norske laegeforening : tidsskrift for praktisk medicin, ny raekke.

[19]  Gutfreund,et al.  Processing of temporal sequences in neural networks. , 1988, Physical review letters.

[20]  James A. Anderson,et al.  A simple neural network generating an interactive memory , 1972 .