论文信息 - Delayed Learning and the Organized States

Delayed Learning and the Organized States

Elman presented a network with a context layer for time-series processing. The context layer keeps the output of the hidden layer, and the outputs are inputted to the hidden layer for the next calculation of the time-series. In this paper, the context layer is reformed into the internal memory layer, which is connected from the hidden layer with the connection weights to make the internal memory. The new learning algorithm, called the time-delayed back-propagation learning, is developed for the internal memory. The ability of the network with the internal memory layer and the organized states of the internal memory are demonstrated by applying it to the simple sinusoidal time-series.

Naohiro Ishii | Toshinori Deguchi | N. Ishii | Toshinori Deguchi

[1] Jirí Benes,et al. On neural networks , 1990, Kybernetika.

[2] Ah Chung Tsoi,et al. Noisy Time Series Prediction using Recurrent Neural Networks and Grammatical Inference , 2001, Machine Learning.

[3] James L. McClelland,et al. Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[4] Jacek M. Zurada,et al. Advances in Neural Networks - ISNN 2006, Third International Symposium on Neural Networks, Chengdu, China, May 28 - June 1, 2006, Proceedings, Part I , 2006, International Symposium on Neural Networks.

[5] Geoffrey E. Hinton,et al. Learning internal representations by error propagation , 1986 .

[6] Jacek M. Zurada,et al. Sequential network construction for time series prediction , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[7] Jeffrey L. Elman,et al. Finding Structure in Time , 1990, Cogn. Sci..

[8] Naohiro Ishii,et al. Delayed Learning on Internal Memory Network and Organizing Internal States , 2006, ISNN.

[9] J. Elman. Learning and development in neural networks: the importance of starting small , 1993, Cognition.

[10] Jukka Saarinen,et al. Time Series Prediction with Multilayer Perception, FIR and Elman Neural Networks , 1996 .