An Extended Neuron Model for Efficient Time-Series Generation and Prediction

Modelling of spatio-temporal patterns with neural networks is an important task for a large number of applications which require adaptive control. In this paper, the use of an extended neuron model in neural networks is proposed to achieve a given dynamic network behaviour. The new neuron model is based on the implementation of exponential excitation decay and the introduction of temporal refractoriness of the neuron output as observed in biological nerve cells. A learning algorithm based on error-backpropagation for the resulting network is derived. A benchmark test on prediction of the chaotic Macky-Glass differential equation and real-live experiments with controlling the movement of a walking machine leg are performed. The results suggest superior time-series modelling ability of the presented approach in terms of network trainability and computation complexity.

[1]  Josef A. Nossek,et al.  Comparison of learning algorithms for feedforward neural nets , 1996, 1996 IEEE International Symposium on Circuits and Systems. Circuits and Systems Connecting the World. ISCAS 96.

[2]  Michael I. Jordan Attractor dynamics and parallelism in a connectionist sequential machine , 1990 .

[3]  K. Aihara,et al.  Chaotic neural networks , 1990 .

[4]  Kazuyuki Aihara,et al.  Spatio-temporal summation and self-organization in chaotic neural networks , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[5]  Michael R. Davenport,et al.  Continuous-time temporal back-propagation with adaptable time delays , 1993, IEEE Trans. Neural Networks.

[6]  Masafumi Hagiwara,et al.  Learning temporal sequences by complex neurons with local feedback , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.