Temporal sequence learning and recognition with dynamic SOM

The purpose of the paper is to propose a map-like artificial neural network for temporal sequence pattern clustering. The map construction in our presentation is related to the self-organizing map (SOM) idea. The SOM idea was originally designed for static pattern learning and recognition. It has been found efficient for organizing high dimensional data sets. One of the biggest limitations of the traditional SOM technique is caused by its static characteristics. We propose a new neural network construction model and its corresponding training algorithm based on traditional SOM training technology and backpropagation training technology. It overcomes the static limitation of traditional SOM and tries to reach a new stage for dynamic pattern clustering, and recognition. At the end of the paper, we give some experimental results for testing this proposed method on real speech data.

[1]  Suchendra M. Bhandarkar,et al.  A multi-layer Kohonen's self-organizing feature map for range image segmentation , 1993, IEEE International Conference on Neural Networks.

[2]  Jukka Heikkonen,et al.  Time Series Predicition using Recurrent SOM with Local Linear Models , 1997 .

[3]  Jari Kangas Phoneme recognition using time-dependent versions of self-organizing maps , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[4]  Anthony Kuh,et al.  A combined self-organizing feature map and multilayer perceptron for isolated word recognition , 1992, IEEE Trans. Signal Process..

[5]  John J. Hopfield,et al.  Neurons, Dynamics and Computation , 1994 .

[6]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[7]  Sophocles J. Orfanidis,et al.  Introduction to signal processing , 1995 .

[8]  Kevin Warwick,et al.  Applying Self-Organizing Feature Maps to the Control of Artificial Organisms in Maze Running Tasks , 1992, 1992 American Control Conference.

[9]  Masafumi Hagiwara,et al.  Theoretical derivation of momentum term in back-propagation , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[10]  John G. Taylor,et al.  The temporal Kohönen map , 1993, Neural Networks.