Spatio-temporal self-organizing feature maps

Thus far, the success of capturing and classifying temporal information with neural networks has been limited. Our methodology adds a spatio-temporal coupling to the self-organizing feature map (SOFM) which creates temporally and spatially localized neighborhoods in the map. The spatio-temporal coupling is based on traveling waves of activity which start at each winning node and are naturally attenuated over time. When these traveling waves reinforce each other, temporal activity wavefronts are created which are then used to enhance a node's possibility of winning the next competition. The spatiotemporal coupling is easily implemented with only local connectivity and calculations. Once trained, the spatio-temporal SOFM can be used for detection or for partial pattern recall. The methodology gracefully handles time-warping and multiple patterns with overlapping input vectors.

[1]  ROBERT K. CUNNINGHAM,et al.  Diffusion-enhancement bilayer: Realizing long-range apparent motion and spatiotemporal grouping in a neural architecture , 1994, Neural Networks.

[2]  Jari Kangas,et al.  Time-delayed self-organizing maps , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[3]  Teuvo Kohonen THE HYPERMAP ARCHITECTURE , 1991 .

[4]  P. Morasso,et al.  A new approach to storing temporal sequences , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[5]  Mathias Bode,et al.  Parallel hardware implementation of Kohonen's algorithm with an active medium , 1993, Neural Networks.

[6]  John G. Taylor,et al.  The temporal Kohönen map , 1993, Neural Networks.

[7]  Jari Kangas Phoneme recognition using time-dependent versions of self-organizing maps , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[8]  Pietro Morasso SELF-ORGANISING FEATURE MAPS FOR CURSIVE SCRIPT RECOGNITION , 1991 .

[9]  Hillol Kargupta,et al.  Temporal sequence processing based on the biological reaction-diffusion process , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[10]  Risto Miikkulainen,et al.  SARDNET: A Self-Organizing Feature Map for Sequences , 1994, NIPS.