Automatic temporal pattern extraction and association

This paper proposes an approach for automatic temporal pattern extraction from a temporal sequence, whose signal samples suffer from noise and non-linear temporal warping. The patterns are recurrent signal segments in the original temporal sequence with respect to some criteria defined by the user. We use Threshold hidden Markov model (THMM) to model the signal sequence. A variance of the Segmental K-means algorithm is used to train the THMM The trained THMM can be used to detect the pattern in the temporal sequence. We apply the proposed approach to automatically analyze multiple synchronized temporal sequences from several input modalities. The timing information of the extracted patterns is used to learn the correlation across multiple modalities, which leads to automatic concept learning.

[1]  John G. Taylor,et al.  The temporal Kohönen map , 1993, Neural Networks.

[2]  Dana Ron,et al.  Learning to model sequences generated by switching distributions , 1995, COLT '95.

[3]  Alex Pentland,et al.  Unsupervised clustering of ambulatory audio and video , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[4]  B. Gaines,et al.  THE LOGIC OF AUTOMATA , 1975 .

[5]  Christopher Raphael,et al.  Automatic Segmentation of Acoustic Musical Signals Using Hidden Markov Models , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[7]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[8]  Thomas S. Huang,et al.  Extracting the Recurring Patterns from Image , 2001 .