A similarity measure for motion stream segmentation and recognition

Recognition of motion streams such as data streams generated by different sign languages or various captured human body motions requires a high performance similarity measure. The motion streams have multiple attributes, and motion patterns in the streams can have different lengths from those of isolated motion patterns and different attributes can have different temporal shifts and variations. To address these issues, this paper proposes a similarity measure based on singular value decomposition (SVD) of motion matrices. Eigenvector differences weighed by the corresponding eigenvalues are considered for the proposed similarity measure. Experiments with general hand gestures and human motion streams show that the proposed similarity measure gives good performance for recognizing motion patterns in the motion streams in real time.

[1]  Christoph Bregler,et al.  Motion capture assisted animation: texturing and synthesis , 2002, ACM Trans. Graph..

[2]  Cyrus Shahabi,et al.  A PCA-based similarity measure for multivariate time series , 2004, MMDB '04.

[3]  Ming Ouhyoung,et al.  A real-time continuous gesture recognition system for sign language , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[4]  B. Prabhakaran,et al.  Segmentation and recognition of multi-attribute motion sequences , 2004, MULTIMEDIA '04.

[5]  Alex Pentland,et al.  Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Camillo J. Taylor,et al.  Reconstruction of Articulated Objects from Point Correspondences in a Single Uncalibrated Image , 2000, Comput. Vis. Image Underst..

[7]  Sethuraman Panchanathan,et al.  Gesture segmentation in complex motion sequences , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[8]  W. Krzanowski.  Between-Groups Comparison of Principal Components , 1979 .

[9]  Donald J. Berndt,et al.  Using Dynamic Time Warping to Find Patterns in Time Series , 1994, KDD Workshop.

[10]  Dale E. Seborg,et al.  Clustering of multivariate time-series data , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[11]  David A. Forsyth,et al.  Enriching a motion collection by transplanting limbs , 2004, SCA '04.

[12]  Cyrus Shahabi,et al.  Real-time Pattern Isolation and Recognition Over Immersive Sensor Data Streams , 2003, MMM.

[13]  Gene H. Golub,et al.  Matrix computations , 1983 .

[14]  Gang Qian,et al.  Phrase structure detection in dance , 2004, MULTIMEDIA '04.

[15]  B. Prabhakaran,et al.  Similarity measure for multi-attribute data [haptic data recognition] , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[16]  Loren Olson,et al.  A gesture-driven multimodal interactive dance system , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).