Segmentation and recognition of motion capture data stream by classification

Three dimensional human motions recorded by motion capture and hand gestures recorded by using data gloves generate variable-length data streams. These data streams usually have dozens of attributes, and have different variations for similar motions. To segment and recognize motion streams, a classification-based approach is proposed in this paper. Classification feature vectors are extracted by utilizing singular value decompositions (SVD) of motion data. The extracted feature vectors capture the dominating geometric structures of motion data as revealed by SVD. Multi-class support vector machine (SVM) classifiers with class probability estimates are explored for classifying the feature vectors in order to segment and recognize motion streams. Experiments show that the proposed approach can find patterns in motion data streams with high accuracy.

[1]  B. Prabhakaran,et al.  A similarity measure for motion stream segmentation and recognition , 2005, MDM '05.

[2]  Gene H. Golub,et al.  Matrix computations , 1983 .

[3]  Chih-Jen Lin,et al.  Probability Estimates for Multi-class Classification by Pairwise Coupling , 2003, J. Mach. Learn. Res..

[4]  Cyrus Shahabi,et al.  Real-time Pattern Isolation and Recognition Over Immersive Sensor Data Streams , 2003, MMM.

[5]  Alex Pentland,et al.  Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  B. Prabhakaran,et al.  Similarity measure for multi-attribute data [haptic data recognition] , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[7]  Alexander J. Smola,et al.  Advances in Large Margin Classifiers , 2000 .

[8]  B. Prabhakaran,et al.  Segmentation and recognition of multi-attribute motion sequences , 2004, MULTIMEDIA '04.

[9]  Cyrus Shahabi,et al.  A PCA-based similarity measure for multivariate time series , 2004, MMDB '04.

[10]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[11]  W. Krzanowski.  Between-Groups Comparison of Principal Components , 1979 .

[12]  Gang Qian,et al.  Phrase structure detection in dance , 2004, MULTIMEDIA '04.

[13]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[14]  John R. Smith,et al.  Semantic representation: search and mining of multimedia content , 2004, KDD '04.

[15]  Dimitrios Gunopulos,et al.  Rotation invariant distance measures for trajectories , 2004, KDD.

[16]  Ioannis Pitas,et al.  Visual speech recognition using support vector machines , 2002, 2002 14th International Conference on Digital Signal Processing Proceedings. DSP 2002 (Cat. No.02TH8628).

[17]  Cyrus Shahabi,et al.  Analysis of haptic data for sign language recognition , 2001, HCI.

[18]  Joseph Picone,et al.  Applications of support vector machines to speech recognition , 2004, IEEE Transactions on Signal Processing.

[19]  Loren Olson,et al.  A gesture-driven multimodal interactive dance system , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[20]  Sethuraman Panchanathan,et al.  Gesture segmentation in complex motion sequences , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[21]  G. Stewart.  Error and Perturbation Bounds for Subspaces Associated with Certain Eigenvalue Problems , 1973 .

[22]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[23]  Latifur Khan,et al.  Real-time classification of variable length multi-attribute motions , 2006, Knowledge and Information Systems.