Automatic Human Mocap Data Classification

Automatic classification of human motion capture (mocap) data has many commercial, biomechanical, and medical applications and is the principal focus of this paper. First, we propose a multi-resolution string representation scheme based on the tree-structured vector quantization (TSVQ) to transform the time-series of human poses into codeword sequences. Then, we take the temporal variations of human poses into account via codeword sequence matching. Furthermore, we develop a family of pose-histogram-based classifiers to examine the spatial distribution of human poses. We analyze the performance of the temporal and spatial classifiers separately. To achieve a higher classification rate, we merge their decisions and soft scores using novel fusion methods. The proposed fusion solutions are tested on a wide variety of sequences from the CMU mocap database using five-fold cross validation, and a correct classification rate of 99.6% is achieved.

[1]  Okan Arikan,et al.  Interactive motion generation from examples , 2002, ACM Trans. Graph..

[2]  Lap-Pui Chau,et al.  A Fuzzy Clustering Algorithm for Virtual Character Animation Representation , 2011, IEEE Transactions on Multimedia.

[3]  Eugene Fiume,et al.  An efficient search algorithm for motion data using weighted PCA , 2005, SCA '05.

[4]  Petros Daras,et al.  Quaternionic Signal Processing Techniques for Automatic Evaluation of Dance Performances From MoCap Data , 2014, IEEE Transactions on Multimedia.

[5]  Michelle Effros.  Practical multi-resolution source coding: TSVQ revisited , 1998, Proceedings DCC '98 Data Compression Conference (Cat. No.98TB100225).

[6]  Christoph Bregler,et al.  Motion capture assisted animation: texturing and synthesis , 2002, ACM Trans. Graph..

[7]  Cyrus Shahabi,et al.  A PCA-based similarity measure for multivariate time series , 2004, MMDB '04.

[8]  Jason J. Corso,et al.  Action bank: A high-level representation of activity in video , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Markus Koskela,et al.  Classification of RGB-D and Motion Capture Sequences Using Extreme Learning Machine , 2013, SCIA.

[10]  Zhaoqi Wang,et al.  Indexing and retrieval of human motion data by a hierarchical tree , 2009, VRST '09.

[11]  Bobby Bodenheimer,et al.  An evaluation of a cost metric for selecting transitions between motion segments , 2003, SCA '03.

[12]  Sung Yong Shin,et al.  Rhythmic-motion synthesis based on motion-beat analysis , 2003, ACM Trans. Graph..

[13]  Bodo Rosenhahn,et al.  Human Motion - Understanding, Modeling, Capture and Animation, Second Workshop, Human Motion 2007, Rio de Janeiro, Brazil, October 20, 2007, Proceedings , 2007, Workshop on Human Motion.

[14]  Bodo Rosenhahn,et al.  Proceedings of the 2nd conference on Human motion: understanding, modeling, capture and animation , 2007 .

[15]  Chih-Yi Chiu,et al.  Content-based retrieval for human motion data , 2004, J. Vis. Commun. Image Represent..

[16]  David A. Forsyth,et al.  Motion synthesis from annotations , 2003, ACM Trans. Graph..

[17]  Jovan Popovic,et al.  Style translation for human motion , 2005, ACM Trans. Graph..

[18]  Hiroki Arimura,et al.  Linear-Time Longest-Common-Prefix Computation in Suffix Arrays and Its Applications , 2001, CPM.

[19]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[20]  Tido Röder,et al.  EFFICIENT INDEXING AND RETRIEVAL OF MOTION CAPTURE DATA BASED ON ADAPTIVE SEGMENTATION , 2005 .

[21]  Mubarak Shah,et al.  Recognizing 50 human action categories of web videos , 2012, Machine Vision and Applications.

[22]  C. Karen Liu,et al.  Synthesis of complex dynamic character motion from simple animations , 2002, ACM Trans. Graph..

[23]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[24]  Victor B. Zordan,et al.  Dynamic response for motion capture animation , 2005, SIGGRAPH '05.

[25]  Nasser M. Nasrabadi,et al.  Image coding using vector quantization: a review , 1988, IEEE Trans. Commun..

[26]  C.-C. Jay Kuo,et al.  Human motion classification and management based on mocap data analysis , 2011, J-HGBU '11.

[27]  Jessica K. Hodgins,et al.  Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces , 2004, ACM Trans. Graph..

[28]  Dimitrios Gunopulos,et al.  Fast Motion Capture Matching with Replicated Motion Editing , 2003 .

[29]  Lucas Kovar,et al.  Flexible automatic motion blending with registration curves , 2003, SCA '03.

[30]  C.-C. Jay Kuo,et al.  Overview on Mocap Data Compression , 2010 .

[31]  Zhaoqi Wang,et al.  Efficient motion data indexing and retrieval with local similarity measure of motion strings , 2009, The Visual Computer.

[32]  Lucas Kovar,et al.  Automated extraction and parameterization of motions in large data sets , 2004, ACM Trans. Graph..

[33]  Enno Ohlebusch,et al.  Replacing suffix trees with enhanced suffix arrays , 2004, J. Discrete Algorithms.

[34]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[35]  Fiora Pirri,et al.  Discriminative Sequence Back-constrained GP-LVM for MOCAP based Action Recognition , 2013, ICPRAM.

[36]  Dong Kyue Kim,et al.  Constructing suffix arrays in linear time , 2005, J. Discrete Algorithms.

[37]  B M Nigg,et al.  Identification of individual walking patterns using time discrete and time continuous data sets. , 2002, Gait & posture.

[38]  Peter Sanders,et al.  Simple Linear Work Suffix Array Construction , 2003, ICALP.

[39]  Bodo Rosenhahn,et al.  06241 Abstracts Collection - Human Motion - Understanding, Modeling, Capture and Animation. 13th Workshop , 2006, Human Motion - Understanding, Modeling, Capture and Animation. 13th Workshop.

[40]  C.-C. Jay Kuo,et al.  Coding of Motion Capture Data via Temporal-Domain Sampling and Spatial-domain Vector Quantization Techniques , 2010, PCM.

[41]  Yasuhiko Sakamoto,et al.  Motion map: image-based retrieval and segmentation of motion data , 2004, SCA '04.

[42]  Meinard Müller,et al.  Motion templates for automatic classification and retrieval of motion capture data , 2006, SCA '06.

[43]  Paul A. Viola,et al.  Learning silhouette features for control of human motion , 2004, SIGGRAPH '04.

[44]  Feng Liu,et al.  3D motion retrieval with motion index tree , 2003, Comput. Vis. Image Underst..

[45]  B. Prabhakaran,et al.  Segmentation and recognition of motion streams by similarity search , 2007, TOMCCAP.

[46]  Meinard Müller,et al.  Efficient content-based retrieval of motion capture data , 2005, SIGGRAPH '05.