Multi-Mode Tensor Representation of Motion Data

JVRB, 5(2008), no. 5. - In this paper, we investigate how a multilinear model can be used to represent human motion data. Based on technical modes (referring to degrees of freedom and number of frames) and natural modes that typically appear in the context of a motion capture session (referring to actor, style, and repetition), the motion data is encoded in form of a high-order tensor. This tensor is then reduced by using N-mode singular value decomposition. Our experiments show that the reduced model approximates the original motion better then previously introduced PCA-based approaches. Furthermore, we discuss how the tensor representation may be used as a valuable tool for the synthesis of new motions.

[1]  Tido Röder,et al.  Documentation Mocap Database HDM05 , 2007 .

[2]  Lucas Kovar,et al.  Motion graphs , 2002, SIGGRAPH '08.

[3]  Q. Wu,et al.  Development of a Computer Tool for Anthropometric Analyses , 2003, METMBS.

[4]  Michael J. Black,et al.  Representing cyclic human motion using functional analysis , 2005, Image Vis. Comput..

[5]  A. Zinke,et al.  Iterative Multi Scale Dynamic Time Warping , 2006 .

[6]  Lance Williams,et al.  Motion signal processing , 1995, SIGGRAPH.

[7]  Jessica K. Hodgins,et al.  Performance animation from low-dimensional control signals , 2005, SIGGRAPH 2005.

[8]  Jessica K. Hodgins,et al.  Performance animation from low-dimensional control signals , 2005, ACM Trans. Graph..

[9]  Hanspeter Pfister,et al.  Face transfer with multilinear models , 2005, ACM Trans. Graph..

[10]  Eugene Fiume,et al.  An efficient search algorithm for motion data using weighted PCA , 2005, SCA '05.

[11]  Sung Yong Shin,et al.  General Construction of Time-Domain Filters for Orientation Data , 2002, IEEE Trans. Vis. Comput. Graph..

[12]  Jessica K. Hodgins,et al.  Analyzing the physical correctness of interpolated human motion , 2005, SCA '05.

[13]  M. Alex O. Vasilescu.  Human motion signatures: analysis, synthesis, recognition , 2002, Object recognition supported by user interaction for service robots.

[14]  Jernej Barbic,et al.  Segmenting Motion Capture Data into Distinct Behaviors , 2004, Graphics Interface.

[15]  Meinard Müller,et al.  Efficient content-based retrieval of motion capture data , 2005, SIGGRAPH '05.

[16]  Victor B. Zordan,et al.  Automatic splicing for hand and body animations , 2006, SCA '06.

[17]  Lucas Kovar,et al.  Automated extraction and parameterization of motions in large data sets , 2004, ACM Trans. Graph..

[18]  Jessica K. Hodgins,et al.  Construction and optimal search of interpolated motion graphs , 2007, ACM Trans. Graph..

[19]  Jessica K. Hodgins,et al.  Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces , 2004, SIGGRAPH 2004.

[20]  Jovan Popovic,et al.  Style translation for human motion , 2005, ACM Trans. Graph..

[21]  N. Troje.  Decomposing biological motion: a framework for analysis and synthesis of human gait patterns. , 2002, Journal of vision.

[22]  Arno Zinke,et al.  MotionLab sonify: a framework for the sonification of human motion data , 2005, Ninth International Conference on Information Visualisation (IV'05).

[23]  Wei Wang,et al.  A system for analyzing and indexing human-motion databases , 2005, SIGMOD '05.

[24]  Lucas Kovar,et al.  Flexible automatic motion blending with registration curves , 2003, SCA '03.

[25]  Jun Ohya,et al.  D-12-79 A Study of Synthesizing New Human Motions from Sampled Motions Using Tensor Decomposition(D-12. パターン認識・メディア理解, 情報・システム2) , 2005 .

[26]  Maic Masuch,et al.  Playing Audio-only Games: A compendium of interacting with virtual, auditory Worlds , 2005, DiGRA Conference.

[27]  Daniel Thalmann,et al.  PCA-based walking engine using motion capture data , 2004, Proceedings Computer Graphics International, 2004..

[28]  Rasmus Bro,et al.  The N-way Toolbox for MATLAB , 2000 .

[29]  Jessica K. Hodgins,et al.  Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces , 2004, ACM Trans. Graph..

[30]  Tomohiko Mukai,et al.  Multilinear Motion Synthesis Using Geostatistics , 2006 .

[31]  Martin A. Giese,et al.  Morphable Models for the Analysis and Synthesis of Complex Motion Patterns , 2000, International Journal of Computer Vision.

[32]  Meinard Müller,et al.  Motion templates for automatic classification and retrieval of motion capture data , 2006, SCA '06.

[33]  Jessica K. Hodgins,et al.  Constraint-based motion optimization using a statistical dynamic model , 2007, ACM Trans. Graph..