Modeling style and variation in human motion

Style and variation are two vital components of human motion: style differentiates between examples of the same behavior (slow walk vs. fast walk) while variation differentiates between examples of the same style (vigorous vs. lackadaisical arm swing). This paper presents a novel method to simultaneously model style and variation of motion data captured from different subjects performing the same behavior. An articulated skeleton is separated into several joint groups, and latent variation parameters are introduced to parameterize the variation of each partial motion. The relationships between user-defined style parameters and latent variation parameters are represented by a Bayesian network that is automatically learned from example motions. The geostatistical model, named universal Kriging, is extended to be a style-and-variation interpolation to generate partial motions for all joint groups. Experiments with sideways stepping, walking and running behaviors have demonstrated that the motion sequences synthesized by our method are smooth and natural, while their variations can be easily noticed even when their input style parameters are the same.

[1]  Tomohiko Mukai,et al.  Geostatistical motion interpolation , 2005, SIGGRAPH 2005.

[2]  Michael Gleicher,et al.  Automated extraction and parameterization of motions in large data sets , 2004, SIGGRAPH 2004.

[3]  Jessica K. Hodgins,et al.  The Effects of Noise on the Perception of Animated Human Running , 1999, Computer Animation and Simulation.

[4]  Lucas Kovar,et al.  Motion graphs , 2002, SIGGRAPH Classes.

[5]  Sung Yong Shin,et al.  On-line locomotion generation based on motion blending , 2002, SCA '02.

[6]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[7]  David A. Forsyth,et al.  Enriching a motion collection by transplanting limbs , 2004, SCA '04.

[8]  Lucas Kovar,et al.  Footskate cleanup for motion capture editing , 2002, SCA '02.

[9]  Christoph Bregler,et al.  Motion capture assisted animation: texturing and synthesis , 2002, ACM Trans. Graph..

[10]  Christoph Bregler,et al.  Animating by multi-level sampling , 2000, Proceedings Computer Animation 2000.

[11]  Thomas W. Calvert,et al.  Goal-directed, dynamic animation of human walking , 1989, SIGGRAPH.

[12]  Aaron Hertzmann,et al.  Style-based inverse kinematics , 2004, SIGGRAPH 2004.

[13]  Carol O'Sullivan,et al.  Clone attack! Perception of crowd variety , 2008, SIGGRAPH 2008.

[14]  Lance Williams,et al.  Motion signal processing , 1995, SIGGRAPH.

[15]  Ken Perlin,et al.  Real Time Responsive Animation with Personality , 1995, IEEE Trans. Vis. Comput. Graph..

[16]  Daniel M. Wolpert,et al.  Signal-dependent noise determines motor planning , 1998, Nature.

[17]  Daniel Thalmann,et al.  Key-posture extraction out of human motion data , 2001, 2001 Conference Proceedings of the 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[18]  In-Kwon Lee,et al.  Enriching a motion database by analogous combination of partial human motions , 2007, The Visual Computer.

[19]  Neil D. Lawrence,et al.  Hierarchical Gaussian process latent variable models , 2007, ICML '07.

[20]  Noel A Cressie,et al.  Statistics for Spatial Data. , 1992 .

[21]  Adrien Treuille,et al.  Near-optimal character animation with continuous control , 2007, SIGGRAPH 2007.

[22]  Kari Pulli,et al.  Style translation for human motion , 2005, SIGGRAPH 2005.

[23]  Hongtao Wu,et al.  An efficient approach to the forward kinematics of a planar parallel manipulator with similar platforms , 2002, IEEE Trans. Robotics Autom..

[24]  Pascal Fua,et al.  Style‐Based Motion Synthesis † , 2004, Comput. Graph. Forum.

[25]  David J. Fleet,et al.  Multifactor Gaussian process models for style-content separation , 2007, ICML '07.

[26]  Ziv Bar-Joseph,et al.  Modeling spatial and temporal variation in motion data , 2009, SIGGRAPH 2009.

[27]  Daniel Thalmann,et al.  A Coherent Locomotion Engine Extrapolating Beyond Experimental Data , 2004 .

[28]  Neil D. Lawrence,et al.  Gaussian Process Latent Variable Models for Visualisation of High Dimensional Data , 2003, NIPS.