Motion graphs++

This paper introduces a new generative statistical model that allows for human motion analysis and synthesis at both semantic and kinematic levels. Our key idea is to decouple complex variations of human movements into finite structural variations and continuous style variations and encode them with a concatenation of morphable functional models. This allows us to model not only a rich repertoire of behaviors but also an infinite number of style variations within the same action. Our models are appealing for motion analysis and synthesis because they are highly structured, contact aware, and semantic embedding. We have constructed a compact generative motion model from a huge and heterogeneous motion database (about two hours mocap data and more than 15 different actions). We have demonstrated the power and effectiveness of our models by exploring a wide variety of applications, ranging from automatic motion segmentation, recognition, and annotation, and online/offline motion synthesis at both kinematics and behavior levels to semantic motion editing. We show the superiority of our model by comparing it with alternative methods.

[1]  Tomohiko Mukai,et al.  Geostatistical motion interpolation , 2005, SIGGRAPH '05.

[2]  Okan Arikan,et al.  Interactive motion generation from examples , 2002, ACM Trans. Graph..

[3]  R. Bowden Learning Statistical Models of Human Motion , 2000 .

[4]  Lucas Kovar,et al.  Flexible automatic motion blending with registration curves , 2003, SCA '03.

[5]  Christopher M. Bishop,et al.  Neural Network for Pattern Recognition , 1995 .

[6]  David A. Forsyth,et al.  Generalizing motion edits with Gaussian processes , 2009, ACM Trans. Graph..

[7]  David A. Forsyth,et al.  Motion synthesis from annotations , 2003, ACM Trans. Graph..

[8]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[9]  Hyun Joon Shin,et al.  Fat graphs: constructing an interactive character with continuous controls , 2006, SCA '06.

[10]  Aaron Hertzmann,et al.  Style machines , 2000, SIGGRAPH 2000.

[11]  Ziv Bar-Joseph,et al.  Modeling spatial and temporal variation in motion data , 2009, ACM Trans. Graph..

[12]  Aaron Hertzmann,et al.  Style-based inverse kinematics , 2004, ACM Trans. Graph..

[13]  Carl E. Rasmussen,et al.  A Unifying View of Sparse Approximate Gaussian Process Regression , 2005, J. Mach. Learn. Res..

[14]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[15]  Jinxiang Chai,et al.  Physically valid statistical models for human motion generation , 2011, TOGS.

[16]  Jessica K. Hodgins,et al.  Construction and optimal search of interpolated motion graphs , 2007, ACM Trans. Graph..

[17]  Taku Komura,et al.  Interaction patches for multi-character animation , 2008, ACM Trans. Graph..

[18]  C. Karen Liu,et al.  Synthesis of Responsive Motion Using a Dynamic Model , 2010, Comput. Graph. Forum.

[19]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[20]  Adrian Hilton,et al.  Realistic synthesis of novel human movements from a database of motion capture examples , 2000, Proceedings Workshop on Human Motion.

[21]  Zoran Popović,et al.  Motion fields for interactive character locomotion , 2010, SIGGRAPH 2010.

[22]  Jessica K. Hodgins,et al.  Constraint-based motion optimization using a statistical dynamic model , 2007, SIGGRAPH 2007.

[23]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[24]  Kari Pulli,et al.  Style translation for human motion , 2005, SIGGRAPH 2005.

[25]  Yen-Lin Chen,et al.  Interactive generation of human animation with deformable motion models , 2009, TOGS.

[26]  Hyun Joon Shin,et al.  Snap-together motion: assembling run-time animations , 2003, ACM Trans. Graph..

[27]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[28]  Adrien Bousseau,et al.  Real-time rough refraction , 2011, SI3D.

[29]  Philippe Beaudoin,et al.  Motion-motif graphs , 2008, SCA '08.

[30]  Michael Gleicher,et al.  Automated extraction and parameterization of motions in large data sets , 2004, SIGGRAPH 2004.

[31]  Lucas Kovar,et al.  Motion graphs , 2002, SIGGRAPH Classes.

[32]  Harry Shum,et al.  Motion texture: a two-level statistical model for character motion synthesis , 2002, ACM Trans. Graph..

[33]  Michael Gleicher,et al.  Parametric motion graphs , 2007, SI3D.

[34]  Manfred Lau,et al.  Behavior planning for character animation , 2005, SCA '05.

[35]  Jessica K. Hodgins,et al.  Performance animation from low-dimensional control signals , 2005, SIGGRAPH 2005.