Constructing good quality motion graphs for realistic human animation

Human animation has become an integral part of a diverse range of media, such as computer games, movie special effects and virtual training applications. Motion graphs built from motion capture data have emerged as a very promising technique for automatic synthesis of natural human motion. They use a simple graph structure to embed multiple behaviors and are well-suited for both interactive control and off-line motion synthesis. In this thesis, we address two fundamental problems with motion graphs to make them more accessible to a wide range of animation users. This thesis work especially benefits novice animation users who desire simple and fully automatic motion synthesis tools, such as motion graph-based techniques. First, achieving both good connectivity and smooth transitions in motion graphs is a difficult task. Good connectivity requires transitions between less similar poses, while good motion quality results only from transitions between very similar poses. Our Well-Connected Motion Graph addresses this problem by introducing interpolation between the user-provided motion data and minimizing the number of interpolated poses present in the graph while preserving the graph quality. Second, manually selecting a subset of motions from a large motion capture database to create a good quality motion graph is an arduous and often imperfect process. On one hand, we want this subset to be of the smallest possible size for fast motion search, and on the other hand, the subset needs to contain enough motion data to satisfy user requirements and to generate good quality motions. We cast the motion selection problem as a search for a minimum size sub-graph from a large motion graph built from the large motion capture database. While this problem is NP-hard, our efficient Iterative Sub-graph Algorithm provides a good approximation to the optimal solution and scales to large motion capture databases.

[1]  Steven M. Seitz,et al.  Interactive manipulation of rigid body simulations , 2000, SIGGRAPH.

[2]  Zoran Popovic,et al.  Physically based motion transformation , 1999, SIGGRAPH.

[3]  Mark Mizuguchi,et al.  Data driven motion transitions for interactive games , 2001, Eurographics.

[4]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[5]  Jessica K. Hodgins,et al.  Construction and optimal search of interpolated motion graphs , 2007, ACM Trans. Graph..

[6]  Lucas Kovar,et al.  Automated extraction and parameterization of motions in large data sets , 2004, ACM Trans. Graph..

[7]  Jessica K. Hodgins,et al.  Analyzing the physical correctness of interpolated human motion , 2005, SCA '05.

[8]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[9]  Lucas Kovar,et al.  Flexible automatic motion blending with registration curves , 2003, SCA '03.

[10]  Nils J. Nilsson,et al.  Problem-solving methods in artificial intelligence , 1971, McGraw-Hill computer science series.

[11]  Zoran Popovic,et al.  Motion warping , 1995, SIGGRAPH.

[12]  Sung Yong Shin,et al.  On‐line motion blending for real‐time locomotion generation , 2004, Comput. Animat. Virtual Worlds.

[13]  David A. Forsyth,et al.  Motion synthesis from annotations , 2003, ACM Trans. Graph..

[14]  Arun N. Netravali,et al.  Constrained diameter Steiner trees for multicast conferences in overlay networks , 2004, First International Conference on Quality of Service in Heterogeneous Wired/Wireless Networks.

[15]  Alla Safonova,et al.  Achieving good connectivity in motion graphs , 2008, SCA '08.

[16]  Jeremy G. Siek,et al.  The Boost Graph Library - User Guide and Reference Manual , 2001, C++ in-depth series.

[17]  Jovan Popovic,et al.  Style translation for human motion , 2005, ACM Trans. Graph..

[18]  Eugene Fiume,et al.  Limit cycle control and its application to the animation of balancing and walking , 1996, SIGGRAPH.

[19]  Jehee Lee,et al.  Simulating biped behaviors from human motion data , 2007, SIGGRAPH 2007.

[20]  Hyun Joon Shin,et al.  Fat graphs: constructing an interactive character with continuous controls , 2006, SCA '06.

[21]  Jehee Lee,et al.  Precomputing avatar behavior from human motion data , 2006, Graph. Model..

[22]  Jessica K. Hodgins,et al.  Synthesizing Human Motion from Intuitive Constraints , 2008, Artificial Intelligence Techniques for Computer Graphics.

[23]  David A. Forsyth,et al.  Knowing when to put your foot down , 2006, I3D '06.

[24]  Jehee Lee,et al.  Simulating biped behaviors from human motion data , 2007, ACM Trans. Graph..

[25]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[26]  KangKang Yin,et al.  SIMBICON: simple biped locomotion control , 2007, ACM Trans. Graph..

[27]  Christoph Bregler,et al.  Motion capture assisted animation: texturing and synthesis , 2002, ACM Trans. Graph..

[28]  D.M. Mount,et al.  An Efficient k-Means Clustering Algorithm: Analysis and Implementation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Philippe Beaudoin,et al.  Motion-motif graphs , 2008, SCA '08.

[30]  David C. Brogan,et al.  Animating human athletics , 1995, SIGGRAPH.

[31]  Taesoo Kwon,et al.  Motion modeling for on-line locomotion synthesis , 2005, SCA '05.

[32]  Jessica K. Hodgins,et al.  Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces , 2004, ACM Trans. Graph..

[33]  Bobby Bodenheimer,et al.  Computing the duration of motion transitions: an empirical approach , 2004, SCA '04.

[34]  C. Karen Liu,et al.  Momentum-based parameterization of dynamic character motion , 2004, SCA '04.

[35]  Richard Szeliski,et al.  Video textures , 2000, SIGGRAPH.

[36]  Okan Arikan,et al.  Interactive motion generation from examples , 2002, ACM Trans. Graph..

[37]  Mladen Kos,et al.  A GRASP heuristic for the delay-constrained multicast routing problem , 2006, Telecommun. Syst..

[38]  Carsten Griwodz,et al.  Evaluating Steiner-tree heuristics and diameter variations for application layer multicast , 2008, Comput. Networks.

[39]  Nancy S. Pollard,et al.  Efficient synthesis of physically valid human motion , 2003, ACM Trans. Graph..

[40]  Sebastian Thrun,et al.  ARA*: Anytime A* with Provable Bounds on Sub-Optimality , 2003, NIPS.

[41]  Nancy S. Pollard,et al.  To appear in the ACM SIGGRAPH conference proceedings Responsive Characters from Motion Fragments , 2022 .

[42]  Daniel Thalmann,et al.  An ontology of virtual humans , 2007, The Visual Computer.

[43]  Jeffrey Scott Vitter,et al.  External memory algorithms and data structures , 1999, External Memory Algorithms.

[44]  Richard S. Sutton,et al.  Reinforcement Learning , 1992, Handbook of Machine Learning.

[45]  C. Karen Liu,et al.  Learning physics-based motion style with nonlinear inverse optimization , 2005, ACM Trans. Graph..

[46]  Michael Gleicher,et al.  Parametric motion graphs , 2007, SI3D.

[47]  Aaron Hertzmann,et al.  Active learning for real-time motion controllers , 2007, SIGGRAPH 2007.

[48]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[49]  Manfred Lau,et al.  Behavior planning for character animation , 2005, SCA '05.

[50]  Alberto Menache,et al.  Understanding Motion Capture for Computer Animation and Video Games , 1999 .

[51]  Tido Röder,et al.  Documentation Mocap Database HDM05 , 2007 .

[52]  Lance Williams,et al.  Motion signal processing , 1995, SIGGRAPH.

[53]  Nancy S. Pollard,et al.  Evaluating motion graphs for character animation , 2007, TOGS.

[54]  Hyun Joon Shin,et al.  Snap-together motion: assembling run-time animations , 2003, SIGGRAPH '08.

[55]  Judea Pearl,et al.  Heuristics : intelligent search strategies for computer problem solving , 1984 .

[56]  John W. L. Ogilvie,et al.  Heuristics: Intelligent Search Strategies for Com- Puter Problem , 2001 .

[57]  David A. Forsyth,et al.  Quick transitions with cached multi-way blends , 2007, SI3D.

[58]  Ronan Boulic,et al.  Robust kinematic constraint detection for motion data , 2006, SCA '06.

[59]  C. Karen Liu,et al.  Synthesis of complex dynamic character motion from simple animations , 2002, ACM Trans. Graph..

[60]  Sung Yong Shin,et al.  On-line locomotion generation based on motion blending , 2002, SCA '02.

[61]  Lucas Kovar,et al.  Motion Graphs , 2002, ACM Trans. Graph..

[62]  Andrew P. Witkin,et al.  Spacetime constraints , 1988, SIGGRAPH.

[63]  Sudipto Guha,et al.  Approximation algorithms for directed Steiner problems , 1999, SODA '98.