Enriching a motion collection by transplanting limbs

This paper describes a method that can significantly increase the size of a collection of motion observations by cutting limbs from one motion sequence and attaching them to another. Not all such transplants are successful, because correlations across the body are a significant feature of human motion. The method uses randomized search based around a set of rules to generate transplants that are (a) likely to be successful and (b) likely to enrich the existing motion collection. The resulting frames are annotated by a classifier to tell whether they look like human motion or not. We evaluate the method by obtaining motion demands from an application, synthesizing motions to meet those demands, and then scoring the synthesized motions. Motions synthesized using transplants are generally somewhat better than those synthesized without using transplants, because transplanting generates many frames quite close to the original frames, so that it is easier for the motion synthesis process to find a good path in the motion graph. Furthermore, we show classifier errors tend to have relatively little impact in practice. Finally, we show that transplanted motion data can be used to synthesize motions of a group coordinated in space and time without producing motions that share frames.

[1]  Lucas Kovar,et al.  Flexible automatic motion blending with registration curves , 2003, SCA '03.

[2]  C. C. Chang,et al.  Libsvm : introduction and benchmarks , 2000 .

[3]  Michael Gleicher,et al.  Motion editing with spacetime constraints , 1997, SI3D.

[4]  Michael Gleicher,et al.  Animation from observation: Motion capture and motion editing , 1999, COMG.

[5]  Bobby Bodenheimer,et al.  The Process of Motion Capture: Dealing with the Data , 1997, Computer Animation and Simulation.

[6]  Pascal Fua,et al.  Local and Global Skeleton Fitting Techniques for Optical Motion Capture , 1998, CAPTECH.

[7]  Jessica K. Hodgins,et al.  Perception of Human Motion With Different Geometric Models , 1998, IEEE Trans. Vis. Comput. Graph..

[8]  Alberto Menache,et al.  Understanding Motion Capture for Computer Animation and Video Games , 1999 .

[9]  Michael Gleicher,et al.  Constraint-based motion adaptation , 1998, Comput. Animat. Virtual Worlds.

[10]  David C. Brogan,et al.  Animating human athletics , 1995, SIGGRAPH.

[11]  Lucas Kovar,et al.  Footskate cleanup for motion capture editing , 2002, SCA '02.

[12]  Okan Arikan,et al.  Interactive motion generation from examples , 2002, ACM Trans. Graph..

[13]  Lucas Kovar,et al.  Motion graphs , 2002, SIGGRAPH '08.

[14]  K HodginsJessica,et al.  Perception of Human Motion With Different Geometric Models , 1998 .

[15]  Maja J. Mataric,et al.  Automated derivation of behavior vocabularies for autonomous humanoid motion , 2003, AAMAS '03.

[16]  Nancy S. Pollard,et al.  Efficient synthesis of physically valid human motion , 2003, ACM Trans. Graph..

[17]  Petros Faloutsos,et al.  The virtual stuntman: dynamic characters with a repertoire of autonomous motor skills , 2001, Comput. Graph..

[18]  Zoran Popovic,et al.  Physically based motion transformation , 1999, SIGGRAPH.

[19]  Hyun Joon Shin,et al.  Snap-together motion: assembling run-time animations , 2003, ACM Trans. Graph..

[20]  Thomas B. Moeslund,et al.  Summaries of 107 Computer Vision-Based Human Motion Capture Papers , 1999 .

[21]  Jessica K. Hodgins,et al.  Motion capture-driven simulations that hit and react , 2002, SCA '02.

[22]  Adrian Hilton,et al.  Realistic synthesis of novel human movements from a database of motion capture examples , 2000, Proceedings Workshop on Human Motion.

[23]  Geoffrey E. Hinton,et al.  NeuroAnimator: fast neural network emulation and control of physics-based models , 1998, SIGGRAPH.

[24]  Jessica K. Hodgins,et al.  Tracking and Modifying Upper-body Human Motion Data with Dynamic Simulation , 1999, Computer Animation and Simulation.

[25]  Christoph Bregler,et al.  Motion capture assisted animation: texturing and synthesis , 2002, ACM Trans. Graph..

[26]  Michael Gleicher,et al.  Comparing Constraint-Based Motion Editing Methods , 2001, Graph. Model..

[27]  Jessica K. Hodgins,et al.  Do Geometric Models Affect Judgments of Human Motion? , 1997, Graphics Interface.

[28]  D. Thalmann,et al.  Local and Global Skeleton Fitting Techniques for Optical Motion Capture , Modeling and Motion Capture Techniques for Virtual Environments , 1998 .

[29]  Hyeong-Seok Ko,et al.  Spacetime sweeping: an interactive dynamic constraints solver , 2002, Proceedings of Computer Animation 2002 (CA 2002).

[30]  Petros Faloutsos,et al.  Composable controllers for physics-based character animation , 2001, SIGGRAPH.

[31]  David A. Forsyth,et al.  Automatic Detection of Human Nudes , 1999, International Journal of Computer Vision.

[32]  Nancy S. Pollard,et al.  Force-based motion editing for locomotion tasks , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[33]  Maja J. Mataric,et al.  Automated Derivation of Primitives for Movement Classification , 2000, Auton. Robots.

[34]  David A. Forsyth,et al.  Motion synthesis from annotations , 2003, ACM Trans. Graph..

[35]  Maja J. Mataric,et al.  Deriving action and behavior primitives from human motion data , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[36]  Sung Yong Shin,et al.  A hierarchical approach to interactive motion editing for human-like figures , 1999, SIGGRAPH.

[37]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[38]  Michael Gleicher,et al.  Constraint‐based motion adaptation , 1998 .