Interactive motion generation from examples

There are many applications that demand large quantities of natural looking motion. It is difficult to synthesize motion that looks natural, particularly when it is people who must move. In this paper, we present a framework that generates human motions by cutting and pasting motion capture data. Selecting a collection of clips that yields an acceptable motion is a combinatorial problem that we manage as a randomized search of a hierarchy of graphs. This approach can generate motion sequences that satisfy a variety of constraints automatically. The motions are smooth and human-looking. They are generated in real time so that we can author complex motions interactively. The algorithm generates multiple motions that satisfy a given set of constraints, allowing a variety of choices for the animator. It can easily synthesize multiple motions that interact with each other using constraints. This framework allows the extensive re-use of motion capture data for new purposes.

[1]  W. T. Dempster,et al.  Properties of body segments based on size and weight , 1967 .

[2]  R. C. Nelson,et al.  BIOMECHANICAL COMPARISON OF MALE AND FEMALE DISTANCE RUNNERS * , 1977, Annals of the New York Academy of Sciences.

[3]  V. L. Fortney.  The Kinematics and Kinetics of the Running Pattern of Two-, Four-, and Six-Year-Old Children , 1983 .

[4]  Thomas A. McMahon,et al.  Muscles, Reflexes, and Locomotion , 1984 .

[5]  Anne Lohrli.  Chapman and Hall , 1985 .

[6]  Andrew P. Witkin,et al.  Spacetime constraints , 1988, SIGGRAPH.

[7]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[8]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[9]  Joseph O'Rourke,et al.  Computational Geometry in C. , 1995 .

[10]  David C. Brogan,et al.  Animating human athletics , 1995, SIGGRAPH.

[11]  James R. Bergen,et al.  Texture Analysis: Representation and Matching , 1995, ICIAP.

[12]  Bruce Blumberg,et al.  Multi-level direction of autonomous creatures for real-time virtual environments , 1995, SIGGRAPH.

[13]  Zoran Popovic,et al.  Motion warping , 1995, SIGGRAPH.

[14]  Demetri Terzopoulos,et al.  Automated learning of muscle-actuated locomotion through control abstraction , 1995, SIGGRAPH.

[15]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[16]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[17]  Peter Green,et al.  Markov chain Monte Carlo in Practice , 1996 .

[18]  Michiel van de Panne,et al.  Motion synthesis by example , 1996 .

[19]  Ken Perlin,et al.  Improv: a system for scripting interactive actors in virtual worlds , 1996, SIGGRAPH.

[20]  Michael F. Cohen,et al.  Efficient generation of motion transitions using spacetime constraints , 1996, SIGGRAPH.

[21]  Leonidas J. Guibas,et al.  Metropolis light transport , 1997, SIGGRAPH.

[22]  Sylvia Richardson,et al.  Markov Chain Monte Carlo in Practice , 1997 .

[23]  Jessica K. Hodgins,et al.  Adapting simulated behaviors for new characters , 1997, SIGGRAPH.

[24]  David C. Brogan,et al.  Dynamically simulated characters in virtual environments , 1998, SIGGRAPH '97.

[25]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[26]  J. O´Rourke,et al.  Computational Geometry in C: Arrangements , 1998 .

[27]  Geoffrey E. Hinton,et al.  NeuroAnimator: fast neural network emulation and control of physics-based models , 1998, SIGGRAPH.

[28]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[29]  John Funge,et al.  Cognitive modeling: knowledge, reasoning and planning for intelligent characters , 1999, SIGGRAPH.

[30]  Z. Popovic,et al.  Motion transformation by physically based spacetime optimization , 1999 .

[31]  Sung Yong Shin,et al.  A hierarchical approach to interactive motion editing for human-like figures , 1999, SIGGRAPH.

[32]  Jean-Claude Latombe,et al.  Motion Planning: A Journey of Robots, Molecules, Digital Actors, and Other Artifacts , 1999, Int. J. Robotics Res..

[33]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[34]  Christoph Bregler,et al.  Animating by multi-level sampling , 2000, Proceedings Computer Animation 2000.

[35]  C. C. Chang,et al.  Libsvm : introduction and benchmarks , 2000 .

[36]  R. Bowden.  Learning Statistical Models of Human Motion , 2000 .

[37]  Adrian Hilton,et al.  Realistic synthesis of novel human movements from a database of motion capture examples , 2000, Proceedings Workshop on Human Motion.

[38]  David A. Forsyth,et al.  Sampling plausible solutions to multi-body constraint problems , 2000, SIGGRAPH.

[39]  Richard Szeliski,et al.  Video textures , 2000, SIGGRAPH.

[40]  Maja J. Mataric,et al.  Getting Humanoids to Move and Imitate , 2000, IEEE Intell. Syst..

[41]  Aaron Hertzmann,et al.  Style machines , 2000, SIGGRAPH 2000.

[42]  John A. N. Lee,et al.  A probabilistic approach to planning biped locomotion with prescribed motions , 2000 .

[43]  David C. Hogg,et al.  Learning Variable-Length Markov Models of Behavior , 2001, Comput. Vis. Image Underst..

[44]  Michael Gleicher,et al.  Motion path editing , 2001, I3D '01.

[45]  Petros Faloutsos,et al.  Composable controllers for physics-based character animation , 2001, SIGGRAPH.

[46]  Harry Shum,et al.  Motion texture: a two-level statistical model for character motion synthesis , 2002, ACM Trans. Graph..

[47]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[48]  Christoph Bregler,et al.  Motion capture assisted animation: texturing and synthesis , 2002, ACM Trans. Graph..

[49]  Lucas Kovar,et al.  Footskate cleanup for motion capture editing , 2002, SCA '02.

[50]  Christoph Bregler,et al.  Turning to the masters: motion capturing cartoons , 2002, ACM Trans. Graph..

[51]  Lucas Kovar,et al.  Motion graphs , 2002, SIGGRAPH '08.

[52]  C. Karen Liu,et al.  Synthesis of complex dynamic character motion from simple animations , 2002, ACM Trans. Graph..