Motion synthesis from annotations

This paper describes a framework that allows a user to synthesize human motion while retaining control of its qualitative properties. The user paints a timeline with annotations --- like walk, run or jump --- from a vocabulary which is freely chosen by the user. The system then assembles frames from a motion database so that the final motion performs the specified actions at specified times. The motion can also be forced to pass through particular configurations at particular times, and to go to a particular position and orientation. Annotations can be painted positively (for example, must run), negatively (for example, may not run backwards) or as a don't-care. The system uses a novel search method, based around dynamic programming at several scales, to obtain a solution efficiently so that authoring is interactive. Our results demonstrate that the method can generate smooth, natural-looking motion.The annotation vocabulary can be chosen to fit the application, and allows specification of composite motions (run and jump simultaneously, for example). The process requires a collection of motion data that has been annotated with the chosen vocabulary. This paper also describes an effective tool, based around repeated use of support vector machines, that allows a user to annotate a large collection of motions quickly and easily so that they may be used with the synthesis algorithm.

[1]  W. T. Dempster,et al.  Properties of body segments based on size and weight , 1967 .

[2]  R. C. Nelson,et al.  BIOMECHANICAL COMPARISON OF MALE AND FEMALE DISTANCE RUNNERS * , 1977, Annals of the New York Academy of Sciences.

[3]  Thomas A. McMahon,et al.  Muscles, Reflexes, and Locomotion , 1984 .

[4]  Andrew P. Witkin,et al.  Spacetime constraints , 1988, SIGGRAPH.

[5]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[6]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[7]  Joseph O'Rourke,et al.  Computational Geometry in C. , 1995 .

[8]  David C. Brogan,et al.  Animating human athletics , 1995, SIGGRAPH.

[9]  James R. Bergen,et al.  Pyramid-based texture analysis/synthesis , 1995, Proceedings., International Conference on Image Processing.

[10]  Bruce Blumberg,et al.  Multi-level direction of autonomous creatures for real-time virtual environments , 1995, SIGGRAPH.

[11]  Zoran Popovic,et al.  Motion warping , 1995, SIGGRAPH.

[12]  Demetri Terzopoulos,et al.  Automated learning of muscle-actuated locomotion through control abstraction , 1995, SIGGRAPH.

[13]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[14]  Peter Green,et al.  Markov chain Monte Carlo in Practice , 1996 .

[15]  Michiel van de Panne,et al.  Motion synthesis by example , 1996 .

[16]  Ken Perlin,et al.  Improv: a system for scripting interactive actors in virtual worlds , 1996, SIGGRAPH.

[17]  Michael F. Cohen,et al.  Efficient generation of motion transitions using spacetime constraints , 1996, SIGGRAPH.

[18]  Leonidas J. Guibas,et al.  Metropolis light transport , 1997, SIGGRAPH.

[19]  Jessica K. Hodgins,et al.  Adapting simulated behaviors for new characters , 1997, SIGGRAPH.

[20]  David C. Brogan,et al.  Dynamically simulated characters in virtual environments , 1998, SIGGRAPH '97.

[21]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[22]  Geoffrey E. Hinton,et al.  NeuroAnimator: fast neural network emulation and control of physics-based models , 1998, SIGGRAPH.

[23]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[24]  John Funge,et al.  Cognitive modeling: knowledge, reasoning and planning for intelligent characters , 1999, SIGGRAPH.

[25]  Z. Popovic,et al.  Motion transformation by physically based spacetime optimization , 1999 .

[26]  Sung Yong Shin,et al.  A hierarchical approach to interactive motion editing for human-like figures , 1999, SIGGRAPH.

[27]  Jean-Claude Latombe,et al.  Motion Planning: A Journey of Robots, Molecules, Digital Actors, and Other Artifacts , 1999, Int. J. Robotics Res..

[28]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[29]  Christoph Bregler,et al.  Animating by multi-level sampling , 2000, Proceedings Computer Animation 2000.

[30]  C. C. Chang,et al.  Libsvm : introduction and benchmarks , 2000 .

[31]  R. Bowden.  Learning Statistical Models of Human Motion , 2000 .

[32]  Adrian Hilton,et al.  Realistic synthesis of novel human movements from a database of motion capture examples , 2000, Proceedings Workshop on Human Motion.

[33]  David A. Forsyth,et al.  Sampling plausible solutions to multi-body constraint problems , 2000, SIGGRAPH.

[34]  Richard Szeliski,et al.  Video textures , 2000, SIGGRAPH.

[35]  Maja J. Mataric,et al.  Getting Humanoids to Move and Imitate , 2000, IEEE Intell. Syst..

[36]  Aaron Hertzmann,et al.  Style machines , 2000, SIGGRAPH 2000.

[37]  John A. N. Lee,et al.  A probabilistic approach to planning biped locomotion with prescribed motions , 2000 .

[38]  David C. Hogg,et al.  Learning Variable-Length Markov Models of Behavior , 2001, Comput. Vis. Image Underst..

[39]  Michael Gleicher,et al.  Motion path editing , 2001, I3D '01.

[40]  Petros Faloutsos,et al.  Composable controllers for physics-based character animation , 2001, SIGGRAPH.

[41]  Harry Shum,et al.  Motion texture: a two-level statistical model for character motion synthesis , 2002, ACM Trans. Graph..

[42]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[43]  Christoph Bregler,et al.  Motion capture assisted animation: texturing and synthesis , 2002, ACM Trans. Graph..

[44]  Lucas Kovar,et al.  Footskate cleanup for motion capture editing , 2002, SCA '02.

[45]  Christoph Bregler,et al.  Turning to the masters: motion capturing cartoons , 2002, ACM Trans. Graph..

[46]  Okan Arikan,et al.  Interactive motion generation from examples , 2002, ACM Trans. Graph..

[47]  Lucas Kovar,et al.  Motion graphs , 2002, SIGGRAPH '08.

[48]  C. Karen Liu,et al.  Synthesis of complex dynamic character motion from simple animations , 2002, ACM Trans. Graph..