Motion capture assisted animation: texturing and synthesis

We discuss a method for creating animations that allows the animator to sketch an animation by setting a small number of keyframes on a fraction of the possible degrees of freedom. Motion capture data is then used to enhance the animation. Detail is added to degrees of freedom that were keyframed, a process we call texturing. Degrees of freedom that were not keyframed are synthesized. The method takes advantage of the fact that joint motions of an articulated figure are often correlated, so that given an incomplete data set, the missing degrees of freedom can be predicted from those that are present.

[1]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[2]  Ken Perlin,et al.  [Computer Graphics]: Three-Dimensional Graphics and Realism , 2022 .

[3]  Marc H. Raibert,et al.  Legged Robots That Balance , 1986, IEEE Expert.

[4]  Andrew P. Witkin,et al.  Spacetime constraints , 1988, SIGGRAPH.

[5]  Jane Wilhelms,et al.  Collision Detection and Response for Computer Animation , 1988, SIGGRAPH.

[6]  David Baraff,et al.  Curved surfaces and coherence for non-penetrating rigid body simulation , 1990, SIGGRAPH.

[7]  Jessica K. Hodgins,et al.  Animation of dynamic legged locomotion , 1991, SIGGRAPH.

[8]  David Baraff,et al.  Fast contact force computation for nonpenetrating rigid bodies , 1994, SIGGRAPH.

[9]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[10]  David C. Brogan,et al.  Animating human athletics , 1995, SIGGRAPH.

[11]  Zoran Popovic,et al.  Motion warping , 1995, SIGGRAPH.

[12]  J. Bergen,et al.  Pyramid-based texture analysis/synthesis , 1995, SIGGRAPH.

[13]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[14]  Ken-ichi Anjyo,et al.  Fourier principles for emotion-based human figure animation , 1995, SIGGRAPH.

[15]  Lance Williams,et al.  Motion signal processing , 1995, SIGGRAPH.

[16]  Ken Perlin,et al.  Improv: a system for scripting interactive actors in virtual worlds , 1996, SIGGRAPH.

[17]  Michael F. Cohen,et al.  Efficient generation of motion transitions using spacetime constraints , 1996, SIGGRAPH.

[18]  Jeremy S. De Bonet,et al.  Multiresolution sampling procedure for analysis and synthesis of texture images , 1997, SIGGRAPH.

[19]  Michael Gleicher,et al.  Motion editing with spacetime constraints , 1997, SI3D.

[20]  Christoph Bregler,et al.  Learning and recognizing human dynamics in video sequences , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[22]  Tony DeRose,et al.  Subdivision surfaces in character animation , 1998, SIGGRAPH.

[23]  Andrew P. Witkin,et al.  Large steps in cloth simulation , 1998, SIGGRAPH.

[24]  T P Andriacchi,et al.  A point cluster method for in vivo motion analysis: applied to a study of knee kinematics. , 1998, Journal of biomechanical engineering.

[25]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[26]  Zoran Popovic,et al.  Physically based motion transformation , 1999, SIGGRAPH.

[27]  Matthew Brand,et al.  Voice puppetry , 1999, SIGGRAPH.

[28]  Jessica K. Hodgins,et al.  The Effects of Noise on the Perception of Animated Human Running , 1999, Computer Animation and Simulation.

[29]  Sung Yong Shin,et al.  A hierarchical approach to interactive motion editing for human-like figures , 1999, SIGGRAPH.

[30]  Christoph Bregler,et al.  Animating by multi-level sampling , 2000, Proceedings Computer Animation 2000.

[31]  David A. Forsyth,et al.  Sampling plausible solutions to multi-body constraint problems , 2000, SIGGRAPH.

[32]  Richard Szeliski,et al.  Video textures , 2000, SIGGRAPH.

[33]  Aaron Hertzmann,et al.  Style machines , 2000, SIGGRAPH 2000.

[34]  T P Andriacchi,et al.  Studies of human locomotion: past, present and future. , 2000, Journal of biomechanics.

[35]  Norman I. Badler,et al.  The EMOTE model for effort and shape , 2000, SIGGRAPH.

[36]  Scott L. Delp,et al.  A Computational Framework for Simulation and Analysis of Human and Animal Movement , 2000 .

[37]  Sung Yong Shin,et al.  A Coordinate-Invariant Approach to Multiresolution Motion Analysis , 2001, Graph. Model..

[38]  Ronald Fedkiw,et al.  Visual simulation of smoke , 2001, SIGGRAPH.

[39]  M G Pandy,et al.  Computer modeling and simulation of human movement. , 2001, Annual review of biomedical engineering.

[40]  Ronald Fedkiw,et al.  Practical animation of liquids , 2001, SIGGRAPH.

[41]  Harry Shum,et al.  Motion texture: a two-level statistical model for character motion synthesis , 2002, ACM Trans. Graph..

[42]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[43]  Michael J. Black,et al.  Implicit Probabilistic Models of Human Motion for Synthesis and Tracking , 2002, ECCV.

[44]  Okan Arikan,et al.  Interactive motion generation from examples , 2002, ACM Trans. Graph..

[45]  Jitendra Malik,et al.  Twist Based Acquisition and Tracking of Animal and Human Kinematics , 2004, International Journal of Computer Vision.