Style‐Based Motion Synthesis †

Representing motions as linear sums of principal components has become a widely accepted animation technique. While powerful, the simplest version of this approach is not particularly well suited to modeling the specific style of an individual whose motion had not yet been recorded when building the database: it would take an expert to adjust the PCA weights to obtain a motion style that is indistinguishable from his. Consequently, when realism is required, the current practice is to perform a full motion capture session each time a new person must be considered. In this paper, we extend the PCA approach so that this requirement can be drastically reduced: for whole classes of cyclic and noncyclic motions such as walking, running or jumping, it is enough to observe the newcomer moving only once at a particular speed or jumping a particular distance using either an optical motion capture system or a simple pair of synchronized video cameras. This one observation is used to compute a set of principal component weights that best approximates the motion and to extrapolate in real‐time realistic animations of the same person walking or running at different speeds, and jumping a different distance.

[1]  Murray Mp,et al.  Gait as a total pattern of movement. , 1967 .

[2]  M. P. Murray Gait as a total pattern of movement. , 1967, American journal of physical medicine.

[3]  Ken Shoemake,et al.  Animating rotation with quaternion curves , 1985, SIGGRAPH.

[4]  Michael Girard,et al.  Interactive Design of 3D Computer-Animated Legged Animal Motion , 1987, IEEE Computer Graphics and Applications.

[5]  David C. Brogan,et al.  Animating human athletics , 1995, SIGGRAPH.

[6]  Ken-ichi Anjyo,et al.  Fourier principles for emotion-based human figure animation , 1995, SIGGRAPH.

[7]  Ken Perlin,et al.  Real Time Responsive Animation with Personality , 1995, IEEE Trans. Vis. Comput. Graph..

[8]  Lance Williams,et al.  Motion signal processing , 1995, SIGGRAPH.

[9]  Michael Gleicher,et al.  Motion editing with spacetime constraints , 1997, SI3D.

[10]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[11]  Zoran Popovic,et al.  Physically based motion transformation , 1999, SIGGRAPH.

[12]  Franck Multon,et al.  Computer animation of human walking: a survey , 1999, Comput. Animat. Virtual Worlds.

[13]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[14]  Sung Yong Shin,et al.  A hierarchical approach to interactive motion editing for human-like figures , 1999, SIGGRAPH.

[15]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[16]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[17]  Andrew Blake,et al.  Markerless motion capture of complex full-body movement for character anima-tion , 2001, CVPR 2000.

[18]  Andrew Blake,et al.  Articulated body motion capture by annealed particle filtering , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[19]  Golam Ashraf,et al.  Dynamic Time Warp Based Framespace Interpolation for Motion Editing , 2000, Graphics Interface.

[20]  Marc Alexa,et al.  Representing Animations by Principal Components , 2000, Comput. Graph. Forum.

[21]  Aaron Hertzmann,et al.  Style machines , 2000, SIGGRAPH 2000.

[22]  Jessica K. Hodgins,et al.  Simulating leaping, tumbling, landing and balancing humans , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[23]  Michael Gleicher,et al.  Comparing Constraint-Based Motion Editing Methods , 2001, Graph. Model..

[24]  Sung Yong Shin,et al.  Computer puppetry: An importance-based approach , 2001, TOGS.

[25]  David J. Fleet,et al.  People tracking using hybrid Monte Carlo filtering , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[26]  Peter-Pike J. Sloan,et al.  Shape by example , 2001, I3D '01.

[27]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[28]  I. Jolliffe Principal Component Analysis , 2002 .

[29]  Okan Arikan,et al.  Interactive motion generation from examples , 2002, ACM Trans. Graph..

[30]  Sung Yong Shin,et al.  On-line locomotion generation based on motion blending , 2002, SCA '02.

[31]  Daniel Thalmann,et al.  Construction of animation models out of captured data , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[32]  N. Troje Decomposing biological motion: a framework for analysis and synthesis of human gait patterns. , 2002, Journal of vision.

[33]  C. Karen Liu,et al.  Synthesis of complex dynamic character motion from simple animations , 2002, ACM Trans. Graph..

[34]  Mira Dontcheva,et al.  Layered acting for character animation , 2003, ACM Trans. Graph..

[35]  Cristian Sminchisescu,et al.  Kinematic jump processes for monocular 3D human tracking , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[36]  Lucas Kovar,et al.  Flexible automatic motion blending with registration curves , 2003, SCA '03.

[37]  Tomaso A. Poggio,et al.  Reanimating Faces in Images and Video , 2003, Comput. Graph. Forum.

[38]  Daniel Thalmann,et al.  A Coherent Locomotion Engine Extrapolating Beyond Experimental Data , 2004 .

[39]  Pascal Fua,et al.  3D Human Body Tracking Using Deterministic Temporal Motion Models , 2004, ECCV.

[40]  Aaron Hertzmann,et al.  Style-based inverse kinematics , 2004, ACM Trans. Graph..

[41]  Ronan Boulic,et al.  An inverse kinematics architecture enforcing an arbitrary number of strict priority levels , 2004, The Visual Computer.

[42]  P. Fua,et al.  Accurate face models from uncalibrated and ill-lit video sequences , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[43]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[44]  Lucas Kovar,et al.  Motion Graphs , 2002, ACM Trans. Graph..