Interactive motion mapping for real‐time character control

It is now possible to capture the 3D motion of the human body on consumer hardware and to puppet in real time skeleton‐based virtual characters. However, many characters do not have humanoid skeletons. Characters such as spiders and caterpillars do not have boned skeletons at all, and these characters have very different shapes and motions. In general, character control under arbitrary shape and motion transformations is unsolved ‐ how might these motions be mapped? We control characters with a method which avoids the rigging‐skinning pipeline — source and target characters do not have skeletons or rigs. We use interactively‐defined sparse pose correspondences to learn a mapping between arbitrary 3D point source sequences and mesh target sequences. Then, we puppet the target character in real time. We demonstrate the versatility of our method through results on diverse virtual characters with different input motion controllers. Our method provides a fast, flexible, and intuitive interface for arbitrary motion mapping which provides new ways to control characters for real‐time animation.

[1]  N. Higham Computing the polar decomposition with applications , 1986 .

[2]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[3]  David J. Sturman,et al.  Computer Puppetry , 1998, IEEE Computer Graphics and Applications.

[4]  Marc Alexa,et al.  Representing Animations by Principal Components , 2000, Comput. Graph. Forum.

[5]  Lorenzo Torresani,et al.  Tracking and modeling non-rigid objects with rank constraints , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[6]  Mira Dontcheva,et al.  Layered acting for character animation , 2003, ACM Trans. Graph..

[7]  Christian Rössl,et al.  Laplacian surface editing , 2004, SGP '04.

[8]  Jovan Popovic,et al.  Deformation transfer for triangle meshes , 2004, ACM Trans. Graph..

[9]  Jovan Popović,et al.  Deformation transfer for triangle meshes , 2004, SIGGRAPH 2004.

[10]  Doug L. James,et al.  Skinning mesh animations , 2005, SIGGRAPH 2005.

[11]  Doug L. James,et al.  Skinning mesh animations , 2005, ACM Trans. Graph..

[12]  Chris Hecker,et al.  Real-time motion retargeting to highly varied user-created morphologies , 2008, ACM Trans. Graph..

[13]  David J. Fleet,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE Gaussian Process Dynamical Model , 2007 .

[14]  Byung-Uck Kim,et al.  Real-time data driven deformation using kernel canonical correlation analysis , 2008, SIGGRAPH 2008.

[15]  Byung-Uck Kim,et al.  Real-time data driven deformation using kernel canonical correlation analysis , 2008, ACM Trans. Graph..

[16]  Marie-Paule Cani,et al.  Modal Locomotion: Animating Virtual Characters with Natural Vibrations , 2009, Comput. Graph. Forum.

[17]  Jovan Popović,et al.  Semantic deformation transfer , 2009, SIGGRAPH 2009.

[18]  Kun Zhou,et al.  Deformation Transfer to Multi‐Component Objects , 2010, Comput. Graph. Forum.

[19]  Katsu Yamane,et al.  Animating non-humanoid characters with human motion data , 2010, SCA '10.

[20]  Edilson de Aguiar,et al.  Stable spaces for real-time clothing , 2010, ACM Trans. Graph..

[21]  Peter-Pike J. Sloan,et al.  Fast and Efficient Skinning of Animated Meshes , 2010, Comput. Graph. Forum.

[22]  Takeo Kanade,et al.  Trajectory Space: A Dual Representation for Nonrigid Structure from Motion , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Sergey Levine,et al.  Continuous character control with low-dimensional embeddings , 2012, ACM Trans. Graph..

[24]  Markus H. Gross,et al.  Deformable objects alive! , 2012, ACM Trans. Graph..

[25]  Yaser Sheikh,et al.  Bilinear spatiotemporal basis models , 2012, TOGS.

[26]  Reinhard Klein,et al.  Interactive steering of mesh animations , 2012, SCA '12.

[27]  Olga Sorkine-Hornung,et al.  Fast automatic skinning transformations , 2012, ACM Trans. Graph..

[28]  Hans-Peter Seidel,et al.  Automatically Rigging Multi‐component Characters , 2012, Comput. Graph. Forum.

[29]  Andrew W. Fitzgibbon,et al.  KinÊtre: animating the world with the human body , 2012, UIST.

[30]  Thomas J. Cashman,et al.  A continuous, editable representation for deforming mesh sequences with separate signals for time, pose and shape , 2012, Comput. Graph. Forum.

[31]  Yeongho Seol,et al.  Creature features: online motion puppetry for non-human characters , 2013, SCA '13.