Learning Part-Based Models for Animation from Surface Motion Capture

Surface motion capture (Surf Cap) enables 3D reconstruction of human performance with detailed cloth and hair deformation. However, there is a lack of tools that allow flexible editing of Surf Cap sequences. In this paper, we present a Laplacian editing technique that constrains the mesh deformation to plausible surface shapes learnt from a set of examples. A part-Based representation of the mesh enables learning of surface deformation locally in the space of Laplacian coordinates, avoiding correlations between body parts while preserving surface details. This extends the range of animation with natural surface deformation beyond the whole-body poses present in the Surf Cap data. We illustrate successful use of our tool on three different characters.

[1]  Adrian Hilton,et al.  Global temporal registration of multiple non-rigid surface sequences , 2011, CVPR 2011.

[2]  Hans-Peter Seidel,et al.  Performance capture from sparse multi-view video , 2008, ACM Trans. Graph..

[3]  Christian Rössl,et al.  Laplacian surface editing , 2004, SGP '04.

[4]  H. Shum,et al.  Subspace gradient domain mesh deformation , 2006, SIGGRAPH 2006.

[5]  Atsushi Nakazawa,et al.  Human video textures , 2009, I3D '09.

[6]  Cary B. Phillips,et al.  Multi-weight enveloping: least-squares approximation techniques for skin animation , 2002, SCA '02.

[7]  Kevin G. Der,et al.  Inverse kinematics for reduced deformable models , 2006, SIGGRAPH 2006.

[8]  Olga Sorkine-Hornung,et al.  On Linear Variational Surface Deformation Methods , 2008, IEEE Transactions on Visualization and Computer Graphics.

[9]  Ilya Baran,et al.  Automatic rigging and animation of 3D characters , 2007, SIGGRAPH 2007.

[10]  Tae-Yong Kim,et al.  Eurographics/ Acm Siggraph Symposium on Computer Animation (2008) Drivenshape -a Data-driven Approach for Shape Deformation , 2022 .

[11]  Sebastian Thrun,et al.  SCAPE: shape completion and animation of people , 2005, SIGGRAPH 2005.

[12]  Adrian Hilton,et al.  Video-based character animation , 2005, SCA '05.

[13]  Michael Garland,et al.  Free-form motion processing , 2008, TOGS.

[14]  D. Levin,et al.  Linear rotation-invariant coordinates for meshes , 2005, SIGGRAPH 2005.

[15]  Jan Kautz,et al.  Video-based characters: creating new human performances from a multi-view video database , 2011, SIGGRAPH 2011.

[16]  Adrian Hilton,et al.  Human motion synthesis from 3D video , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Doug L. James,et al.  Skinning mesh animations , 2005, ACM Trans. Graph..

[18]  Markus Gross,et al.  Deformation Transfer for Detail-Preserving Surface Editing , 2006 .

[19]  O. Sorkine Differential Representations for Mesh Processing , 2006 .

[20]  Jovan Popović,et al.  Mesh-based inverse kinematics , 2005, SIGGRAPH 2005.

[21]  Dinesh K. Pai,et al.  EigenSkin: real time large deformation character skinning in hardware , 2002, SCA '02.

[22]  Adrian Hilton,et al.  Surface Capture for Performance-Based Animation , 2007, IEEE Computer Graphics and Applications.

[23]  Olga Sorkine-Hornung,et al.  Bounded biharmonic weights for real-time deformation , 2011, Commun. ACM.

[24]  Hans-Peter Seidel,et al.  A volumetric approach to interactive shape editing , 2007 .

[25]  Martin Klaudiny,et al.  Global Non-rigid Alignment of Surface Sequences , 2013, International Journal of Computer Vision.

[26]  Jean-Yves Guillemaut,et al.  Interactive Animation of 4D Performance Capture , 2013, IEEE Transactions on Visualization and Computer Graphics.

[27]  Richard Szeliski,et al.  High-quality video view interpolation using a layered representation , 2004, SIGGRAPH 2004.

[28]  Jean-Yves Guillemaut,et al.  4D parametric motion graphs for interactive animation , 2012, I3D '12.

[29]  Olga Sorkine-Hornung,et al.  Elasticity-inspired deformers for character articulation , 2012, ACM Trans. Graph..

[30]  Daniel Thalmann,et al.  Joint-dependent local deformations for hand animation and object grasping , 1989 .

[31]  Christian Rössl,et al.  Differential coordinates for interactive mesh editing , 2004, Proceedings Shape Modeling Applications, 2004..

[32]  Wojciech Matusik,et al.  Articulated mesh animation from multi-view silhouettes , 2008, ACM Trans. Graph..

[33]  Pieter Peers,et al.  Facial performance synthesis using deformation-driven polynomial displacement maps , 2008, SIGGRAPH 2008.

[34]  Fernando De la Torre,et al.  Interactive region-based linear 3D face models , 2011, SIGGRAPH 2011.

[35]  Michael Gleicher,et al.  Building efficient, accurate character skins from examples , 2003, ACM Trans. Graph..

[36]  Olga Sorkine-Hornung,et al.  Context‐Aware Skeletal Shape Deformation , 2007, Comput. Graph. Forum.

[37]  Adrian Hilton,et al.  Space-time Editing of 3D Video Sequences , 2011, 2011 Conference for Visual Media Production.

[38]  John P. Lewis,et al.  Pose Space Deformation: A Unified Approach to Shape Interpolation and Skeleton-Driven Deformation , 2000, SIGGRAPH.