Space-time Editing of 3D Video Sequences

A shape constrained Laplacian mesh deformation approach is introduced for interactive editing of mesh sequences. This allows low-level constraints, such as foot or hand contact, to be imposed while preserving the natural dynamics of the captured surface. The approach also allows artistic manipulation of motion style to achieve effects such as squash-and-stretch. Interactive editing of key-frames is followed by automatic temporal propagation over a window of frames. User edits are seamlessly integrated into the captured mesh sequence. Three spatio-temporal interpolation methods are evaluated. Results on a variety of real and synthetic sequences demonstrate that the approach enables flexible manipulation of captured 3D video sequences.

[1]  Michael Garland,et al.  Free-form motion processing , 2008, TOGS.

[2]  Michael Gleicher,et al.  Motion editing with spacetime constraints , 1997, SI3D.

[3]  Jinxiang Chai,et al.  Synthesis and editing of personalized stylistic human motion , 2010, I3D '10.

[4]  Olga Sorkine-Hornung,et al.  On Linear Variational Surface Deformation Methods , 2008, IEEE Transactions on Visualization and Computer Graphics.

[5]  O. Sorkine.  Differential Representations for Mesh Processing , 2006 .

[6]  Michael Gleicher,et al.  Automated extraction and parameterization of motions in large data sets , 2004, SIGGRAPH 2004.

[7]  Lucas Kovar,et al.  Motion graphs , 2002, SIGGRAPH Classes.

[8]  Tomohiko Mukai,et al.  Geostatistical motion interpolation , 2005, SIGGRAPH '05.

[9]  Charles F. Rose,et al.  Verbs and adverbs: multidimensional motion interpolation using radial basis functions , 1999 .

[10]  Aaron Hertzmann,et al.  Style machines , 2000, SIGGRAPH 2000.

[11]  Jovan Popović,et al.  Deformation transfer for triangle meshes , 2004, SIGGRAPH 2004.

[12]  Hans-Peter Seidel,et al.  A volumetric approach to interactive shape editing , 2007 .

[13]  Yong Cao,et al.  Style components , 2006, Graphics Interface.

[14]  Michael Gleicher,et al.  Parametric motion graphs , 2007, SI3D.

[15]  Adrian Hilton,et al.  Human motion synthesis from 3D video , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Wojciech Matusik,et al.  Articulated mesh animation from multi-view silhouettes , 2008, ACM Trans. Graph..

[17]  Kun Zhou,et al.  Gradient domain editing of deforming mesh sequences , 2007, ACM Trans. Graph..

[18]  Adrian Hilton,et al.  Surface Capture for Performance-Based Animation , 2007, IEEE Computer Graphics and Applications.

[19]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[20]  Jovan Popović,et al.  Semantic deformation transfer , 2009, SIGGRAPH 2009.

[21]  D. Levin,et al.  Linear rotation-invariant coordinates for meshes , 2005, SIGGRAPH 2005.

[22]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[23]  Kari Pulli,et al.  Style translation for human motion , 2005, SIGGRAPH 2005.

[24]  Markus Gross,et al.  Deformation Transfer for Detail-Preserving Surface Editing , 2006 .

[25]  Jovan Popović,et al.  Mesh-based inverse kinematics , 2005, SIGGRAPH 2005.

[26]  Sung Yong Shin,et al.  A hierarchical approach to interactive motion editing for human-like figures , 1999, SIGGRAPH.