Sparse localized deformation components

We propose a method that extracts sparse and spatially localized deformation modes from an animated mesh sequence. To this end, we propose a new way to extend the theory of sparse matrix decompositions to 3D mesh sequence processing, and further contribute with an automatic way to ensure spatial locality of the decomposition in a new optimization framework. The extracted dimensions often have an intuitive and clear interpretable meaning. Our method optionally accepts user-constraints to guide the process of discovering the underlying latent deformation space. The capabilities of our efficient, versatile, and easy-to-implement method are extensively demonstrated on a variety of data sets and application contexts. We demonstrate its power for user friendly intuitive editing of captured mesh animations, such as faces, full body motion, cloth animations, and muscle deformations. We further show its benefit for statistical geometry processing and biomechanically meaningful animation editing. It is further shown qualitatively and quantitatively that our method outperforms other unsupervised decomposition methods and other animation parameterization approaches in the above use cases.

[1]  Sergey Levine,et al.  Continuous character control with low-dimensional embeddings , 2012, ACM Trans. Graph..

[2]  Parag Havaldar Course Notes: Performance Driven Facial Animation , 2006 .

[3]  Jessica K. Hodgins,et al.  Stable spaces for real-time clothing , 2010, ACM Trans. Graph..

[4]  Hanspeter Pfister,et al.  Face transfer with multilinear models , 2005, SIGGRAPH 2005.

[5]  Ronald Fedkiw,et al.  Automatic determination of facial muscle activations from sparse motion capture marker data , 2005, ACM Trans. Graph..

[6]  Geoffrey Irving,et al.  Compression and Direct Manipulation of Complex Blendshape Models , 2011 .

[7]  Byung-Uck Kim,et al.  Real-time data driven deformation using kernel canonical correlation analysis , 2008, ACM Trans. Graph..

[8]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[9]  Rodolphe Jenatton,et al.  Structured Sparsity-Inducing Norms : Statistical and Algorithmic Properties with Applications to Neuroimaging. (Normes Parcimonieuses Structurées : Propriétés Statistiques et Algorithmiques avec Applications à l'Imagerie Cérébrale) , 2011 .

[10]  P. Faloutsos,et al.  Motion Editing With Independent Component Analysis , 2009 .

[11]  Mark Meyer,et al.  Key Point Subspace Acceleration and soft caching , 2007, SIGGRAPH 2007.

[12]  Guillermo Sapiro,et al.  Online dictionary learning for sparse coding , 2009, ICML '09.

[13]  Peter-Pike J. Sloan,et al.  Fast and Efficient Skinning of Animated Meshes , 2010, Comput. Graph. Forum.

[14]  Harry Shum,et al.  Face poser: Interactive modeling of 3D facial expressions using facial priors , 2009, TOGS.

[15]  Steve Marschner,et al.  Data‐Driven Estimation of Cloth Simulation Models , 2012, Comput. Graph. Forum.

[16]  M. Pauly,et al.  Embedded deformation for shape manipulation , 2007, SIGGRAPH 2007.

[17]  Gabriel Taubin,et al.  Stereoscopic Cinema , 2015, Image and Geometry Processing for 3-D Cinematography.

[18]  Hao Li,et al.  Example-based facial rigging , 2010, ACM Transactions on Graphics.

[19]  Michael Garland,et al.  Free-form motion processing , 2008, TOGS.

[20]  Markus H. Gross,et al.  Efficient simulation of example-based materials , 2012, SCA '12.

[21]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[22]  Zhigang Deng,et al.  Smooth skinning decomposition with rigid bones , 2012, ACM Trans. Graph..

[23]  Hans-Peter Seidel,et al.  Performance Capture from Multi-View Video , 2010, Image and Geometry Processing for 3-D Cinematography.

[24]  Hans-Peter Seidel,et al.  Shading-based dynamic shape refinement from multi-view video under general illumination , 2011, 2011 International Conference on Computer Vision.

[25]  Michael Gleicher,et al.  Building efficient, accurate character skins from examples , 2003, ACM Trans. Graph..

[26]  Julien Mairal,et al.  Optimization with Sparsity-Inducing Penalties , 2011, Found. Trends Mach. Learn..

[27]  Lionel Revéret,et al.  Principal geodesic dynamics , 2012, SCA '12.

[28]  Guillermo Sapiro,et al.  Sparse Modeling of Intrinsic Correspondences , 2012, Comput. Graph. Forum.

[29]  Olga Sorkine-Hornung,et al.  Context‐Aware Skeletal Shape Deformation , 2007, Comput. Graph. Forum.

[30]  Hans-Peter Seidel,et al.  Automatic Conversion of Mesh Animations into Skeleton‐based Animations , 2008, Comput. Graph. Forum.

[31]  Adam W. Bargteil,et al.  Physics-inspired upsampling for cloth simulation in games , 2011, SIGGRAPH 2011.

[32]  Mark Pauly,et al.  Example-based facial rigging , 2010, SIGGRAPH 2010.

[33]  Ken-ichi Anjyo,et al.  Direct Manipulation Blendshapes , 2010, IEEE Computer Graphics and Applications.

[34]  Jason Osipa Stop Staring: Facial Modeling and Animation Done Right , 2003 .

[35]  James F. O'Brien,et al.  Near-exhaustive precomputation of secondary cloth effects , 2013, ACM Trans. Graph..

[36]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[37]  Hans-Peter Seidel,et al.  A Statistical Model of Human Pose and Body Shape , 2009, Comput. Graph. Forum.

[38]  Hans-Peter Seidel,et al.  Lightweight binocular facial performance capture under uncontrolled lighting , 2012, ACM Trans. Graph..

[39]  Marcus A. Magnor,et al.  Capture and Statistical Modeling of Arm‐Muscle Deformations , 2013, Comput. Graph. Forum.

[40]  Mario Botsch,et al.  Example‐Driven Deformations Based on Discrete Shells , 2011, Comput. Graph. Forum.

[41]  Steven M. Seitz,et al.  Spacetime faces , 2004, ACM Trans. Graph..

[42]  Lester W. Mackey,et al.  Deflation Methods for Sparse PCA , 2008, NIPS.

[43]  I. Jolliffe,et al.  A Modified Principal Component Technique Based on the LASSO , 2003 .

[44]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[45]  Sebastian Thrun,et al.  SCAPE: shape completion and animation of people , 2005, SIGGRAPH 2005.

[46]  Stephen J. Wright,et al.  Sparse Reconstruction by Separable Approximation , 2008, IEEE Transactions on Signal Processing.

[47]  Fernando De la Torre,et al.  Interactive region-based linear 3D face models , 2011, SIGGRAPH 2011.

[48]  Hans-Peter Seidel,et al.  Learning skeletons for shape and pose , 2010, I3D '10.

[49]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[50]  Keenan Crane,et al.  Geodesics in heat: A new approach to computing distance based on heat flow , 2012, TOGS.

[51]  Thomas J. Cashman,et al.  A continuous, editable representation for deforming mesh sequences with separate signals for time, pose and shape , 2012, Comput. Graph. Forum.

[52]  Dinesh K. Pai,et al.  EigenSkin: real time large deformation character skinning in hardware , 2002, SCA '02.

[53]  Bailin Deng,et al.  Exploring Local Modifications for Constrained Meshes , 2013, Comput. Graph. Forum.

[54]  Derek Bradley,et al.  High-quality passive facial performance capture using anchor frames , 2011, ACM Trans. Graph..

[55]  R. Tibshirani,et al.  Sparse Principal Component Analysis , 2006 .

[56]  Michael J. Black,et al.  DRAPE , 2012, ACM Trans. Graph..