Fast and reliable example-based mesh IK for stylized deformations

Example-based shape deformation allows a mesh to be easily manipulated or animated with simple inputs. As the user pulls parts of the shape, the rest of the mesh automatically changes in an intuitive way by drawing from a set of exemplars. This provides a way for virtual shapes or characters to be easily authored and manipulated, or for a set of drawings to be animated with simple inputs. We describe a new approach for example-based inverse kinematic mesh manipulation which generates high quality deformations for a wide range of inputs, and in particular works well even when provided stylized or "cartoony" examples. This approach is fast enough to run in real time, reliably uses the artist's input shapes in an intuitive way even for highly nonphysical deformations, and provides added expressiveness by allowing the input shapes to be utilized in a way which spatially varies smoothly across the resulting deformed mesh. This allows for rich and detailed deformations to be created from a small set of input shapes, and gives an easy way for a set of sketches to be brought alive with simple click-and-drag inputs.

[1]  Peter-Pike J. Sloan,et al.  Shape by example , 2001, I3D '01.

[2]  Ben Jones,et al.  Example-based plastic deformation of rigid bodies , 2016, ACM Trans. Graph..

[3]  Craig Gotsman,et al.  Smooth Rotation Enhanced As-Rigid-As-Possible Mesh Animation , 2015, IEEE Transactions on Visualization and Computer Graphics.

[4]  Ken-ichi Anjyo,et al.  Direct Manipulation Blendshapes , 2010, IEEE Computer Graphics and Applications.

[5]  Olga Sorkine-Hornung,et al.  Smooth Shape‐Aware Functions with Controlled Extrema , 2012, Comput. Graph. Forum.

[6]  Mario Botsch,et al.  Example‐Driven Deformations Based on Discrete Shells , 2011, Comput. Graph. Forum.

[7]  Marc Alexa,et al.  As-rigid-as-possible surface modeling , 2007, Symposium on Geometry Processing.

[8]  Jovan Popovic,et al.  Deformation transfer for triangle meshes , 2004, ACM Trans. Graph..

[9]  Aaron Hertzmann,et al.  Style-based inverse kinematics , 2004, ACM Trans. Graph..

[10]  Jernej Barbic,et al.  Linear subspace design for real-time shape deformation , 2015, ACM Trans. Graph..

[11]  Takeo Igarashi,et al.  As-rigid-as-possible shape manipulation , 2005, SIGGRAPH '05.

[12]  Christopher D. Twigg,et al.  Point Cloud Glue: constraining simulations using the procrustes transform , 2010, SCA '10.

[13]  Lin Gao,et al.  A Data‐Driven Approach to Realistic Shape Morphing , 2013, Comput. Graph. Forum.

[14]  Matthias Zwicker,et al.  Mesh-based inverse kinematics , 2005, ACM Trans. Graph..

[15]  Yizhou Yu,et al.  Controllable hand deformation from sparse examples with rich details , 2011, SCA '11.

[16]  Olga Sorkine-Hornung,et al.  On Linear Variational Surface Deformation Methods , 2008, IEEE Transactions on Visualization and Computer Graphics.

[17]  Antonio Susín,et al.  Cage Based Deformations: A Survey , 2013 .

[18]  Olga Sorkine-Hornung,et al.  Context‐Aware Skeletal Shape Deformation , 2007, Comput. Graph. Forum.

[19]  Michael A. Saunders,et al.  SNOPT: An SQP Algorithm for Large-Scale Constrained Optimization , 2002, SIAM J. Optim..

[20]  Alla Sheffer,et al.  Pyramid coordinates for morphing and deformation , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[21]  Peter Schröder,et al.  A simple geometric model for elastic deformations , 2010, ACM Trans. Graph..

[22]  Jovan Popovic,et al.  Inverse kinematics for reduced deformable models , 2006, SIGGRAPH '06.

[23]  Olga Sorkine-Hornung,et al.  Fast automatic skinning transformations , 2012, ACM Trans. Graph..

[24]  Hans-Peter Seidel,et al.  Mutable elastic models for sculpting structured shapes , 2013, Comput. Graph. Forum.

[25]  Ligang Liu,et al.  A Local/Global Approach to Mesh Parameterization , 2008, Comput. Graph. Forum.

[26]  Jovan Popovic,et al.  Automatic rigging and animation of 3D characters , 2007, ACM Trans. Graph..

[27]  Li Zhang,et al.  Spacetime faces: high resolution capture for modeling and animation , 2004, SIGGRAPH 2004.

[28]  Joan Lasenby,et al.  Bone Glow: An Improved Method for the Assignment of Weights for Mesh Deformation , 2008, AMDO.

[29]  Olga Sorkine-Hornung,et al.  Bounded biharmonic weights for real-time deformation , 2011, Commun. ACM.

[30]  Thomas W. Sederberg,et al.  Free-form deformation of solid geometric models , 1986, SIGGRAPH.

[31]  M. Kilian,et al.  Geometric modeling in shape space , 2007, SIGGRAPH 2007.

[32]  Takeo Igarashi,et al.  As-rigid-as-possible shape manipulation , 2005, ACM Trans. Graph..

[33]  Mark Meyer,et al.  Subspace clothing simulation using adaptive bases , 2014, ACM Trans. Graph..

[34]  Byung-Uck Kim,et al.  Real-time data driven deformation using kernel canonical correlation analysis , 2008, ACM Trans. Graph..

[35]  John P. Lewis,et al.  Pose Space Deformation: A Unified Approach to Shape Interpolation and Skeleton-Driven Deformation , 2000, SIGGRAPH.

[36]  Wilmot Li,et al.  Dynamic Sprites , 2013, MIG.

[37]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[38]  Eitan Grinspun,et al.  Example-based elastic materials , 2011, ACM Trans. Graph..

[39]  Xun Wang,et al.  Fast corotational simulation for example-driven deformation , 2014, Comput. Graph..

[40]  Nadia Magnenat-Thalmann,et al.  Real‐Time Subspace Integration for Example‐Based Elastic Material , 2015, Comput. Graph. Forum.

[41]  John P. Lewis,et al.  Compression and direct manipulation of complex blendshape models , 2011, ACM Trans. Graph..

[42]  Marc Alexa,et al.  As-rigid-as-possible shape interpolation , 2000, SIGGRAPH.

[43]  Takeo Igarashi,et al.  Real-time example-based elastic deformation , 2012, SCA '12.

[44]  Markus H. Gross,et al.  Efficient simulation of example-based materials , 2012, SCA '12.