Example-based expressive animation of 2D rigid bodies

We present a novel approach to facilitate the creation of stylized 2D rigid body animations. Our approach can handle multiple rigid objects following complex physically-simulated trajectories with collisions, while retaining a unique artistic style directly specified by the user. Starting with an existing target animation (e.g., produced by a physical simulation engine) an artist interactively draws over a sparse set of frames, and the desired appearance and motion stylization is automatically propagated to the rest of the sequence. The stylization process may also be performed in an off-line batch process from a small set of drawn sequences. To achieve these goals, we combine parametric deformation synthesis that generalizes and reuses hand-drawn exemplars, with non-parametric techniques that enhance the hand-drawn appearance of the synthesized sequence. We demonstrate the potential of our method on various complex rigid body animations which are created with an expressive hand-drawn look using notably less manual interventions as compared to traditional techniques.

[1]  Takeo Igarashi,et al.  Real-time example-based elastic deformation , 2012, SCA '12.

[2]  Harry Shum,et al.  Stylizing motion with drawings , 2003, SCA '03.

[3]  Richard Williams,et al.  The Animator's Survival Kit , 2001 .

[4]  C. Karen Liu,et al.  Artist-directed dynamics for 2D animation , 2016, ACM Trans. Graph..

[5]  Rubaiat Habib Kazi,et al.  Motion Amplifiers: Sketching Dynamic Illustrations Using the Principles of 2D Animation , 2016, CHI.

[6]  Marcin Szymanski,et al.  Simulating cartoon style animation , 2002, NPAR '02.

[7]  John Dingliana,et al.  As-rigid-as-possible image registration for hand-drawn cartoon animations , 2009, NPAR '09.

[8]  Michael Haller,et al.  Non-photorealistic rendering techniques for motion in computer games , 2004, CIE.

[9]  Bruce Randall Donald,et al.  Accessible animation and customizable graphics via simplicial configuration modeling , 2000, SIGGRAPH.

[10]  Andrew P. Witkin,et al.  Spacetime constraints , 1988, SIGGRAPH.

[11]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[12]  Nicholas J. Higham,et al.  Fast Polar Decomposition of an Arbitrary Matrix , 1990, SIAM J. Sci. Comput..

[13]  F. Thomas,et al.  Disney Animation: The Illusion of Life , 1981 .

[14]  Markus H. Gross,et al.  Meshless deformations based on shape matching , 2005, ACM Trans. Graph..

[15]  Wen Tang,et al.  Automatic expressive deformations for stylizing motion , 2006, GRAPHITE '06.

[16]  Nassir Navab,et al.  Dense image registration through MRFs and efficient linear programming , 2008, Medical Image Anal..

[17]  John Lasseter,et al.  Principles of traditional animation applied to 3D computer animation , 1987, SIGGRAPH.

[18]  Seungyong Lee,et al.  Coherent line drawing , 2007, NPAR '07.

[19]  Jong-Chul Yoon,et al.  CartoonModes: Cartoon stylization of video objects through modal analysis , 2012, Graph. Model..

[20]  Eitan Grinspun,et al.  Example-based elastic materials , 2011, ACM Trans. Graph..

[21]  Markus H. Gross,et al.  Deformable objects alive! , 2012, ACM Trans. Graph..

[22]  Ben Jones,et al.  Example-based plastic deformation of rigid bodies , 2016, ACM Trans. Graph..

[23]  Li-Yi Wei,et al.  Energy-Brushes: Interactive Tools for Illustrating Stylized Elemental Dynamics , 2016, UIST.

[24]  Eli Shechtman,et al.  StyLit , 2016, ACM Trans. Graph..

[25]  Maneesh Agrawala,et al.  The cartoon animation filter , 2006, ACM Trans. Graph..

[26]  Wilmot Li,et al.  Dynamic sprites: artistic authoring of interactive animations , 2015, Comput. Animat. Virtual Worlds.

[27]  Rubaiat Habib Kazi,et al.  Draco: bringing life to illustrations with kinetic textures , 2014, CHI.

[28]  Ronen Barzel,et al.  A modeling system based on dynamic constraints , 1988, SIGGRAPH.

[29]  Stephen DiVerdi,et al.  HelpingHand: example-based stroke stylization , 2012, ACM Trans. Graph..

[30]  Rubaiat Habib Kazi,et al.  Kitty: sketching dynamic and interactive illustrations , 2014, UIST.

[31]  John Dingliana,et al.  A Physically Based Deformation Model for Interactive Cartoon Animation , 2007, VRIPHYS.

[32]  Pierre Bénard,et al.  Stylizing animation by example , 2013, ACM Trans. Graph..

[33]  Li-Yi Wei,et al.  Autocomplete hand-drawn animations , 2015, ACM Trans. Graph..

[34]  F. Thomas,et al.  The illusion of life : Disney animation , 1981 .

[35]  Christoph Bregler,et al.  Turning to the masters: motion capturing cartoons , 2002, ACM Trans. Graph..

[36]  Leon A. Gatys,et al.  Image Style Transfer Using Convolutional Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Sung Yong Shin,et al.  Polymorph: Morphing Among Multiple Images , 1998, IEEE Computer Graphics and Applications.