Autocomplete hand-drawn animations

Hand-drawn animation is a major art form and communication medium, but can be challenging to produce. We present a system to help people create frame-by-frame animations through manual sketches. We design our interface to be minimalistic: it contains only a canvas and a few controls. When users draw on the canvas, our system silently analyzes all past sketches and predicts what might be drawn in the future across spatial locations and temporal frames. The interface also offers suggestions to beautify existing drawings. Our system can reduce manual workload and improve output quality without compromising natural drawing flow and control: users can accept, ignore, or modify such predictions visualized on the canvas by simple gestures. Our key idea is to extend the local similarity method in [Xing et al. 2014], which handles only low-level spatial repetitions such as hatches within a single frame, to a global similarity that can capture high-level structures across multiple frames such as dynamic objects. We evaluate our system through a preliminary user study and confirm that it can enhance both users' objective performance and subjective satisfaction.

[1]  M. Pauly,et al.  Embedded deformation for shape manipulation , 2007, SIGGRAPH 2007.

[2]  Michiel van de Panne,et al.  Motion doodles: an interface for sketching character motion , 2004, SIGGRAPH Courses.

[3]  John Dingliana,et al.  As-rigid-as-possible image registration for hand-drawn cartoon animations , 2009, NPAR '09.

[4]  Stephen DiVerdi,et al.  RealBrush: painting with examples of physical media , 2013, ACM Trans. Graph..

[5]  Martin Guay,et al.  Space-time sketching of character animation , 2015, ACM Trans. Graph..

[6]  Markus H. Gross,et al.  Temporal noise control for sketchy animation , 2011, NPAR '11.

[7]  Li-Yi Wei,et al.  History assisted view authoring for 3D models , 2014, CHI.

[8]  Adrien Treuille,et al.  Real-time drawing assistance through crowdsourcing , 2013, HCOMP.

[9]  Takeo Igarashi,et al.  Generating photo manipulation tutorials by demonstration , 2009, ACM Trans. Graph..

[10]  Li-Yi Wei,et al.  Autocomplete painting repetitions , 2014, ACM Trans. Graph..

[11]  Yong Jae Lee,et al.  ShadowDraw: real-time user guidance for freehand drawing , 2011, ACM Trans. Graph..

[12]  Alex Graves,et al.  Generating Sequences With Recurrent Neural Networks , 2013, ArXiv.

[13]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[14]  Adrien Bousseau,et al.  The drawing assistant: automated drawing guidance and feedback from photographs , 2013, UIST.

[15]  Wilmot Li,et al.  Dynamic sprites: artistic authoring of interactive animations , 2015, Comput. Animat. Virtual Worlds.

[16]  Leonidas J. Guibas,et al.  Non-Rigid Registration Under Isometric Deformations , 2008 .

[17]  C. Lawrence Zitnick,et al.  Handwriting beautification using token means , 2013, ACM Trans. Graph..

[18]  Markus H. Gross,et al.  BetweenIT: An Interactive Tool for Tight Inbetweening , 2010, Comput. Graph. Forum.

[19]  Brad A. Myers,et al.  Selective Undo Support for Painting Applications , 2015, CHI.

[20]  Pierre Bénard,et al.  Stylizing animation by example , 2013, ACM Trans. Graph..

[21]  Oliver Deussen,et al.  Hardware‐Based Non‐Photorealistic Rendering Using a Painting Robot , 2015, Comput. Graph. Forum.

[22]  Mirela Ben-Chen,et al.  Complex Barycentric Coordinates with Applications to Planar Shape Deformation , 2009, Comput. Graph. Forum.

[23]  Chiew-Lan Tai,et al.  MoXi: real-time ink dispersion in absorbent paper , 2005, SIGGRAPH '05.

[24]  Li-yi Wei,et al.  Discrete element textures , 2011, SIGGRAPH 2011.

[25]  Stephen DiVerdi,et al.  Exploring collections of 3D models using fuzzy correspondences , 2012, ACM Trans. Graph..

[26]  Rubaiat Habib Kazi,et al.  Kitty: sketching dynamic and interactive illustrations , 2014, UIST.

[27]  Markus H. Gross,et al.  Hierarchical motion brushes for animation instancing , 2014, NPAR '14.

[28]  Jean Charles Bazin,et al.  Painting by feature , 2013, ACM Trans. Graph..

[29]  William V. Baxter,et al.  Latent Doodle Space , 2006, Comput. Graph. Forum.

[30]  David Salesin,et al.  A sketching interface for articulated figure animation , 2006, SIGGRAPH 2006.

[31]  Hao Li,et al.  Global Correspondence Optimization for Non‐Rigid Registration of Depth Scans , 2008, Comput. Graph. Forum.

[32]  Rubaiat Habib Kazi,et al.  Draco: bringing life to illustrations with kinetic textures , 2014, CHI.

[33]  Takeo Igarashi,et al.  As-rigid-as-possible shape manipulation , 2005, ACM Trans. Graph..

[34]  Li-Yi Wei,et al.  Discrete element textures , 2011, ACM Trans. Graph..

[35]  Andy Cockburn,et al.  Causality: a conceptual model of interaction history , 2014, CHI.