MagicToon: A 2D-to-3D creative cartoon modeling system with mobile AR

We present MagicToon, an interactive modeling system with mobile augmented reality (AR) that allows children to build 3D cartoon scenes creatively from their own 2D cartoon drawings on paper. Our system consists of two major components: an automatic 2D-to-3D cartoon model creator and an interactive model editor to construct more complicated AR scenes. The model creator can generate textured 3D cartoon models according to 2D drawings automatically and overlay them on the real world, bringing life to flat cartoon drawings. With our interactive model editor, the user can perform several optional operations on 3D models such as copying and animating in AR context through a touchscreen of a handheld device. The user can also author more complicated AR scenes by placing multiple registered drawings simultaneously. The results of our user study have shown that our system is easier to use compared with traditional sketch-based modeling systems and can give more play to children's innovations compared with AR coloring books.

[1]  Brian Wyvill,et al.  ShapeShop: sketch-based solid modeling with BlobTrees , 2007, SIGGRAPH '07.

[2]  Satoshi Matsuoka,et al.  Teddy: A Sketching Interface for 3D Freeform Design , 1999, SIGGRAPH Courses.

[3]  S. G. Hart,et al.  Development of NASA-TLX(Task Load Index) , 1988 .

[4]  Gilberto Osorio-Gómez,et al.  AIR-MODELLING: A tool for gesture-based solid modelling in context during early design stages in AR environments , 2015, Comput. Ind..

[5]  Andreas Dünser,et al.  An interactive augmented reality coloring book , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[6]  Jihad El-Sana,et al.  In-Place Sketching for content authoring in Augmented Reality games , 2010, 2010 IEEE Virtual Reality Conference (VR).

[7]  Pascal Fua,et al.  Live Texturing of Augmented Reality Characters from Colored Drawings , 2015, IEEE Transactions on Visualization and Computer Graphics.

[8]  Sharon L. Oviatt,et al.  Human-centered design meets cognitive load theory: designing interfaces that help people think , 2006, MM '06.

[9]  Ivan Poupyrev,et al.  MagicBook: transitioning between reality and virtuality , 2001, CHI Extended Abstracts.

[10]  Antonio L. Furtado,et al.  Draw Your Own Story: Paper and Pencil Interactive Storytelling , 2011, ICEC.

[11]  Joaquim A. Jorge,et al.  NaturaSketch: Modeling from Images and Natural Sketches , 2011, IEEE Computer Graphics and Applications.

[12]  Tobias Isenberg,et al.  Sketching, scaffolding, and inking: a visual history for interactive 3D modeling , 2007, NPAR '07.

[13]  Kenny Mitchell,et al.  Augmented creativity: bridging the real and virtual worlds to enhance creative play , 2015, SIGGRAPH Asia Mobile Graphics and Interactive Applications.

[14]  Marc Alexa,et al.  FiberMesh: designing freeform surfaces with 3D curves , 2007, SIGGRAPH 2007.

[15]  Nava Rubin,et al.  Salient and multiple illusory surfaces , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[16]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[17]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[18]  Heinrich Müller,et al.  Improved Laplacian Smoothing of Noisy Surface Meshes , 1999, Comput. Graph. Forum.

[19]  Andrew Nealen,et al.  RigMesh: automatic rigging for part-based shape modeling and deformation , 2012, ACM Trans. Graph..

[20]  Ching Y. Suen,et al.  A fast parallel algorithm for thinning digital patterns , 1984, CACM.

[21]  Jonathan Richard Shewchuk,et al.  Delaunay refinement algorithms for triangular mesh generation , 2002, Comput. Geom..

[22]  Jihad El-Sana,et al.  In-place 3D sketching for authoring and augmenting mechanical systems , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[23]  Takeo Igarashi,et al.  Structured annotations for 2D-to-3D modeling , 2009, ACM Trans. Graph..

[24]  Wolfgang Hürst,et al.  Tracking-based interaction for object creation in mobile augmented reality , 2013, MM '13.

[25]  Nicoletta Adamo-Villani,et al.  ARpm: an augmented reality interface for polygonal modeling , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[26]  Ilya Baran,et al.  Automatic rigging and animation of 3D characters , 2007, SIGGRAPH 2007.