Inverse toon shading: interactive normal field modeling with isophotes

We introduce an interactive modeling tool for designing a smooth 3D normal field from the isophotes of a discretely shaded 2D image. Block or cartoon shading is a visual style in which artists depict a smoothly shaded 3D object using a small number of discrete brightness values, manifested as regions or bands of constant color. In our approach, artists trace isophotes, or curves of constant brightness, along the boundaries between constant color bands. Our algorithm first estimates light directions and computes 3D normals along the object silhouette and at intersections between isophotes from different light sources. We then propagate these 3D normals smoothly along isophotes, and subsequently throughout the interior of the shape. We describe our user interface for editing isophotes and correcting unintended normals produced by our algorithm. We validate our approach with a perceptual experiment and comparisons to ground truth data. Finally, we present a set of 3D renderings created using our interface.

[1]  Betty Edwards,et al.  The new drawing on the right side of the brain workbook : guided practice in the five basic skills of drawing , 1979 .

[2]  Li Zhang,et al.  Single view modeling of free-form scenes , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[3]  Koos Eissen,et al.  Sketching: Drawing Techniques for Product Designers , 2009 .

[4]  Takeo Igarashi,et al.  Structured annotations for 2D-to-3D modeling , 2009, SIGGRAPH 2009.

[5]  Todd E. Zickler,et al.  A projective framework for radiometric image analysis , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Adrien Bousseau,et al.  CrossShade: shading concept sketches using cross-section curves , 2012, ACM Trans. Graph..

[7]  Yotam I. Gingold,et al.  Shading-based surface editing , 2008, ACM Trans. Graph..

[8]  Kiriakos N. Kutulakos,et al.  Shape from Planar Curves: A Linear Escape from Flatland , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Yotam I. Gingold,et al.  Shape optimization using reflection lines , 2007, Symposium on Geometry Processing.

[10]  Olga Sorkine-Hornung,et al.  Ink-and-ray: Bas-relief meshes for adding global illumination effects to hand-drawn characters , 2014, TOGS.

[11]  Jean-Denis Durou,et al.  Numerical methods for shape-from-shading: A new survey with benchmarks , 2008, Comput. Vis. Image Underst..

[12]  Scott F. Johnston Lumo: illumination for cel animation , 2002, NPAR '02.

[13]  Daniel Cremers,et al.  Fast and globally optimal single view reconstruction of curved objects , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  J. Koenderink,et al.  Surface perception in pictures , 1992, Perception & psychophysics.

[15]  J. Flusser,et al.  Numerically Stable Direct Least Squares Fitting of Ellipses , 1998 .

[16]  Adrien Bousseau,et al.  True2Form: 3D curve networks from 2D sketches via selective regularization , 2014, ACM Trans. Graph..

[17]  Harry Shum,et al.  ShapePalettes: interactive normal transfer via sketching , 2007, ACM Trans. Graph..

[18]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[19]  Holger Theisel,et al.  Are isophotes and reflection lines the same? , 2001, Comput. Aided Geom. Des..

[20]  Steven M. Seitz,et al.  Single-view modelling of free-form scenes , 2002, Comput. Animat. Virtual Worlds.

[21]  Elaine Cohen,et al.  Eurographics Workshop on Sketch-based Interfaces and Modeling (2006) Producing Models from Drawings of Curved Surfaces , 2022 .

[22]  Hans-Peter Seidel,et al.  Modeling of surfaces with fair reflection line pattern , 1999, Proceedings Shape Modeling International '99. International Conference on Shape Modeling and Applications.

[23]  John Dingliana,et al.  LazyBrush: Flexible Painting Tool for Hand‐drawn Cartoons , 2009, Comput. Graph. Forum.

[24]  Dick Powell Presentation Techniques: A Guide to Drawing and Presenting Design Ideas , 1990 .

[25]  Aaron Hertzmann,et al.  Isophote distance: a shading approach to artistic stroke thickness , 2007, NPAR '07.

[26]  Alexandrina Orzan,et al.  Texture Design and Draping in 2D Images , 2016 .

[27]  Yasuyuki Matsushita,et al.  Single-View Relighting with Normal Map Painting , 2006 .

[28]  John Snyder,et al.  Freeform vector graphics with controlled thin-plate splines , 2011, ACM Trans. Graph..

[29]  Satoshi Matsuoka,et al.  Teddy: A Sketching Interface for 3D Freeform Design , 1999, SIGGRAPH Courses.

[30]  Thomas Poeschl,et al.  Detecting surface irregularities using isophotes , 1984, Comput. Aided Geom. Des..

[31]  Pascal Barla,et al.  Diffusion curves: a vector representation for smooth-shaded images , 2008, ACM Trans. Graph..

[32]  Nathan A. Carr,et al.  Repoussé: automatic inflation of 2D artwork , 2008, SBM'08.

[33]  Takeo Igarashi,et al.  Structured annotations for 2D-to-3D modeling , 2009, ACM Trans. Graph..

[34]  Michael S. Brown,et al.  ShapePalettes: interactive normal transfer via sketching , 2007, SIGGRAPH 2007.