Seamless reconstruction of part-based high-relief models from hand-drawn images

We present a new approach to reconstruction of high-relief surface models from hand-made drawings. Our method is tailored to an interactive modeling scenario where the input drawing can be separated into a set of semantically meaningful parts of which relative depth order is known beforehand. For this kind of input, our technique allows inflating individual components to have a semi-elliptical profile, positioning them to satisfy prescribed depth order, and providing their seamless interconnection. Compared to previous methods, our approach is the first that formulates this reconstruction process as a single non-linear optimization problem. Because its direct optimization is computationally challenging, we propose an approximate solution which delivers comparable results orders of magnitude faster enabling an interactive user workflow. We evaluate our approach on various hand-made drawings and demonstrate that it provides state-of-the-art quality in comparison with previous methods which require comparable user intervention.

[1]  Mark Meyer,et al.  Discrete Differential-Geometry Operators for Triangulated 2-Manifolds , 2002, VisMath.

[2]  Takeo Igarashi,et al.  Smooth meshes for sketch-based freeform modeling , 2003, I3D '03.

[3]  Wenping Wang,et al.  BendSketch , 2017, ACM Trans. Graph..

[4]  Adam Finkelstein,et al.  Digital bas-relief from 3D scenes , 2007, ACM Trans. Graph..

[5]  Hongxin Zhang,et al.  Prototype Modeling from Sketched Silhouettes based on Convolution Surfaces , 2004, Comput. Graph. Forum.

[6]  John Dingliana,et al.  Adding Depth to Cartoons Using Sparse Depth (In)equalities , 2010, Comput. Graph. Forum.

[7]  H. Read The Art of Sculpture , 1956 .

[8]  Daniele Panozzo,et al.  LIBIGL: A C++ library for geometry processing without a mesh data structure , 2014 .

[9]  Chi-Wing Fu,et al.  Globally Consistent Wrinkle-Aware Shading of Line Drawings , 2018, IEEE Transactions on Visualization and Computer Graphics.

[10]  Daniel Cohen-Or,et al.  3-Sweep , 2013, ACM Trans. Graph..

[11]  Daniel Cohen-Or,et al.  Geosemantic Snapping for Sketch‐Based Modeling , 2013, Comput. Graph. Forum.

[12]  Brian Wyvill,et al.  ShapeShop: sketch-based solid modeling with BlobTrees , 2006, SBM.

[13]  Dani Lischinski,et al.  Hallucinating Stereoscopy from a Single Image , 2015, Comput. Graph. Forum.

[14]  Paolo Cignoni,et al.  Computer-Assisted Generation of Bas-and High-Reliefs , 1997, J. Graphics, GPU, & Game Tools.

[15]  Marie-Paule Cani,et al.  Modeling 3D animals from a side-view sketch , 2015, Comput. Graph..

[16]  John F. Hughes,et al.  SmoothSketch: 3D free-form shapes from complex sketches , 2006, SIGGRAPH '06.

[17]  Tien-Tsin Wong,et al.  Stereoscopizing cel animations , 2013, ACM Trans. Graph..

[18]  Olga Sorkine-Hornung,et al.  Ink-and-ray: Bas-relief meshes for adding global illumination effects to hand-drawn characters , 2014, TOGS.

[19]  Fan Jiang,et al.  An Interactive 2D-to-3D Cartoon Modeling System , 2016, Edutainment.

[20]  Sabine Süsstrunk,et al.  High Reliefs from 3D Scenes , 2015, Comput. Graph. Forum.

[21]  Jorge Nocedal,et al.  On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[22]  Olga Sorkine-Hornung,et al.  Appearance-mimicking surfaces , 2014, ACM Trans. Graph..

[23]  Alla Sheffer,et al.  Modeling Character Canvases from Cartoon Drawings , 2015, ACM Trans. Graph..

[24]  Leif Kobbelt,et al.  Geometric fairing of irregular meshes for free-form surface design , 2001, Comput. Aided Geom. Des..

[25]  Adam Finkelstein,et al.  Digital bas-relief from 3D scenes , 2007, ACM Trans. Graph..

[26]  Chi-Wing Fu,et al.  Interactive High-Relief Reconstruction for Organic and Double-Sided Objects from a Photo , 2017, IEEE Transactions on Visualization and Computer Graphics.

[27]  Marc Alexa,et al.  FiberMesh: designing freeform surfaces with 3D curves , 2007, ACM Trans. Graph..

[28]  Satoshi Matsuoka,et al.  Teddy: A Sketching Interface for 3D Freeform Design , 1999, SIGGRAPH Courses.

[29]  Takeo Igarashi,et al.  Structured annotations for 2D-to-3D modeling , 2009, ACM Trans. Graph..

[30]  A. Ricci,et al.  A Constructive Geometry for Computer Graphics , 1973, Comput. J..

[31]  A. Ricci,et al.  A Constructive Geometry for Computer Graphics , 1973, Computer/law journal.

[32]  Andrew Nealen,et al.  RigMesh: automatic rigging for part-based shape modeling and deformation , 2012, ACM Trans. Graph..

[33]  Craig Gotsman,et al.  ArtiSketch: A System for Articulated Sketch Modeling , 2013, Comput. Graph. Forum.

[34]  Chi-Wing Fu,et al.  2.5D Cartoon Hair Modeling and Manipulation , 2015, IEEE Transactions on Visualization and Computer Graphics.

[35]  Faramarz F. Samavati,et al.  Image-assisted modeling from sketches , 2010, Graphics Interface.

[36]  Gabriel Taubin,et al.  A signal processing approach to fair surface design , 1995, SIGGRAPH.

[37]  Adrien Bousseau,et al.  True2Form: 3D curve networks from 2D sketches via selective regularization , 2014, ACM Trans. Graph..

[38]  Bob Carpenter,et al.  The Stan Math Library: Reverse-Mode Automatic Differentiation in C++ , 2015, ArXiv.