Structured annotations for 2D-to-3D modeling

We present a system for 3D modeling of free-form surfaces from 2D sketches. Our system frees users to create 2D sketches from arbitrary angles using their preferred tool, which may include pencil and paper. A 3D model is created by placing primitives and annotations on the 2D image. Our primitives are based on commonly used sketching conventions and allow users to maintain a single view of the model. This eliminates the frequent view changes inherent to existing 3D modeling tools, both traditional and sketch-based, and enables users to match input to the 2D guide image. Our annotations---same-lengths and angles, alignment, mirror symmetry, and connection curves---allow the user to communicate higher-level semantic information; through them our system builds a consistent model even in cases where the original image is inconsistent. We present the results of a user study comparing our approach to a conventional "sketch-rotate-sketch" workflow.

[1]  Hyewon Seo,et al.  Free-Form Sketching of Self-Occluding Objects , 2007, IEEE Computer Graphics and Applications.

[2]  Mario Costa Sousa,et al.  Sketch-based modeling with few strokes , 2005, SCCG '05.

[3]  Li Zhang,et al.  Single view modeling of free-form scenes , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[4]  Ravin Balakrishnan,et al.  ILoveSketch: as-natural-as-possible sketching system for creating 3d curve models , 2008, UIST '08.

[5]  Sylvain Lefebvre,et al.  Structure‐Preserving Reshape for Textured Architectural Scenes , 2009, Comput. Graph. Forum.

[6]  Marc Alexa,et al.  FiberMesh: designing freeform surfaces with 3D curves , 2007, SIGGRAPH 2007.

[7]  J. Koenderink,et al.  Surface perception in pictures , 1992, Perception & psychophysics.

[8]  Tobias Isenberg,et al.  Sketching, scaffolding, and inking: a visual history for interactive 3D modeling , 2007, NPAR '07.

[9]  Michael S. Brown,et al.  ShapePalettes: interactive normal transfer via sketching , 2007, SIGGRAPH 2007.

[10]  Takeo Igarashi,et al.  As-rigid-as-possible shape manipulation , 2005, ACM Trans. Graph..

[11]  Hans-Peter Seidel,et al.  3D-modeling by ortho-image generation from image sequences , 2008, SIGGRAPH 2008.

[12]  Julie Dorsey,et al.  The Mental Canvas: A Tool for Conceptual Architectural Design and Analysis , 2007 .

[13]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[14]  Ravin Balakrishnan,et al.  Sketching and Composing Widgets for 3D Manipulation , 2008, Comput. Graph. Forum.

[15]  Marc Pollefeys,et al.  Interactive 3D architectural modeling from unordered photo collections , 2008, SIGGRAPH 2008.

[16]  D. Zorin,et al.  Interactive modeling of topologically complex geometric detail , 2004, SIGGRAPH 2004.

[17]  Masayuki Nakajima,et al.  CrossSketch: freeform surface modeling with details , 2007, SBIM '07.

[18]  Emmanuel Prados.  Application of the theory of the viscosity solutions to the Shape From Shading problem , 2004 .

[19]  Abhishek Ranjan,et al.  A suggestive interface for image guided 3D sketching , 2004, CHI.

[20]  Christian Rössl,et al.  Laplacian surface editing , 2004, SGP '04.

[21]  P. A. C. Varley,et al.  Sketch input of 3D models - current directions , 2007, VISAPP.

[22]  Maneesh Agrawala,et al.  Artistic Multiprojection Rendering , 2000, Rendering Techniques.

[23]  Philip H. S. Torr,et al.  VideoTrace: rapid interactive scene modelling from video , 2007, SIGGRAPH 2007.

[24]  J. Hughes,et al.  SmoothSketch: 3D free-form shapes from complex sketches , 2006, ACM Trans. Graph..

[25]  Brian Wyvill,et al.  Introduction to Implicit Surfaces , 1997 .

[26]  Kiia Kallio.  3D6B Editor: Projective 3D Sketching with Line-Based Rendering , 2005, SBM.

[27]  Gershon Elber,et al.  Inferring 3D models from freehand sketches and constraints , 1997, Comput. Aided Des..

[28]  Harry Shum,et al.  Sketching reality: Realistic interpretation of architectural designs , 2008, TOGS.

[29]  Mario Costa Sousa,et al.  A Taxonomy of Modeling Techniques using Sketch-Based Interfaces , 2008, Eurographics.