Sketch-based search and composition of 3D models

There is growing interest in developing tools with which novice users can create detailed 3D models of their own designs. The most popular approaches to this problem include sketch-based interfaces and part-composition systems. The sketch-based modeling systems provide natural interfaces for creating 3D models from 2D sketches, but are generally limited to creating simple geometric models. The part-composition systems provide tools for combining parts extracted from a database of 3D models, and thus can generate very detailed 3D models, but usually with much higher overhead and expertise required by the user for manipulating 3D geometry interactively. In this paper, we introduce a new modeling method that overcomes these limitations by combining both approaches - we introduce a modeling system for parts composition with a sketching interface. The system allows the user to find a part in a database and composite it into a model with a single sketch. This approach combines the benefits of both approaches - i.e., it allows creation of highly detailed models/scenes (as details come from parts in the database), while 2D sketched strokes provide all the information for part selection and composition (no 3D manipulation is required, in general). To enable this modeling method, we investigate an algorithm for 3D shape search with 2D sketch as a shape query and a part placement algorithm which automatically orients, translates, scales, and attaches a new part into a modeling scene by taking the user sketch as a hint. User experiences with our prototype system show that novice users can create interesting and detailed models with our system.

[1]  Day Chyi Ku,et al.  A sketching interface for 3D modeling of polyhedrons , 2006, SBM'06.

[2]  Jiantao Pu,et al.  A 2D Sketch-Based User Interface for 3D CAD Model Retrieval , 2005 .

[3]  John F. Hughes,et al.  SmoothSketch: 3D free-form shapes from complex sketches , 2006, SIGGRAPH '06.

[4]  Szymon Rusinkiewicz,et al.  Modeling by example , 2004, ACM Trans. Graph..

[5]  J. Loffler,et al.  Content-based retrieval of 3D models in distributed Web databases by visual shape information , 2000, 2000 IEEE Conference on Information Visualization. An International Conference on Computer Visualization and Graphics.

[6]  Karthik Ramani,et al.  Sketch-based 3D engineering part class browsing and retrieval , 2006, SBM'06.

[7]  Szymon Rusinkiewicz,et al.  Modeling by example , 2004, SIGGRAPH 2004.

[8]  Chen Yang,et al.  Sketch-based modeling of parameterized objects , 2005, SIGGRAPH '05.

[9]  Marc Alexa,et al.  FiberMesh: designing freeform surfaces with 3D curves , 2007, ACM Trans. Graph..

[10]  Daniel Cohen-Or,et al.  SnapPaste: an interactive technique for easy mesh composition , 2006, The Visual Computer.

[11]  Nikitas M. Sgouros,et al.  Shape-based retrieval of 3D models in scene synthesis , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[12]  Marc Alexa,et al.  SilSketch: automated sketch-based editing of surface meshes , 2007, SBIM '07.

[13]  Kun Zhou,et al.  Mesh editing with poisson-based gradient field manipulation , 2004, SIGGRAPH 2004.

[14]  Karthik Ramani,et al.  Classifier combination for sketch-based 3D part retrieval , 2007, Comput. Graph..

[15]  John F. Hughes,et al.  Inferring 3D free-form shapes from contour drawings , 2005, SIGGRAPH '05.

[16]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark , 2004, Proceedings Shape Modeling Applications, 2004..

[17]  Takeo Igarashi,et al.  Magic canvas: interactive design of a 3-D scene prototype from freehand sketches , 2007, GI '07.

[18]  Mario Costa Sousa,et al.  Sketch-Based Mesh Augmentation , 2005, SBM.

[19]  Frank Nielsen,et al.  Copy-Paste Synthesis of 3D Geometry with Repetitive Patterns , 2006, Smart Graphics.

[20]  Kun Zhou,et al.  Mesh editing with poisson-based gradient field manipulation , 2004, ACM Trans. Graph..

[21]  Charlie C. L. Wang,et al.  Sketch Based Mesh Fusion , 2006, Computer Graphics International.

[22]  J. Hughes,et al.  SmoothSketch: 3D free-form shapes from complex sketches , 2006, ACM Trans. Graph..

[23]  David P. Dobkin,et al.  A search engine for 3D models , 2003, TOGS.

[24]  Satoshi Matsuoka,et al.  Teddy: A Sketching Interface for 3D Freeform Design , 1999, SIGGRAPH Courses.

[25]  John F. Hughes,et al.  SKETCH: An Interface for Sketching 3D Scenes , 1996, SIGGRAPH.

[26]  Marc Alexa,et al.  A sketch-based interface for detail-preserving mesh editing , 2005, SIGGRAPH 2005.

[27]  Christian Rössl,et al.  Laplacian surface editing , 2004, SGP '04.

[28]  George Drettakis,et al.  Relief : A Modeling by Drawing Tool , 2004 .

[29]  Takeo Igarashi,et al.  Smooth meshes for sketch-based freeform modeling , 2003, I3D '03.