Modeling by example

In this paper, we investigate a data-driven synthesis approach to constructing 3D geometric surface models. We provide methods with which a user can search a large database of 3D meshes to find parts of interest, cut the desired parts out of the meshes with intelligent scissoring, and composite them together in different ways to form new objects. The main benefit of this approach is that it is both easy to learn and able to produce highly detailed geometric models -- the conceptual design for new models comes from the user, while the geometric details come from examples in the database. The focus of the paper is on the main research issues motivated by the proposed approach: (1) interactive segmentation of 3D surfaces, (2) shape-based search to find 3D models with parts matching a query, and (3) composition of parts to form new models. We provide new research contributions on all three topics and incorporate them into a prototype modeling system. Experience with our prototype system indicates that it allows untrained users to create interesting and detailed 3D models.

[1]  Ramesh C. Jain,et al.  Three-dimensional object recognition , 1985, CSUR.

[2]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[3]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using orthonormal matrices , 1988 .

[4]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Marc Rioux,et al.  Nefertiti: a query by content software for three-dimensional models databases management , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[6]  Pheng-Ann Heng,et al.  Interactive Volume Cutting , 1998, Graphics Interface.

[7]  Sven Loncaric,et al.  A survey of shape analysis techniques , 1998, Pattern Recognit..

[8]  Satoshi Matsuoka,et al.  Teddy: A Sketching Interface for 3D Freeform Design , 1999, SIGGRAPH Courses.

[9]  Hiromasa Suzuki,et al.  Interactive Mesh Fusion Based on Local 3D Metamorphosis , 1999, Graphics Interface.

[10]  Dinesh Manocha,et al.  Interactive surface decomposition for polyhedral morphing , 1999, The Visual Computer.

[11]  Hans-Christian Hege,et al.  Fast and intuitive generation of geometric shape transitions , 2000, The Visual Computer.

[12]  M. T. Suzuki,et al.  A Web-based retrieval system for 3D polygonal models , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[13]  Peter-Pike J. Sloan,et al.  Shape by example , 2001, I3D '01.

[14]  Marc Alexa,et al.  Local control for mesh morphing , 2001, Proceedings International Conference on Shape Modeling and Applications.

[15]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[16]  Roddy MacLeod,et al.  Coarse Filters for Shape Matching , 2002, IEEE Computer Graphics and Applications.

[17]  Yunjin Lee,et al.  Geometric Snakes for Triangular Meshes , 2002, Comput. Graph. Forum.

[18]  Michael Elad,et al.  Content based retrieval of VRML objects: an iterative and interactive approach , 2002 .

[19]  David E. Breen,et al.  Level set surface editing operators , 2002, ACM Trans. Graph..

[20]  David P. Dobkin,et al.  A search engine for 3D models , 2003, TOGS.

[21]  Thomas A. Funkhouser,et al.  Early experiences with a 3D model search engine , 2003, Web3D '03.

[22]  Remco C. Veltkamp,et al.  Polyhedral Model Retrieval Using Weighted Point Sets , 2003, Int. J. Image Graph..

[23]  Dejan V. VraniC.  An improvement of rotation invariant 3D-shape based on functions on concentric spheres , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[24]  G. Curtis.  Disarmed: The Story of the Venus de Milo , 2003 .

[25]  Ayellet Tal,et al.  Hierarchical mesh decomposition using fuzzy clustering and cuts , 2003, ACM Trans. Graph..

[26]  Ming Ouhyoung,et al.  On Visual Similarity Based 3D Model Retrieval , 2003, Comput. Graph. Forum.

[27]  Frank Nielsen,et al.  A Sketching Interface for Modeling the Internal Structures of 3D Shapes , 2003, Smart Graphics.

[28]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark , 2004, Proceedings Shape Modeling Applications, 2004..

[29]  Michael Kazhdan,et al.  SHAPE REPRESENTATIONS AND ALGORITHMS FOR 3D MODEL RETRIEVAL , 2004 .

[30]  Remco C. Veltkamp,et al.  A survey of content based 3D shape retrieval methods , 2004, Proceedings Shape Modeling Applications, 2004..

[31]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[32]  J. Hughes,et al.  SKETCH: an interface for sketching 3D scenes , 1996, SIGGRAPH Courses.