Modeling by example

In this paper, we investigate a data-driven synthesis approach to constructing 3D geometric surface models. We provide methods with which a user can search a large database of 3D meshes to find parts of interest, cut the desired parts out of the meshes with intelligent scissoring, and composite them together in different ways to form new objects. The main benefit of this approach is that it is both easy to learn and able to produce highly detailed geometric models -- the conceptual design for new models comes from the user, while the geometric details come from examples in the database. The focus of the paper is on the main research issues motivated by the proposed approach: (1) interactive segmentation of 3D surfaces, (2) shape-based search to find 3D models with parts matching a query, and (3) composition of parts to form new models. We provide new research contributions on all three topics and incorporate them into a prototype modeling system. Experience with our prototype system indicates that it allows untrained users to create interesting and detailed 3D models.

[1]  Ayellet Tal,et al.  Hierarchical mesh decomposition using fuzzy clustering and cuts , 2003, ACM Trans. Graph..

[2]  H. Simon,et al.  Learning Mathematics From Examples and by Doing , 1987 .

[3]  Frederick P. Brooks,et al.  No Silver Bullet: Essence and Accidents of Software Engineering , 1987 .

[4]  Gerard J. Holzmann,et al.  The Model Checker SPIN , 1997, IEEE Trans. Software Eng..

[5]  Thomas A. Funkhouser,et al.  Early experiences with a 3D model search engine , 2003, Web3D '03.

[6]  Vadim Okun,et al.  Mutation operators for specifications , 2000, Proceedings ASE 2000. Fifteenth IEEE International Conference on Automated Software Engineering.

[7]  David P. Dobkin,et al.  A search engine for 3D models , 2003, TOGS.

[8]  Jonathan Edwards,et al.  Subtext: uncovering the simplicity of programming , 2005, OOPSLA '05.

[9]  Ming Ouhyoung,et al.  On Visual Similarity Based 3D Model Retrieval , 2003, Comput. Graph. Forum.

[10]  Mark Harman,et al.  The relationship between program dependence and mutation analysis , 2001 .

[11]  Waclaw Zalewski,et al.  Shaping Structures: Statics , 1997 .

[12]  Hans-Christian Hege,et al.  Fast and intuitive generation of geometric shape transitions , 2000, The Visual Computer.

[13]  Peter-Pike J. Sloan,et al.  Shape by example , 2001, I3D '01.

[14]  P. Pirolli Effects of Examples and Their Explanations in a Lesson n Recursion: A Production System Analysis , 1991 .

[15]  Michael D. Ernst,et al.  Dynamically discovering likely program invariants , 2000 .

[16]  Fred Cohen Managing network security: Why everything keeps failing , 2000 .

[17]  Yunjin Lee,et al.  Geometric Snakes for Triangular Meshes , 2002, Comput. Graph. Forum.

[18]  Paulo César Masiero,et al.  Mutation testing applied to validate specifications based on statecharts , 1999, Proceedings 10th International Symposium on Software Reliability Engineering (Cat. No.PR00443).

[19]  Robert Seater Core Extraction and Non-Example Generation: Debugging and Understanding Logical Models , 2004 .

[20]  Thomas Ellman,et al.  Explanation-based learning: a survey of programs and perspectives , 1989, CSUR.

[21]  Sebastian Thrun,et al.  Explanation Based Learning: A Comparison of Symbolic and Neural Network Approaches , 1993, ICML.

[22]  Patrick Henry Winston,et al.  Learning structural descriptions from examples , 1970 .

[23]  Mark Harman,et al.  Using program slicing to assist in the detection of equivalent mutants , 1999, Softw. Test. Verification Reliab..

[24]  Remco C. Veltkamp,et al.  Polyhedral Model Retrieval Using Weighted Point Sets , 2003, Int. J. Image Graph..

[25]  Stuart J. Russell Tree-Structured Bias , 1988, AAAI.

[26]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[27]  M. T. Suzuki,et al.  A Web-based retrieval system for 3D polygonal models , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[28]  Tom M. Mitchell,et al.  Explanation-Based Generalization: A Unifying View , 1986, Machine Learning.

[29]  Hiromasa Suzuki,et al.  Interactive Mesh Fusion Based on Local 3D Metamorphosis , 1999, Graphics Interface.

[30]  J. LeFevre,et al.  Do Written Instructions Need Examples , 1986 .

[31]  Roddy MacLeod,et al.  Coarse Filters for Shape Matching , 2002, IEEE Computer Graphics and Applications.

[32]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  David E. Breen,et al.  Level set surface editing operators , 2002, ACM Trans. Graph..

[34]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using orthonormal matrices , 1988 .

[35]  Anne Verroust-Blondet,et al.  Three-dimensional metamorphosis: a survey , 1998, The Visual Computer.

[36]  T. Funkhouser,et al.  Shape representations and algorithms for three-dimensional model retrieval , 2004 .

[37]  Wladyslaw M. Turski,et al.  No Silver Bullet - Essence and Accidents of Software Engineering - Response , 1986, IFIP Congress.

[38]  Michelene T. H. Chi,et al.  Eliciting Self-Explanations Improves Understanding , 1994, Cogn. Sci..

[39]  Remco C. Veltkamp,et al.  A Survey of Content Based 3D Shape Retrieval Methods , 2004, SMI.

[40]  Richard A. Lewis,et al.  Drug design by machine learning: the use of inductive logic programming to model the structure-activity relationships of trimethoprim analogues binding to dihydrofolate reductase. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[41]  Michael D. Ernst,et al.  Selecting Predicates for Implications in Program Analysis , 2002 .

[42]  Sven Loncaric,et al.  A survey of shape analysis techniques , 1998, Pattern Recognit..

[43]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[44]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[45]  Gerald DeJong,et al.  Generalizations Based on Explanations , 1981, IJCAI.

[46]  Pheng-Ann Heng,et al.  Interactive Volume Cutting , 1998, Graphics Interface.

[47]  Prasad Tadepalli,et al.  Learning from Queries and Examples with Tree-structured Bias , 1993, ICML.

[48]  Allen Newell,et al.  Chunking in Soar: The anatomy of a general learning mechanism , 1985, Machine Learning.

[49]  Eugene S. Ferguson,et al.  Engineering and the Mind's Eye , 1994 .

[50]  Jonathan Edwards,et al.  Example centric programming , 2004, SIGP.

[51]  Thomas G. Dietterich,et al.  Learning with Many Irrelevant Features , 1991, AAAI.

[52]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark , 2004, Proceedings Shape Modeling Applications, 2004..

[53]  Dennis F. Kibler,et al.  Learning Symbolic Prototypes , 1997, ICML.

[54]  Marc Rioux,et al.  Nefertiti: a query by content software for three-dimensional models databases management , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[55]  Clayton Lewis,et al.  Why and How to Learn Why: Analysis-Based Generalization of Procedures , 1988, Cogn. Sci..

[56]  Dejan V. VraniC An improvement of rotation invariant 3D-shape based on functions on concentric spheres , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[57]  Dennis F. Kibler,et al.  Learning Prototypical Concept Descriptions , 1995, ICML.

[58]  Peter L. T. Pirolli,et al.  Modeling Individual Differences in Students' Learning Strategies , 1995 .

[59]  Frank Nielsen,et al.  A sketching interface for modeling the internal structures of 3D shapes , 2006, Smart Graphics.

[60]  Fausto Giunchiglia,et al.  NUSMV: A New Symbolic Model Verifier , 1999, CAV.

[61]  Richard J. Lipton,et al.  Theoretical and empirical studies on using program mutation to test the functional correctness of programs , 1980, POPL '80.

[62]  Ashwin Srinivasan,et al.  Mutagenesis: ILP experiments in a non-determinate biological domain , 1994 .

[63]  Randall B. Smith,et al.  SELF: The power of simplicity , 1987, OOPSLA '87.

[64]  Dinesh Manocha,et al.  Interactive surface decomposition for polyhedral morphing , 1999, The Visual Computer.

[65]  John Sweller,et al.  Should Problem Solving Be Used as a Learning Device in Mathematics , 1989 .

[66]  Marvin Minsky,et al.  A framework for representing knowledge , 1974 .

[67]  Michael Elad,et al.  Content based retrieval of VRML objects: an iterative and interactive approach , 2002 .

[68]  M J Sternberg,et al.  Automated discovery of structural signatures of protein fold and function. , 2001, Journal of molecular biology.

[69]  Marc Alexa,et al.  Local control for mesh morphing , 2001, Proceedings International Conference on Shape Modeling and Applications.

[70]  G. Curtis Disarmed: The Story of the Venus de Milo , 2003 .

[71]  Michael Kazhdan,et al.  SHAPE REPRESENTATIONS AND ALGORITHMS FOR 3D MODEL RETRIEVAL , 2004 .

[72]  Ramesh C. Jain,et al.  Three-dimensional object recognition , 1985, CSUR.

[73]  Manu Sridharan,et al.  A micromodularity mechanism , 2001, ESEC/FSE-9.

[74]  Nils J. Nilsson,et al.  Artificial Intelligence , 1974, IFIP Congress.