Generative Object Definition and Semantic Recognition

''What is the difference between a cup and a door?'' These kinds of questions have to be answered in the context of digital libraries. This semantic information, which describes an object on a high, abstract level, is needed in order to provide digital library services such as indexing, markup and retrieval. In this paper we present a new approach to encode and to extract such semantic information. We use generative modeling techniques to describe a class of objects: each class is represented by one algorithm; and each object is one set of high-level parameters, which reproduces the object if passed to the algorithm. Furthermore, the algorithm is annotated with semantic information, i.e. a human-readable description of the object class it represents. We use such an object description to recognize objects in real-world data e.g. laser scans. Using an algorithmic object description, we are able to identify 3D subparts, which can be described and generated by the algorithm. Furthermore, we can determine the needed input parameters. In this way, we can classify objects, recognize them semantically and we can determine their parameters (cup's height, radius, etc.).

[1]  Dieter W. Fellner,et al.  Modeling Procedural Knowledge: A Generative Modeler for Cultural Heritage , 2010, EuroMed.

[2]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[3]  Torsten Ullrich,et al.  Euclides - A JavaScript to PostScript Translator , 2010 .

[4]  Daniel A. Keim,et al.  Content-Based 3D Object Retrieval , 2007, IEEE Computer Graphics and Applications.

[5]  Mine Özkar,et al.  Introduction to shape grammars , 2008, SIGGRAPH '08.

[6]  Dietmar Saupe,et al.  Guest Editors' Introduction: 3D Documents , 2007, IEEE Computer Graphics and Applications.

[7]  James Arvo,et al.  Creating generative models from range images , 1999, SIGGRAPH.

[8]  V. Settgast,et al.  Information technology for cultural heritage , 2007, IEEE Potentials.

[9]  Leonidas J. Guibas,et al.  Discovering structural regularity in 3D geometry , 2008, SIGGRAPH 2008.

[10]  Liu Guanghui,et al.  Global convergence of the fletcher-reeves algorithm with inexact linesearch , 1995 .

[11]  Leonidas J. Guibas,et al.  Partial and approximate symmetry detection for 3D geometry , 2006, ACM Trans. Graph..

[12]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[13]  Dieter W. Fellner,et al.  Semantic fitting and reconstruction , 2008, JOCCH.

[14]  Philip E. Gill,et al.  Practical optimization , 1981 .

[15]  Dieter W. Fellner,et al.  Compilation of procedural models , 2008, Web3D '08.

[16]  Sven Havemann,et al.  Generative mesh modeling , 2005 .

[17]  H. Seidel,et al.  A connection between partial symmetry and inverse procedural modeling , 2010, SIGGRAPH 2010.

[18]  Dieter W. Fellner,et al.  Distance Calculation between a Point and a Subdivision Surface , 2007, VMV.

[19]  Dieter W. Fellner.  Graphics Content in Digital Libraries: Old Problems, Recent Solutions, Future Demands , 2001, J. Univers. Comput. Sci..

[20]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[21]  Emilly Budlong.  Multimedia Information Extraction , 2007 .

[22]  Dieter W. Fellner,et al.  Procedural Modeling in Theory and Practice , 2010 .

[23]  Ilkay Ulusoy,et al.  Generative versus discriminative methods for object recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[24]  Zhengyou Zhang,et al.  Parameter estimation techniques: a tutorial with application to conic fitting , 1997, Image Vis. Comput..