Characterization of 3D shape parts for semantic annotation

3D content stored in big databases or shared on the Internet is a precious resource for several applications, but unfortunately it risks being underexploited due to the difficulty of retrieving it efficiently. In this paper we describe a system called the ''ShapeAnnotator'' through which it is possible to perform non-trivial segmentations of 3D surface meshes and annotate the detected parts through concepts expressed by an ontology. Each part is connected to an instance that can be stored in a knowledge base to ease the retrieval process based on semantics. Through an intuitive interface, users create such instances by simply selecting proper classes in the ontology; attributes and relations with other instances can be computed automatically based on a customizable analysis of the underlying topology and geometry of the parts. We show how our part-based annotation framework can be used in two scenarios, namely for the creation of avatars in emerging Internet-based virtual worlds, and for product design in e-manufacturing.

[1]  J. Rossignac,et al.  Plumber: a method for a multi-scale decomposition of 3D shapes into tubular primitives and bodies , 2004, SM '04.

[2]  李幼升,et al.  Ph , 1989 .

[3]  Marco Attene,et al.  Paper Number: Esda2008-59478 – Preprint Version Shape Knowledge Annotation for Virtual Product Sharing and Reuse , 2022 .

[4]  R GruberThomas.  Toward principles for the design of ontologies used for knowledge sharing , 1995 .

[5]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark , 2004, Proceedings Shape Modeling Applications, 2004..

[6]  Joe Marks.  ACM SIGGRAPH 2004 Papers , 2004, SIGGRAPH 2004.

[7]  Carsten Saathoff.  CONSTRAINT REASONING FOR REGION-BASED IMAGE LABELLING , 2006 .

[8]  Jérôme Gensel,et al.  An MPEG-7 framework enhancing the reuse of 3D models , 2006, Web3D '06.

[9]  Denis Gracanin.  Proceedings of the eleventh international conference on 3D web technology , 2006 .

[10]  Theodosios Pavlidis,et al.  Integrating region growing and edge detection , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Imre Horváth,et al.  Development and Application of Design Concept Ontologies for Contextual Conceptualization , 1998 .

[12]  Mathieu Desbrun,et al.  Variational shape approximation , 2004, SIGGRAPH 2004.

[13]  Nicola Guarino,et al.  Formal ontology, conceptual analysis and knowledge representation , 1995, Int. J. Hum. Comput. Stud..

[14]  Marco Attene,et al.  Hierarchical mesh segmentation based on fitting primitives , 2006, The Visual Computer.

[15]  Baozong Yuan,et al.  A new algorithm for texture segmentation based on edge detection , 1991, Pattern Recognit..

[16]  Marco Attene,et al.  Part-Based Annotation of Virtual 3D Shapes , 2007, 2007 International Conference on Cyberworlds (CW'07).

[17]  Herwart Opitz,et al.  A classification system to describe workpieces , 1970 .

[18]  Marco Attene,et al.  Computational methods for understanding 3D shapes , 2006, Comput. Graph..

[19]  H. Barlow.  Vision: A computational investigation into the human representation and processing of visual information: David Marr. San Francisco: W. H. Freeman, 1982. pp. xvi + 397 , 1983 .

[20]  Giuseppe Patanè,et al.  From geometric to semantic human body models , 2006, Comput. Graph..

[21]  Marco Attene,et al.  Semantic Annotation of 3D Surface Meshes Based on Feature Characterization , 2007, SAMT.

[22]  Gabriel Taubin,et al.  Cutting and Stitching: Converting Sets of Polygons to Manifold Surfaces , 2001, IEEE Trans. Vis. Comput. Graph..

[23]  A. Miene,et al.  On Textures: A Sketch of a Texture-Based Image Segmentation Approach , 2000 .

[24]  Marco Attene,et al.  Part-Based Annotation of Virtual 3D Shapes , 2007, CW 2007.

[25]  Nicola Guarino,et al.  Formal Ontology and Information Systems , 1998 .

[26]  Alan F. Smeaton,et al.  Video retrieval using dialogue, keyframe similarity and video objects , 2005, IEEE International Conference on Image Processing 2005.

[27]  Marco Attene,et al.  Mesh Segmentation - A Comparative Study , 2006, IEEE International Conference on Shape Modeling and Applications 2006 (SMI'06).

[28]  Konstantin Mischaikow,et al.  Feature-based surface parameterization and texture mapping , 2005, TOGS.

[29]  I. Biederman.  Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[30]  Steffen Staab,et al.  M-OntoMat-Annotizer: Image Annotation Linking Ontologies and Multimedia Low-Level Features , 2006, KES.

[31]  Daniel Thalmann,et al.  Real-Time Animation of Realistic Virtual Humans , 1998, IEEE Computer Graphics and Applications.

[32]  Ariel Shamir,et al.  Segmentation and Shape Extraction of 3D Boundary Meshes , 2006, Eurographics.