3D-centered Media Linking and Semantic Enrichment through Integrated Searching, Browsing, Viewing and Annotating

The digitally documented world heritage is archived in databases or repositories, where collections of metadata, images, multimedia objects or nowadays even digital 3D artifacts can be stored and queried. Modeling and linking all this information is complex and involves refined categorizations and relations, which are usually accessed by either simplistic or overwhelmingly complex interfaces. Hence, finding the right level of abstraction for a general interface is very challenging. This becomes even more demanding, if in addition to collection exploration, semantic enrichment is required. This work focuses on the design and implementation of an integrated interface, in which four dedicated activities are combined and provided: i) flexible definition of relational queries, ii) browsing of multiple results and query refinement, iii) inspection and analysis of multimedia objects, and iv) building and enrichment of semantic relationships (data paths) between objects. This integrated interface can handle different kinds of multimedia objects, allowing for querying and annotating text, 2D images or 3D artifacts. We present the software design of this interface and the corresponding underlying model in the semantic network. This work is a general step toward interfacing to 3D Linked Open Data.

[1]  Fabio Pittarello,et al.  ToBoA-3D: an architecture for managing top-down and bottom-up annotated 3D objects and spaces on the web , 2011, Web3D '11.

[2]  Ariel Shamir,et al.  A survey on Mesh Segmentation Techniques , 2008, Comput. Graph. Forum.

[3]  Federico Ponchio,et al.  Multiresolution structures for interactive visualization of very large 3D datasets , 2009 .

[4]  Martin Doerr,et al.  Modeling and querying provenance by extending CIDOC CRM , 2010, Distributed and Parallel Databases.

[5]  Leila De Floriani,et al.  A Java3D framework for inspecting and segmenting 3D models , 2008, Web3D '08.

[6]  Dinesh Manocha,et al.  Quick-VDR: interactive view-dependent rendering of massive models , 2004, SIGGRAPH '04.

[7]  Sven Havemann,et al.  The arrigo showcase reloaded—towards a sustainable link between 3D and semantics , 2008, JOCCH.

[8]  Robin C. Cover,et al.  Metadata Encoding and Transmission Standard (METS) , 2002 .

[9]  Thomas A. Funkhouser,et al.  A benchmark for 3D mesh segmentation , 2009, ACM Trans. Graph..

[10]  Antonio Brogi,et al.  Digital reconstruction of the Arrigo VII funerary complex , 2004, VAST.

[11]  Jane Hunter,et al.  Harvesting community annotations on 3D models of museum artefacts to enhance knowledge, discovery and re-use , 2010 .

[12]  Antti Saaksvuori,et al.  Product lifecycle management , 2004 .

[13]  David B. Arnold,et al.  Web based presentation of semantically tagged 3D content for public sculptures and monuments in the UK , 2009, Web3D '09.

[14]  Ellen Yi-Luen Do,et al.  Immersive redlining and annotation of 3D design models on the Web , 1999 .

[15]  Ellen Yi-Luen Do,et al.  Annotating and sketching on 3D web models , 2002, IUI '02.

[16]  Dinesh Manocha,et al.  Massive model visualization techniques: course notes , 2008, SIGGRAPH '08.

[17]  Martin Doerr,et al.  A Distributed Object Repository for Cultural Heritage , 2010, VAST.

[18]  Paolo Cignoni,et al.  Adaptive TetraPuzzles: Ecient Out-of-Core Construction and Visualization of Gigantic Multiresolution Polygonal Models , 2004, SIGGRAPH 2004.

[19]  Paolo Cignoni,et al.  Batched multi triangulation , 2005, VIS 05. IEEE Visualization, 2005..

[20]  Martin Doerr,et al.  A Repository for 3D Model Production and Interpretation in Culture and Beyond , 2010, VAST.

[21]  Dinesh Manocha,et al.  Quick-VDR: interactive view-dependent rendering of massive models , 2004, IEEE Visualization 2004.

[22]  Eric C. Jensen,et al.  Metadata Encoding and Transmission Standard , 2009, Encyclopedia of Database Systems.

[23]  Paolo Cignoni,et al.  Adaptive tetrapuzzles: efficient out-of-core construction and visualization of gigantic multiresolution polygonal models , 2004, ACM Trans. Graph..

[24]  Marco Attene,et al.  Semantic Annotation of 3D Surface Meshes Based on Feature Characterization , 2007, SAMT.

[25]  Thomas Funkhouser,et al.  A benchmark for 3D mesh segmentation , 2009, SIGGRAPH 2009.

[26]  Martin Doerr,et al.  CRMdig: A Generic Digital Provenance Model for Scientific Observation , 2011, TaPP.